Place to Work.

Place for Check in.

Recently someone asked how to find OSM users who’ve left a changeset comment, but have not edited themselves. (Technically the initial challenge was for a one line bash script 😉).

Here’s how to do it.

In OpenStreetMap, people can change their username, but OSM data provides an unchanging numeric user id (uid) for users, which we use here.

First download the dump file, from the OpenStreetMap data download serivce (planet.osm.org) ⁽¹⁾.

aria2c --seed-time=0 https://planet.openstreetmap.org/planet/discussions-latest.osm.bz2.torrent

This will download discussions-YYMMDD.osm.bz2⁽²⁾, which is currently about 5 GiB.

I had to write a new tool, anglosaxon to easily parse large XML files like this into a TSV file format⁽³⁾. This programme works on all XML files, maybe it’s useful for other problems you might have. Install that first.

bzcat discussions-220110.osm.bz2 \
  | anglosaxon \
   -S -o changeset_id --tab -o changeset_uid --tab -o comment_uid --nl \
   -s comment -v ../../id --tab -V ../../uid NO_CHANGESET_UID --tab -V uid NO_COMMENT_UID  --nl \
   | gzip > changeset-comments.tsv.gz

This took about 45 minutes to run on my machine, and the output is about 4 MiB (19 MiB uncompressed), and has about 805,000 lines. This step takes the longest.

We create the list of all uids who have opened a changeset:

zcat changeset-comments.tsv.gz | cut -f2 |uniq|sort |uniq > changeset-uids.tsv

Then a list of all uids who have left a changeset comment:

zcat changeset-comments.tsv.gz | cut -f3 |uniq|sort|uniq > comment-uids.tsv

Then we compare, what’s in one but not the other.

comm -13 changeset-uids.tsv comment-uids.tsv |sort -n > uids-comment-without-changeset.tsv

Et voilà! Sin é! And there’s your results. 🙂 The file is 29 KiB, and has ~3,500 entries. I’m surprised it’s so high.⁽⁴⁾

You can find all the changesets that a uid has commented on with this command, (replace UID with the uid)

zcat changeset-comments.tsv.gz | grep -P "\tUID$" | cut -f1

… See full entry

When we create a goal of how to increase the number of mappers in a community we have to take into account who will consume and how this data reached the final public, it is a proportional account, the greater the number of consumers the greater the number of mappers in the region. We need to consider OpenStreetMap as a complex ecosystem that goes beyond the open mapping community and that each group has specific needs. I propose that to better understand the OSM ecosystem we divide it into three groups of users: consumers, distributors and producers, and exercise a little reflection on each group

Consumers: are users who use the map as an end product for navigation, data visualization, planning, search, etc.. without contributing actively.

• How do they access the maps? (whether for navigation, transportation, exploring, trails, etc.)
• How often do you use maps?
• What impediments do you have to use OSM in your daily life?

Producers: all those who actively contribute to the map the known mappers.

• What is the profile of mappers in the region?
• What problems do these mappers face? (socio-economically)
• What tools do they use to map?
• How can we motivate these mappers?
• What are the objectives of the mappers for the region?

Distributors we can classify distributors as those who use the map as a basis for their applications within the communities such as a government that needs to disseminate geographic data or a company that needs its consumers to find its physical stores or any application that needs a map to show its data.

• How can we attract more distributors?
• What is stopping a distributor from using OSM?
• How can we improve our tools to attract more distributors?
• What data do distributors in the region need?

By asking these questions we can get a more complete profile about each group and define ways to target each group according to their interests and needs.

com esse codigo de exemplo você consegue pesquisar em qualquer area escolas que ja estejam mapeadas no OSM. Execute esse codigo no site; https://overpass-turbo.eu/

copie o codigo abaixo para o site;

https://overpass-turbo.eu/

e em seguida execute o mesmo, com o resultado clique em exportar e em seguida faça o Download do arquivo em Geojosn, feito isso você pode mapear no editor Josm ou em outro Editor de sua Preferencia.

/* This has been generated by the overpass-turbo wizard. The original search was: “escola” */ [out:json][timeout:25]; // gather results ( // query part for: “escola” node“amenity”=”school”; way“amenity”=”school”; relation“amenity”=”school”; ); // print results out body; >; out skel qt;

with this example code you can search in any area for schools that are already mapped in OSM. Run this code on the website; https://overpass-turbo.eu/

copy the code below to the site;

https://overpass-turbo.eu/

and then run it, with the result click on export and then download the file in Geojosn, done that you can map it in the Josm editor or in another editor of your choice.

Raphael de Assis Recife/PE.

Zabrałem się ostatnio za poprawę przystanków oznaczonych dawno temu. Z dzisiejszej perspektywy błędne jest tagowanie węzłów highway=bus_stop na drogach - powinny być w miejscu oczekiwania.

W Polsce miejscem z wieloma takimi błędami jest Metropolia GZM. Poniżej opiszę jak ja poprawiam te błędy.

… See full entry

Problem users, whether it be vandals, trolls, spammers, or undisclosed/”rogue” organized mapping projects, is considered a problem all across OSM, but I would like to bring up some top examples of notorious problem users and major incidents involving organized mapping groups from the Philippines. Such edits are a perennial problem in the Philippines OSM community, and particularly in the time of COVID, I think the extended mass quarantines has make this problem worse as more people will be spending time in front of their computer, laptop, cellphone or tablet. While we have a ticket system to monitor suspicious editing activity, I feel it’s kind of Wild Wild West in OSM in the Philippines; new users are increasing (usually ones who only edit a few features, usually in their home area, before riding off into sunset) and not everyone will be patrolling the map for fishy changesets.

Vandals/trolls

bryanpiczon

Long-term vandal, often adding fantasy features usually in the Eastern Visayas region of the Philippines. Has abused multiple accounts. Mostly interested in power lines and roads. Also vandalized areas outside the Philippines,

Joey Samson

Vandalism related to speculative real estate and transportation projects, especially around Manila. Some edits resulted in mass deletions (e.g. a former movie theater south of Manila). Also pesters users to add admin boundaries. 2 accounts traced so far (1 deleted following block)

Niwre Erv Apotseg

Vandal from Mindanao. Mostly duplicated roads, but also have added fictional features. Comments often nonsensical alphabet soup. Had 3 sock puppets.

Mass copying from GMaps

… See full entry

امام صادق علیه‌السلام فرمود: مصلحت زندگى و معاشرت اجتماعى، به پیمان‌ه‏اى پر می‌ماند که دو سوم آن هوش و زیرکى، و یک‌سومش نادیده گرفتن و تجاهل است‏.

Bonjour ! Je contribue depuis quelques années et ce que j’apprécie le plus, c’est la contribution de terrain. J’ai pu expérimenter plusieurs styles et cette entrée du journal a pour but de vous montrer ces styles, d’en discuter en commentaire et de voir comment je pourrais améliorer tout ça.

À pied

Édition directe

Quand je vais sur le terrain pour une contribution, j’ai le plus souvent sur moi uniquement mon téléphone android. J’utilise plusieurs applications qui me permettent la contribution.

StreetComplete

StreetComplete est l’application que j’utilise le plus souvent maintenant pour la contribution sur le terrain. C’est une application qui propose des « quêtes » sous forme de petites questions simples et rapides positionnées sur les éléments de la carte qui ne sont pas entièrement qualifiés. Par exemple, si la carte montre un bac de recyclage, l’application demandera ce qu’on a le droit d’y jeter et cela contribue une nouvelle donnée dans OSM.

… See full entry

Never Stop learning Because OpenStreetMap Never Stop upgrading

We’ve got to know that slow by slow makes journey. I encourage Local communities as well as underrepresented ones ,Mothers , Girls To keep mapping as long as it gives fun and no specific time to do so. Map in your lovely moments slow by slow we shall have a Women community of active Mappers.

OSM Rwanda community.

As many of you know, over the last 6 months or so, we have been reimagining what the future of the Tasking Manager could look like for HOT and the wider Humanitairan and OSM communities.

We have taken the time to reflect and consult in an effort to create a new model for Tasking Manager that aspires to get the Tasking Manager back to its community software roots. You can read about the ‘TM Tomorrow’ here to get up to speed and find (or contribute) questions and answers you may also have.

As the next step in the TM Tomorrow journey, we are now looking for an individual who would like to volunteer as a community caretaker for the Tasking Manager and are open to anyone who would like to express their interest in this position. You can read the full position description here >

Position description tldr;
* Expected time commitment is about 5 hours a week.
* Responsibilities include, project direction, roadmaps and issue prioritisation.
* Will be supported by TM Maintainers, hot_tech collective facilitator, and hot_tech in general.

A few questions that have arisen since we first started talking about this idea that may be helpful to those considering expressing their interest (or feedback).

Q: Why are you doing this?
The short answer to this is to reduce our control and reignite the collective. HOT recognises its role in taking primary control for the project in recent years and the effects of this (and recognise those effects haven’t always been positive). While this did allow us to move things forward, we also recognise our control has reduced engagement of our collective of contributors, stakeholders and users. Moving forward, we want to reduce HOT’s control of the project and shift power back into the collective, where HOT serves and supports the collective, rather than substituting it.

… See full entry

joined OpenMap

“Cartographic generalization, or map generalization, <…> is a core part of cartographic design.”

Yet it is quite often unknown or understood incorrectly/partly. This article has a pretty good description of generalisation, it’s purpose, history and main operators with some examples of where OSM-Carto is missing generalisation.

https://en.wikipedia.org/wiki/Cartographic_generalization

GPS tracks versus image aligned to a surveyed position (cm level RTK) 7 km away - displacement of 20+ meters North South axis.

Surveyed position might have image provider problem, that is, improper stitching and alignment of photo imageries during processing.

GPS tracks has the problems of inherently inaccurate receiver, placement of phone during recording, and possible Kalman filter in the gps app.

Mappers have the problem of not knowing that only JOSM has the imagery alignment database.

Este artículo hace parte de una serie de artículos relacionados con notas:

• Las notas de OpenStreetMap.
• Manipulación de notas.
• Análisis de notas.
• Técnicas de creación y resolución de notas.
• Finalización proyecto de cerrado de notas en Colombia.

Cuando resolvemos notas hay principalmente dos tipos de notas:

• Las que se resuelven efectuando un cambio en el mapa.
• Las que no aportan con un cambio en el mapa.

Puede haber una tercera categoría y es cuando se genera una discusión sobre la nota, pero inicialmente no implica un mapeo directo, o por el contrario genera un cambio en el mapa pero continúa una discusión. Sin embargo, por ser una mezcla de las dos anteriores, no la vamos a tener en cuenta.

Notas que aportan con un cambio

Bajo este tipo de notas se pueden realizar 3 operaciones:

• Las que agregan algo nuevo al mapa.
• Las que piden un cambio en el mapa.
• Las que muestran que el mapa está desactualizado o hay algún error que borrar.

Las notas que se crean por medio de aplicaciones como Maps.me, StreetComplete, OrganicMaps u OnOSM.org, en la mayoría de los casos son de este tipo, las que aportan, ya que en cierta forma son asistidas, y las personas saben qué reportar.

Agregan algo al mapa

En estas notas están las que indican de un nuevo lugar que no está mapeado. Por ejemplo, un nuevo restaurante, el nombre de un barrio, etc. Pero también, cuando complementan algo que no estaba mapeado. Por ejemplo, la superficie de una vía, o la dirección de una construcción.

… See full entry

最近發現有個中國帳號正規化 KFC 的標籤，編輯變動的 boundary 有夠大，甚至把台灣包進去。近期一些主要的 QA 工具如 OSMCha並沒有辦法處理這麼大的 boundary，無法視覺化編輯，看到到底動了什麼，可能是 Overpass API 出問題，因此需要手動檢核有沒有動到台灣的物件。檢查之後應該是沒有動到台灣的物件，但他在編輯變動留言說沒有動到「台灣地區」，這台灣沒在用的名字看了不是很舒服。

我這邊建議，雖然 QA 工具出問題，無法輕易檢查該次編輯是不是有狀況，雖然這筆編輯的確動的只有一個國家範圍，把編輯範圍縮小，分幾次來上傳，將編輯變動 boundary 弄小一點，避免引起誤解，也可以輕易的檢核有沒有出問題。而達人可以繼續畫地圖，避免可能的問題，然後不用花時間在溝通上面。

台灣雖然是個小地方，但是有不少辛辛苦苦畫地圖的圖客，很認真依照事實，看眼前的事物來加東西到 OpenStreetMap 上面。但有時遇到人要挑戰事實，加上非事實的事物，強逼台灣人接受非在地觀點的事物。這種事情是違反 OpenStreetMap 的現地觀察事物，才能加上 OpenStreetMap 上面的 on the ground truth 原則。

OpenStreetMap 的如同其姊妹計畫維基百科一樣，是人人看到怪怪的東西，就可以動手修改，甚至不存在的事物也可以直接移除，不需要有較高的權限。而比較需要背景知識的 reverter 則不一定要管理員才能用，有得到社群共識動手都可以。OpenStreetMap 是個參與平等的計劃，比較資深只是參與比較久，不是講話就怎樣，做事比較有資格，只要有理做什麼編輯都是允許的。

Hi all,

Just a quick heads up that MapComplete 0.14 is deployed!

Apart from lots of fixed bugs and performance improvements, a new theme showing OpenStreetMap notes has landed! Especially the filter functionality should come in handy

And of course, there are plenty of (new) themes, such as the street lighting theme (thanks Robin!) or the postboxes and -offices map (by nicolelaine).

And -by now- over 1000 individual contributors have used MapComplete.

A Microsoft disponibilizou buildings da América do Sul no RapiD. Essa é a cobertura atual

Microsoft has made South American buildings available in RapidD. This is the current coverage:

Bing Maps is releasing open building footprints dataset for countries in South America. We have detected 44.5 million buildings from Maxar imagery collected between 2020 and 2021 for regions encompassing approximately 50% of the South American population. The data is freely available for download and use under applicable license.

O Bing Maps está lançando um conjunto de dados de pegadas de edifícios abertos para países da América do Sul. Detectamos 44,5 milhões de edifícios a partir de imagens Maxar coletadas entre 2020 e 2021 para regiões que abrangem aproximadamente 50% da população sul-americana. Os dados estão disponíveis gratuitamente para download e uso sob licença aplicável.

… See full entry

Not much to say its quiet out here all except for the highway and the trains.

Link da Camada de nomes de Rua Atualizada para uso no Brasil. Inserir esse endereço na camada customizada e depois clicar em OK.

https://api.mapbox.com/styles/v1/wille/cj8lp78dn62wl2rquim47qo0g/tiles/256/{zoom}/{x}/{y}?access_token=pk.eyJ1Ijoid2lsbGUiLCJhIjoiY2t1dm4xYmF2NmEzdDMycTY3MjJtNmRwMiJ9._3qoS2hLLiJEkIDsVO4DoA

Raphael de Assis Recife/PE.