OpenStreetMap logo OpenStreetMap

Users' Diaries

Recent diary entries

Posted by Patrik_B on 31 July 2022 in English. Last updated on 6 February 2025.

When you are reading this you should be already experienced with validating and using JOSM so I will not include basics here.

Validating multiple tasks at once or “Multivalidation”

Usually I am validating projects in HOT Tasking Manager that are focused on mapping buildings. I am going to show you an example of my workflow on one of the Mozambique projects because there are two things that are not in every project and it’s very easy to validate in this area so you can try it on your own. Since writing this diary the campaign ended but you can find similar projects using this filter on the HOT Tasking Manager

I highly recommend using the shortcuts in JOSM, which you can customize, or you can put tools that you are often using to your toolbar. I will write shortcuts for windows in { }.

For Multivalidation in Mozambique I am using these tools:

EXPERT MODE
Edit → Preferences {F12} → checkbox in the bottom left corner. Thanks to this you will be able to see some stuff that has been hidden before like the number of each layer, more options for Search or some tools like extrude tool for example. If you are using shortcuts (like {X} for extrude tool) those will work even if you won’t turn on the Expert mode.

PLUGINS
List of plugins that I am using and their most useful feature for me:

  • Buildings_tools - fundamental plugin for mapping buildings
  • Todo - great tool for adding buildings, task areas, anything into list and then easily check all of them one by one
  • Utilsplugin2 - mainly for Replace geometry {Ctrl+Shift+G}
  • Mapathoner - mainly for Selecting non orthogonal buildings
  • Markseen - mark seen areas of the map
  • Conflation* - basically Replace geometry for multiple objects at once. Since it is kinda tricky and doesn't have that much of a use I leave it here just as an honorable mention.

See full entry

While I tend to keep OpenCampingMap as it is showing only the facts acquired in Openstreetmap some people argue that users want to have reviews on this kind of maps and that this is what makes Google Maps or TripAdvisor so attractive.

This might be true. Thus I have now added a button to an external FOSS review Portal called Mangroove Reviews as a proof of concept.

Posted by Mik1008 on 30 July 2022 in English.

Petsofas Temple

Getting down from Petsofas

Peak Sanctuary is spectacular and there is more than one way to get down from the top. On the way down going south-east you will encounter some old buildings and see some spectacular views in the george. Alternative path leads through the george that does not have name and further down to the beach north of Skinias beach.

The beach is rocky and rarely visited. Water is very clear. The short path south leads to Skinias beach is relatively easy.

Location: Chiona, Community of Palekastron, Itanos Municipal Unit, Municipality of Sitia, Lasithi Regional Unit, Region of Crete, Greece
Posted by tareqpi on 28 July 2022 in English. Last updated on 30 March 2024.

Hi everyone, this is an update on my progress in enhancing Nominatim’s search results ranking. For an overview of the project, you can check out my previous diary entry here. I would like to thank my mentors, Sarah Hoffman (@lonvia) and Marc Tobias (@mtmail), for their guidance throughout the implementation of this project.

Goals of the First Phase

The first phase of this project has some goals which were previously set. Below are the main goals of this phase.

  • Enabling PostGIS to work with raster files
  • Finding and implementing the most suitable method used to import GeoTIFF files
  • Conducting performance tests on the import functionality
  • Adding unit tests
  • Documenting the new changes

Hardware I Am Using

Since Nominatim with a full planet import needs a lot of computing resources, I had set up the server which allowed me to work on the project. I would like to thank OpenCage for providing me with the server to work with on this project. The specifications of the server that I am currently using are 8 core AMD Ryzen™ 7 3700X, 64GB RAM, 1TB NVMe disk (900GB usable, 850GB free), running Ubuntu 22.04 LTS.

OSM Views Data

See full entry

Location: Taman Tun Dr Ismail, Kuala Lumpur, 60000, Malaysia
Posted by SomeoneElse on 26 July 2022 in English. Last updated on 27 July 2022.

Munin

Since the release of Ubuntu 22.04 LTS, it’s now much easier to keep a tile-serving database updated. This version of Ubuntu ships with much more recent versions of osm2pgsql and osmium, so it’s easier to set up updates using those.

First things first, the new “setting up a rendering server” instructions for Ubuntu 22.04 are here. These are much shorter than they used to be because most of the software setup is done automatically as it is installed.

osm2pgsql-replication

See full entry

Location: Crossmoyle, Clones Urban ED, Ballybay-Clones Municipal District, County Monaghan, Ulster, Ireland
Posted by ChrisPark on 26 July 2022 in English. Last updated on 27 July 2022.

GitHub Project

The project indicates the milestones and progress required for project completion, although currently it is still under development as issues may be fine-tuned later with more documentation and tests.

https://github.com/orgs/valhalla/projects/1

Abstract

We are on track for the goal to re-introduce transit to Valhalla, the open-source routing engine. So far, we have the ability to convert raw GTFS data into Valhalla’s transit tiles. The transit tiles must now be connected to rest of Valhalla’s graph for routing, which are the next steps.

Updates

I have pushed updates to Valhalla, such that it no longer relies on the Transitland API to get transit data. Instead, it now reads from locally placed raw GTFS data. To achieve this, the following was done:

1) I needed an ability to read and write GTFS data. GTFS comes in a collection of text files that must be parsed into a structure below:

GTFS Connections

See full entry

Nos últimos meses tenho trabalhado bastante em municípios localizados no sertão de Pernambuco, aonde existe uma grande quantidade de vias que necessitam de mapeamento.  O pouco que existe carece de atualizações dos traços e de identificação adequada das vias e lugares.    Hoje comecei a trabalhar no município de Bodocó, PE. 
Location: Vila São Francisco, Bodocó, Região Geográfica Imediata de Araripina, Região Geográfica Intermediária de Petrolina, Pernambuco, Região Nordeste, 56220-000, Brasil
Posted by ngumenawesamson on 25 July 2022 in English. Last updated on 2 August 2022.

Background.

Even as OSM is rapidly growing in content and contributors, its credibility has been one of the main concerns for authoritative users. The belief that it is made by volunteers can limit the trust in the value of this free data source within traditional GIS communities. At HOT, we have prioritized the top 10 data quality aspects that we want to minimize. These aspects have been categorized under 3 categories the are Positional Accuracy, Semantic Accuracy, and Completeness.

We came to reach the top 10 list through a number of consultations with the Data Quality Working Group, representative from open mapping communities, and associates from HOT regional Hubs.

This information has been shared for reference by all OpenStreetMap data contributors, and users across the open mapping ecosystem, data quality associates at the HOT Regional Hubs, HOT partners and other communities that engage with OpenStreetMap.

HOT is focusing on prioritizing these aspects and implementation on how to minimize/eliminate them through HUB centered community engagements in form of trainings, collaborating with partners and developing tools that can be used to improve the quality of mapping.

There are many other issues affecting the quality of OSM data, however, our top 10 data quality aspects are;

1. Spatial offsets.

2. Temporal consistencies.

3. Feature tracing inconsistencies.

4. Road network consistency.

5. Completeness of health facilities.

6. Completeness of public service data for sustainable communities.

7. Administrative boundary inconsistencies.

8. Tagging.

9. Logical consistencies of map features.

10. Tasking Manager project consistencies.

===============================================================

1. Spatial Offsets:

An offset is the degree of deviation of an object from its intended position.

Category: Positional Accuracy

Possible Sources:

See full entry

This is a bit less OpenStreetMap related then normal, but has to do with the Standard Tile Layer and an outage we had this month.

On July 18th, the Standard Tile Layer experienced degraded service, with 4% of traffic resulting in errors for 2.5 hours. A significant factor in the time to resolve the incident was a lack of visibility of the health status of the rendering servers. The architecture consists of a content delivery network (CDN) hosted by Fastly, backed by 7 rendering servers. Fastly, like most CDNs, offers automatic failover of backends by fetching a URL on the backend server and checking its response. If the response fails, it will shift traffic to a different backend.

A bug in Apache resulted in the servers being able to handle only a reduced number of connections, causing a server to fail the health check, diverting all load to another server. This repeated with multiple servers, sending the load between them until the first server responded to the health check again because it had zero load. Because the servers were responding to most of the manually issued health checks and we had no visibility into how each Fastly node was directing its traffic, it took longer to find the cause than it should have.

Our normal monitoring is provided by Statuscake, but this wasn’t enough here. Instead of increasing the monitoring, we wanted to make use of the existing Fastly healthchecks, which probe the servers from 90 different CDN points. Besides being a vastly higher volume of checks, this more directly monitors the health checks that matter for the service

During the incident, Fastly support provided some details on how to monitor health check status. Based on this guide, the OWG has set up an API on the tile CDN to indicate backend health, and monitoring to track this across all POPs.

See full entry