8.2 Mapping POI with ODK + KoboToolbox Server
The following workflow showcases the tools and processes used in a simple field mapping project during which HOT trained local NGOs to integrate mapping into existing programs using OpenDataKit and KoboToolBox Server.
Project Overview
Bridging Gaps in Development and Emergency for the Refugee Crisis in East Africa
East Africa (and Uganda specifically) continues to be the center of one of the world’s largest and fastest growing refugee crises. Uganda’s progressive open-door policy alone has led to an influx of approximately 1.4 million refugees into the country. High mobility of refugees means distribution and size of refugee settlements changes constantly and the need for standardized accessible information to make timely informed decisions about where services need to be planned and built becomes more crucial than ever. Through the use of open-source technical tools combined with a community-based methodology, HOT has been able to address the critical data gap in these contexts by increasing real-time comprehensive data production on infrastructure and services where refugees and host communities reside. To ensure that government and organizations involved in the refugee response know that, first, this data exists and, second, how to effectively use it, HOT has worked extensively to support and train actors on how to systematically incorporate citizen-generated data into their programs to address and fill existing gaps.
Project page: BRIDGING DATA GAPS: MAPPING REFUGEE CONTEXTS IN EAST AFRICA
Dates: June 2018 - May 2019
Status: Complete
Tools used:
- Field and Remote Data collection: OpenDataKit (ODK) Collect, Kobo server, HOT Tasking Manager (ID Editor, JOSM)
- Data Field Monitoring: OSMand and Maps.me
- Data Cleaning: OpenRefine, Excel, JOSM, Python scripts
- Data Extraction and Visualization: HOT Export tool, OSM Analytics, QGIS, Overpass Turbo, Umap, HDX
Field Mapping Workflow
1. Identifying Partners’ Need and Area of Interest/Operation
Through regular interactions and planned meetings with various stakeholders & partners - including UNHCR, OPM, LWF, etc. - the Project Manager and/or Country Manager would work to understand the technical gaps and needs that institutions were facing in strengthening their contributions to the national refugee response. From this point, we would identify data gaps and the institutional skills needed to fill these areas and co-devise an implementation plan to train the group/organization over multiple days to achieve the intended results and outcomes.
Steps used in this phase:
2. Trainings and Capacity-building Exercises
After the extensive consultation process, trainings would be planned and conducted in house or at a partners’ premise. The main objective of these trainings would be to introduce - and attempt to instil - GIS tools and support capacity building with refugee response partners through custom lessons over a short number of days. These training materials were all specifically designed for each partner organization to ensure the resources matched their level of skill/understanding and enable them to adequately improve their practical knowledge. Trainings generally lasted between 2-5 days and covered topics including data collection, storage, extraction, analysis and visualization.
Steps used in this phase:
Trainings provided to partners included:
- Introduction to OSM
- Mapping with JOSM
- Mapping with ID editor
- Mobile Data Collection Tools
- Introduction to QGIS
- Downloading data from OSM (Hot Export Tool and Quick OSM)
3. Data collection
Data collection activities were consultative and participatory in nature, where data collectors were chosen from the local communities that we were interested in generating data to support the refugee response. Data collectors used their personal smartphones and those who didn’t have proper functioning smartphones were equipped with one by HOT. OpenDatakit was the main data collection tool/application used and 6 unique forms - incl. Health, Education, Water, Sanitation - would be implemented by surveyors and used for mapping in every village visited both in and around the refugee settlements.
Steps used in this phase:
4. Data Storage and Monitoring
The data from the field was stored on the online UNHCR kobo server space. This allowed for different UNHCR and OPM implementing partners to access the data easily and effectively. The data was uploaded by the field data collector at the end of each working day. Uploading ODK requires as low as a 2G connection to send the files to the server. The surveyors were always provided with at least 50 MB of data to accomplish such tasks. The Kobo server was also used as a monitoring tool to determine the number of data points collected and quickly assess any data quality gaps in the field.
Steps used in this phase:
5. Data Cleaning and Analysis
After storing the data on Kobo, the data would be downloaded then cleaned and uploaded using JOSM.
Steps used in this phase:
6. Data Visualization
For this project, HOT used a number of methods to visualize data; from using QGIS to create static maps and atlases to using tools such as Overpass turbo, Umap and Mapbox Studio to create dynamic & informative map products. The types of visualizations were mainly developed included distance matrices, resource gap identifiers, location and navigation maps and proximity indicator maps.
Steps used in this phase: