Data sharing ecosystem without org buy-in

Facilitator: Devin

Note Taker: Damien

Data tools

• make it simple! keep it close/r to desktop applications
• least common denominator tools
• humanitarian data exchange
  • use basic naming conventions and CSVs to get pretty far

Devin (presenter)

• goal: decide how to manage a crisis w only a spreadsheets
• has been building software AND spreadsheets/simple sites
• Sahana software foundation, python-based open-source software for a crisis

Ask Yourself

• Questions + form + input format + output format = data set
• which of these can you either simplify or standardize

What will we discuss today?

"what does the top row a spreadsheet mean?"

data merge scenarios

grassroots side of challenges, esp around getting started

Questions we have

How can we build user practices so data are

How do we create a data dictionary so ppl use the same input in the top so data flows in cleanly

Showing Toolkits

• Data Model Analysis
  • case: we have several groups collecting data we want to aggregate
  • goal: get to and agree on a standard

Merging Spreadsheets

• different data models; doesnt often start at the beginning
• ex. 4 refugee groups collecting info = need to get stakeholders together
  • goal: aggregate / central repo / data standard (a model all can use)
  • goal: interoperability of data
  • create a situation where their directories and data is not being ignored
• Goal: show people the similarities and differences in their datamodels across multiple groups
  • determine the data that is useful

Ex: Build data literacy

Outcome

• data schema
• import template: has the correct headers, terms, input formats

Information Management

• schema: columns
• taxonomy: categories
• data model
• Field(data), Tag (horizontal), Category (hierarchical): differentiate these for users

Sharing Bulk Data

Aggregate data set w a data standard, CKAN, show a

We Looked at

COOP DATA

HDX

CKAN

setup w python config files, hits international standards

Turn a Spreadsheet into a Filterable Mappable Site

http://internetofownership.net/

Embed "awesome-table.com" to visualize

• needs TWO rows at the top: title and instructional
• connect a spreadsheet via google acccount

See a sample of a table template for an "awesome table"

WordPress

resiliencecolab.org

• embed features, tabs - plugins
  • you can embed a google folder as a list w a tab plugin
  • https://resiliencecolab.org/topic-index/data-standards/
• see the data standards tab

AirTable

creates relational database from a table you connect/input. INterface to

Tools

Spreadsheet visualization - a google spreadsheet app

• https://awesome-table.com/
• https://airtable.com/

Servers/apps

• Google Apps
• Sandstorm.io - replacing google for data sharing https://sandstorm.io/

Mapping

• GIS
• Open Map Kit (Red Cross specific tool), Open Street Map,
• CartoDB

Data

• http://hxlstandard.org/ - standardizing humanitarian data tagging
• CKAN, open-source, "fake socrata": http://docs.ckan.org/en/ckan-2.3/api/index.html
• open data kit
• KOBO (form builder) - program an xls form
• ODK https://opendatakit.org/
• Data Anywhere
• Humanitarian Data Exchange (HDX) https://data.humdata.org/
  • CKN, wraps data sets into a standard API