Data sharing ecosystem without org buy-in
Jump to navigation
Jump to search
- Facilitator: Devin
- Note Taker: Damien
Data tools
- make it simple! keep it close/r to desktop applications
- least common denominator tools
- humanitarian data exchange
- use basic naming conventions and CSVs to get pretty far
Devin (presenter)
- goal: decide how to manage a crisis w only a spreadsheets
- has been building software AND spreadsheets/simple sites
- Sahana software foundation, python-based open-source software for a crisis
Ask Yourself
- Questions + form + input format + output format = data set
- which of these can you either simplify or standardize
What will we discuss today?
"what does the top row a spreadsheet mean?"
data merge scenarios
grassroots side of challenges, esp around getting started
Questions we have
How can we build user practices so data are
How do we create a data dictionary so ppl use the same input in the top so data flows in cleanly
Showing Toolkits
- Data Model Analysis
- case: we have several groups collecting data we want to aggregate
- goal: get to and agree on a standard
Merging Spreadsheets
- different data models; doesnt often start at the beginning
- ex. 4 refugee groups collecting info = need to get stakeholders together
- goal: aggregate / central repo / data standard (a model all can use)
- goal: interoperability of data
- create a situation where their directories and data is not being ignored
- Goal: show people the similarities and differences in their datamodels across multiple groups
- determine the data that is useful
Outcome
- data schema
- import template: has the correct headers, terms, input formats
Information Management
- schema: columns
- taxonomy: categories
- data model
- Field(data), Tag (horizontal), Category (hierarchical): differentiate these for users
Sharing Bulk Data
Aggregate data set w a data standard, CKAN, show a
We Looked at
- setup w python config files, hits international standards
Turn a Spreadsheet into a Filterable Mappable Site
http://internetofownership.net/
Embed "awesome-table.com" to visualize
- needs TWO rows at the top: title and instructional
- connect a spreadsheet via google acccount
See a sample of a table template for an "awesome table"
WordPress
resiliencecolab.org
- embed features, tabs - plugins
- you can embed a google folder as a list w a tab plugin
- https://resiliencecolab.org/topic-index/data-standards/
- see the data standards tab
AirTable
creates relational database from a table you connect/input. INterface to
Tools
Spreadsheet visualization - a google spreadsheet app
Servers/apps
- Google Apps
- Sandstorm.io - replacing google for data sharing https://sandstorm.io/
Mapping
- GIS
- Open Map Kit (Red Cross specific tool), Open Street Map,
- CartoDB
Data
- http://hxlstandard.org/ - standardizing humanitarian data tagging
- CKAN, open-source, "fake socrata": http://docs.ckan.org/en/ckan-2.3/api/index.html
- open data kit
- KOBO (form builder) - program an xls form
- ODK https://opendatakit.org/
- Data Anywhere
- Humanitarian Data Exchange (HDX) https://data.humdata.org/
- CKN, wraps data sets into a standard API