Data sharing ecosystem without org buy-in
Jump to navigation
Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.
- Facilitator: Devin
- Note Taker: Damien
Data tools
- make it simple! keep it close/r to desktop applications
- least common denominator tools
- humanitarian data exchange
- use basic naming conventions and CSVs to get pretty far
Devin (presenter)
- goal: decide how to manage a crisis w only a spreadsheets
- has been building software AND spreadsheets/simple sites
- Sahana software foundation, python-based open-source software for a crisis
Ask Yourself
- Questions + form + input format + output format = data set
- which of these can you either simplify or standardize
What will we discuss today?
"what does the top row a spreadsheet mean?"
data merge scenarios
grassroots side of challenges, esp around getting started
Questions we have
How can we build user practices so data are
How do we create a data dictionary so ppl use the same input in the top so data flows in cleanly
Showing Toolkits
- Data Model Analysis
- case: we have several groups collecting data we want to aggregate
- goal: get to and agree on a standard
Merging Spreadsheets
- different data models; doesnt often start at the beginning
- ex. 4 refugee groups collecting info = need to get stakeholders together
- goal: aggregate / central repo / data standard (a model all can use)
- goal: interoperability of data
- create a situation where their directories and data is not being ignored
- Goal: show people the similarities and differences in their datamodels across multiple groups
- determine the data that is useful
Outcome
- data schema
- import template: has the correct headers, terms, input formats
Information Management
- schema: columns
- taxonomy: categories
- data model
- Field(data), Tag (horizontal), Category (hierarchical): differentiate these for users
Sharing Bulk Data
Aggregate data set w a data standard, CKAN, show a
We Looked at
- setup w python config files, hits international standards
Turn a Spreadsheet into a Filterable Mappable Site
http://internetofownership.net/
Embed "awesome-table.com" to visualize
- needs TWO rows at the top: title and instructional
- connect a spreadsheet via google acccount
See a sample of a table template for an "awesome table"
WordPress
resiliencecolab.org
- embed features, tabs - plugins
- you can embed a google folder as a list w a tab plugin
- https://resiliencecolab.org/topic-index/data-standards/
- see the data standards tab
AirTable
creates relational database from a table you connect/input. INterface to
Tools
Spreadsheet visualization - a google spreadsheet app
Servers/apps
- Google Apps
- Sandstorm.io - replacing google for data sharing https://sandstorm.io/
Mapping
- GIS
- Open Map Kit (Red Cross specific tool), Open Street Map,
- CartoDB
Data
- http://hxlstandard.org/ - standardizing humanitarian data tagging
- CKAN, open-source, "fake socrata": http://docs.ckan.org/en/ckan-2.3/api/index.html
- open data kit
- KOBO (form builder) - program an xls form
- ODK https://opendatakit.org/
- Data Anywhere
- Humanitarian Data Exchange (HDX) https://data.humdata.org/
- CKN, wraps data sets into a standard API