Difference between revisions of "Data sharing ecosystem without org buy-in"

From Digital Response
Jump to navigation Jump to search
(Created page with ": Facilitator: Devin : Note Taker: Damien Category:BerkmanCategory:HumTechFest")
 
Line 1: Line 1:
 
: Facilitator: Devin
 
: Facilitator: Devin
 
: Note Taker: Damien
 
: Note Taker: Damien
 +
 +
'''Data tools'''
 +
* make it simple! keep it close/r to desktop applications
 +
* least common denominator tools
 +
* humanitarian data exchange
 +
** use basic naming conventions and CSVs to get pretty far
 +
 +
Devin (presenter)
 +
* goal: decide how to manage a crisis w only a spreadsheets
 +
* has been building software AND spreadsheets/simple sites
 +
* Sahana software foundation, python-based open-source software for a crisis
 +
 +
==Ask Yourself==
 +
* Questions + form + input format + output format = data set
 +
* which of these can you either simplify or standardize
 +
 +
==What will we discuss today?==
 +
"what does the top row a spreadsheet mean?"
 +
 +
data merge scenarios
 +
 +
grassroots side of challenges, esp around getting started
 +
 +
==Questions we have==
 +
How can we build user practices so data are
 +
 +
How do we create a data dictionary so ppl use the same input in the top so data flows in cleanly
 +
 +
==Showing Toolkits==
 +
* Data Model Analysis
 +
** case: we have several groups collecting data we want to aggregate
 +
** goal: get to and agree on a standard
 +
 +
===Merging Spreadsheets===
 +
* different data models; doesnt often start at the beginning
 +
* ex. 4 refugee groups collecting info = need to get stakeholders together
 +
** goal: aggregate / central repo / data standard (a model all can use)
 +
** goal: interoperability of data
 +
** create a situation where their directories and data is not being ignored
 +
* Goal: show people the similarities and differences in their datamodels across multiple groups
 +
** determine the data that is useful
 +
 +
Ex: [https://docs.google.com/spreadsheets/d/1RQKcMz6quPQFolwyrAwvHhT3JVD7QDxPNf7KDaGJXEk/edit#gid=1867626204 Build data literacy]
 +
 +
===Outcome===
 +
* data schema
 +
* import template: has the correct headers, terms, input formats
 +
 +
===Information Management===
 +
* schema: columns
 +
* taxonomy: categories
 +
* data model
 +
* Field(data), Tag (horizontal), Category (hierarchical): differentiate these for users
 +
 +
===Sharing Bulk Data===
 +
Aggregate data set w a data standard, CKAN, show a
 +
 +
==We Looked at==
 +
[http://coopdata.org COOP DATA]
 +
 +
[https://data.humdata.org/group/nepal-earthquake HDX]
 +
 +
[http://ckan.org/ CKAN]
 +
: setup w python config files, hits international standards
 +
 +
==Turn a Spreadsheet into a Filterable Mappable Site==
 +
http://internetofownership.net/
 +
 +
Embed "awesome-table.com" to visualize
 +
* needs TWO rows at the top: title and instructional
 +
* connect a spreadsheet via google acccount
 +
 +
[https://docs.google.com/spreadsheets/d/1KWYgReAdTtuCQRcmdYkVpuY4H466NP6dMpt6y9AcqGI/edit?usp=drive_web See a sample of a table template for an "awesome table"]
 +
 +
==WordPress==
 +
resiliencecolab.org
 +
* embed features, tabs - plugins
 +
** you can embed a google folder as a list w a tab plugin
 +
** https://resiliencecolab.org/topic-index/data-standards/
 +
* see the data standards tab
 +
 +
==[https://airtable.com/features AirTable]==
 +
creates relational database from a table you connect/input. INterface to
 +
 +
==Tools==
 +
===Spreadsheet visualization - a google spreadsheet app===
 +
* https://awesome-table.com/
 +
*https://airtable.com/
 +
 +
===Servers/apps===
 +
* Google Apps
 +
* Sandstorm.io - replacing google for data sharing https://sandstorm.io/
 +
 +
===Mapping===
 +
* GIS
 +
* Open Map Kit (Red Cross specific tool), Open Street Map,
 +
* CartoDB
 +
 +
===Data===
 +
* http://hxlstandard.org/ - standardizing humanitarian data tagging
 +
* CKAN, open-source, "fake socrata": http://docs.ckan.org/en/ckan-2.3/api/index.html
 +
* open data kit
 +
* KOBO (form builder) - program an xls form
 +
* ODK https://opendatakit.org/
 +
* Data Anywhere
 +
* Humanitarian Data Exchange (HDX) https://data.humdata.org/
 +
** CKN,  wraps data sets into a standard API
  
 
[[Category:Berkman]][[Category:HumTechFest]]
 
[[Category:Berkman]][[Category:HumTechFest]]

Revision as of 13:33, 7 June 2016

Facilitator: Devin
Note Taker: Damien

Data tools

  • make it simple! keep it close/r to desktop applications
  • least common denominator tools
  • humanitarian data exchange
    • use basic naming conventions and CSVs to get pretty far

Devin (presenter)

  • goal: decide how to manage a crisis w only a spreadsheets
  • has been building software AND spreadsheets/simple sites
  • Sahana software foundation, python-based open-source software for a crisis

Ask Yourself

  • Questions + form + input format + output format = data set
  • which of these can you either simplify or standardize

What will we discuss today?

"what does the top row a spreadsheet mean?"

data merge scenarios

grassroots side of challenges, esp around getting started

Questions we have

How can we build user practices so data are

How do we create a data dictionary so ppl use the same input in the top so data flows in cleanly

Showing Toolkits

  • Data Model Analysis
    • case: we have several groups collecting data we want to aggregate
    • goal: get to and agree on a standard

Merging Spreadsheets

  • different data models; doesnt often start at the beginning
  • ex. 4 refugee groups collecting info = need to get stakeholders together
    • goal: aggregate / central repo / data standard (a model all can use)
    • goal: interoperability of data
    • create a situation where their directories and data is not being ignored
  • Goal: show people the similarities and differences in their datamodels across multiple groups
    • determine the data that is useful

Ex: Build data literacy

Outcome

  • data schema
  • import template: has the correct headers, terms, input formats

Information Management

  • schema: columns
  • taxonomy: categories
  • data model
  • Field(data), Tag (horizontal), Category (hierarchical): differentiate these for users

Sharing Bulk Data

Aggregate data set w a data standard, CKAN, show a

We Looked at

COOP DATA

HDX

CKAN

setup w python config files, hits international standards

Turn a Spreadsheet into a Filterable Mappable Site

http://internetofownership.net/

Embed "awesome-table.com" to visualize

  • needs TWO rows at the top: title and instructional
  • connect a spreadsheet via google acccount

See a sample of a table template for an "awesome table"

WordPress

resiliencecolab.org

AirTable

creates relational database from a table you connect/input. INterface to

Tools

Spreadsheet visualization - a google spreadsheet app

Servers/apps

Mapping

  • GIS
  • Open Map Kit (Red Cross specific tool), Open Street Map,
  • CartoDB

Data

Retrieved from "https://digitalresponse.aspirationtech.org/index.php?title=Data_sharing_ecosystem_without_org_buy-in&oldid=218"