KEMBAR78
Big Data Session Presentations | PPTX
Open Data and Big Data
       John van Echtelt
     Business Model Innovator

            2013 Conference
             Warsaw, Poland
            22 February 2013
It is NOT about the kind of DATA


     Open             Closed

               Raw
             Linked
               Data

      Big             Little




                2
It is about HOW to create VALUE

              Wisdom


             Knowlegde
Value




           Information

             Data
               3
It is about new BUSINESS MODELS, ...




                 4
…about TRANSFORMATION…
          Cross sector

    Small, medium        Civil Society
      and large         organizations
     companies



               People


     Knowledge
                    Governments
      institutes

           Cross border
                    5
Open Data Maturity Model                                                                                          6




                                                                                                        Data for fact-based
                                                                                                        decisions and
                                                                                                        performance
                                                                              Consumer-style web
                                                                              experiences               Embedded data
                                                                                                        experiences
                                                   Interactive data           Apps, mashups,            (Yelp, Google)
                                                   tables, basic data         dashboards, data-driven
                                                   visualizations (charts &   storytelling              Crowd-sourced data:
                         Basic catalog of          maps), Social sharing,                               human sensor network
                         downloadable files                                   Custom APIs and
                         (CSV, XLS, SHP, ZIP, PD   Manual data publishing     developer docs            Plug-and-play apps
Scattered spreadsheets   F)
and PDFs online                                                               Automated data            Real-time, data
                         Expensive custom web                                 publishing, federation    ecosystems and industry
Clumsy custom web        apps                                                 and                       exchanges
apps                                                                          distribution
                         Manual data publishing                                                         Internal data
                                                                              Web and mobile            collaboration hubs
                                                                              experience design


                                             Organization’s Open Data Maturity Level
Socrata Customer Case Studies




                7
Medicare Data Unleashed                                       8

                                   Socrata Provides:
                                   • Cloud-based infrastructure
                                   • Full data lifecycle management
                                   • Interactive exploration
                                   • Live data distribution
                                   • Automatic API access
                                   • Usage and analysis metrics
                                   • Federation to data.gov
                                   Results (since 8/31/10):
Challenges:                        • 10+ million page views
• Hard to find data                • 1,460% YoY growth
• Inaccessible datasets            • 2.7 Terabytes served
• No data-sharing infrastructure   • 420 datasets
                                   • Private providers using the data via API
                                   8
Health Indicators Visualized                             9

                                 Socrata Provides:
                                 • Cost-effective data warehouse
                                 • Advanced metadata management
                                 • Enriched visualizations
                                 • Configurable web experience
                                 Results:
                                 • Half the cost of alternatives
                                 • Makes BI licenses obsolete
                                 • Expanded reach
Challenges:                      • Visualized U.S. healthcare system
• Present metrics quantifiably   • Easy data maintenance
• Provide public data
  consumption
• Legacy BI platform rigid &      9
  expensive
Access to Healthcare Mobilized                            10

                                   Socrata Provides:
                                   • 100% cloud-based infrastructure
                                   • Full data lifecycle management
                                   • Interactive data discovery
                                   • APIs to enable unlimited reuse of data
                                   • Maps & charts on the web
                                   • Federation to data.gov
                                   Results:
                                   • One consolidated “logical” database
Challenges:
                                   • Extend reach of treatment facilities
• Provide help anytime, anywhere
                                   • Low cost self-service capabilities
• Reach teens
• Multiple fragmented databases
• 24x7 call center operations
                                   10
Energy Efficiency Data Consumerized
                            Socrata Provides:
                            • 100% turnkey cloud-based solution
                            • Easily create consumer web interfaces
                            • Developer-ready API for product catalogs
                            • Easy visualization of efficiency ratings
                            Results:
                            • Easy to use “Product Finder” Apps
                            • System supports complex data analysis
                            • Automatic product status updates via API
Challenges:                 • Repeatable process applied to 60 product
                               catalogs
• Empower consumers
• Comply with new
  regulations
• Hard to enable partners   11
think bigdata. start smartdata. scale fastdata

                Uses Cases
Turn data into apps & speed-up pace of innovation
All industries come to deliver smart services



 Smart cities
                                                 Internet of things




  Ecomobility                                      Predictive
                                                   analytics




Crowdsourcing
                                                      M2M
IT paradigm has changed towards apps model
                (internet-based, data-driven, cloud-based)

« Open data strategy should be a top priority for any organization
that uses the Web as a channel for delivering goods and services
…


Open data APIs are a lightweight approach to data exchange.


Their use is now considered a best practice for opening data and
functionality to developers and other businesses. »


(Gartner – août 2012)
We need to unlocking (open) all data fields opportunities
CUSTOMERS USE CASES
• Industry & Services
   sensors + open data + API
   open data easy preparation & publishing
   open data + crowdsourcing platform
• Government
   open data V2 (API-fication, linked data)
   tourism data management (Wordpress, Drupal …)
Collaborative Data Management
An open data project is not
an open data portal project
IT’S ALL ABOUT WEB & API
Utilities – Real-time geo-mashuping

                        Data sources
                        • open data
                           (files from the web)
                        • sensors data
                           (internal network data)
                        • real time data
                           (web API e.g. weather)
Utilities - Crowdsourcing
Open cities – Smart solutions
Open cities – Decision making

Big Data Session Presentations

  • 1.
    Open Data andBig Data John van Echtelt Business Model Innovator 2013 Conference Warsaw, Poland 22 February 2013
  • 2.
    It is NOTabout the kind of DATA Open Closed Raw Linked Data Big Little 2
  • 3.
    It is aboutHOW to create VALUE Wisdom Knowlegde Value Information Data 3
  • 4.
    It is aboutnew BUSINESS MODELS, ... 4
  • 5.
    …about TRANSFORMATION… Cross sector Small, medium Civil Society and large organizations companies People Knowledge Governments institutes Cross border 5
  • 6.
    Open Data MaturityModel 6 Data for fact-based decisions and performance Consumer-style web experiences Embedded data experiences Interactive data Apps, mashups, (Yelp, Google) tables, basic data dashboards, data-driven visualizations (charts & storytelling Crowd-sourced data: Basic catalog of maps), Social sharing, human sensor network downloadable files Custom APIs and (CSV, XLS, SHP, ZIP, PD Manual data publishing developer docs Plug-and-play apps Scattered spreadsheets F) and PDFs online Automated data Real-time, data Expensive custom web publishing, federation ecosystems and industry Clumsy custom web apps and exchanges apps distribution Manual data publishing Internal data Web and mobile collaboration hubs experience design Organization’s Open Data Maturity Level
  • 7.
  • 8.
    Medicare Data Unleashed 8 Socrata Provides: • Cloud-based infrastructure • Full data lifecycle management • Interactive exploration • Live data distribution • Automatic API access • Usage and analysis metrics • Federation to data.gov Results (since 8/31/10): Challenges: • 10+ million page views • Hard to find data • 1,460% YoY growth • Inaccessible datasets • 2.7 Terabytes served • No data-sharing infrastructure • 420 datasets • Private providers using the data via API 8
  • 9.
    Health Indicators Visualized 9 Socrata Provides: • Cost-effective data warehouse • Advanced metadata management • Enriched visualizations • Configurable web experience Results: • Half the cost of alternatives • Makes BI licenses obsolete • Expanded reach Challenges: • Visualized U.S. healthcare system • Present metrics quantifiably • Easy data maintenance • Provide public data consumption • Legacy BI platform rigid & 9 expensive
  • 10.
    Access to HealthcareMobilized 10 Socrata Provides: • 100% cloud-based infrastructure • Full data lifecycle management • Interactive data discovery • APIs to enable unlimited reuse of data • Maps & charts on the web • Federation to data.gov Results: • One consolidated “logical” database Challenges: • Extend reach of treatment facilities • Provide help anytime, anywhere • Low cost self-service capabilities • Reach teens • Multiple fragmented databases • 24x7 call center operations 10
  • 11.
    Energy Efficiency DataConsumerized Socrata Provides: • 100% turnkey cloud-based solution • Easily create consumer web interfaces • Developer-ready API for product catalogs • Easy visualization of efficiency ratings Results: • Easy to use “Product Finder” Apps • System supports complex data analysis • Automatic product status updates via API Challenges: • Repeatable process applied to 60 product catalogs • Empower consumers • Comply with new regulations • Hard to enable partners 11
  • 12.
    think bigdata. startsmartdata. scale fastdata Uses Cases Turn data into apps & speed-up pace of innovation
  • 13.
    All industries cometo deliver smart services Smart cities Internet of things Ecomobility Predictive analytics Crowdsourcing M2M
  • 14.
    IT paradigm haschanged towards apps model (internet-based, data-driven, cloud-based) « Open data strategy should be a top priority for any organization that uses the Web as a channel for delivering goods and services … Open data APIs are a lightweight approach to data exchange. Their use is now considered a best practice for opening data and functionality to developers and other businesses. » (Gartner – août 2012)
  • 15.
    We need tounlocking (open) all data fields opportunities
  • 16.
  • 17.
    • Industry &Services  sensors + open data + API  open data easy preparation & publishing  open data + crowdsourcing platform • Government  open data V2 (API-fication, linked data)  tourism data management (Wordpress, Drupal …)
  • 18.
    Collaborative Data Management Anopen data project is not an open data portal project IT’S ALL ABOUT WEB & API
  • 19.
    Utilities – Real-timegeo-mashuping Data sources • open data (files from the web) • sensors data (internal network data) • real time data (web API e.g. weather)
  • 20.
  • 21.
    Open cities –Smart solutions
  • 22.
    Open cities –Decision making

Editor's Notes

  • #9 Customers & Partners
  • #10 Customers & Partners
  • #11 Customers & Partners
  • #12 Customers & Partners