KEMBAR78
From open data to API-driven business | PPTX
From Open Data to Open APIs
Future plants of sustainable innovation

                                              David Thoumas – CTO
                                                        12/4/2012




            with OpenDataSoft
                                                             1
 think bigdata. start smartdata. scale fastdata
WHO ARE WE ?


               2
OpenDataSoft
the data driven innovation company
Full featured cloud-based platform for
• operating ones own data driven innovation hubs
• speeding-up new data-centric services go-to-market
• leverage both cloud elasticity & big data fields

Smart metering, M2M, data API … thanks to its integrated platform of Data
Management & Data Publishing, OpenDataSoft helps its customers to set up and
operate their own data open platform dedicated to new services go-to-market,
leveraging cloud computing & big data technologies.




                                                                           3
OpenDataSoft
the data driven innovation company
OpenDataSoft builds a services centric platform




                                                  4
OpenDataSoft
the data driven innovation company
The 3 main platform pillars
• Big Data Management
• Data Smart Publishing
• Data API Factory




                                     5
FROM [OPEN] DATA
TO
OPEN APIS
                   6
Open Data Strategy ?


« Open data strategy should be a top priority for any
organization that uses the Web as a channel for
delivering goods and services … Open data APIs are a
lightweight approach to data exchange. Their use is now considered
a best practice for opening data and functionality to developers and
other businesses. »
(Gartner – août 2012)




                                                                 7
What problem do we solve ?

    Removing the barriers between Data and Applications.

•   For Business users / analysts
•   Who know their data
•   To think and design their applications
•   With a quick Go To Live
•   Without needing to instantiate a complex IT project

      Building applications in days, no more in
                  months or years

                                                           8
How do we solve this problem ?
Functionalities
Data procurement
•   File extraction
•   Pulling from remote sources (Web, DB, …)
•   Pushing through APIs
•   And sometimes, MDM



                                Data preparation
                                •    Fields mapping
                                •    Simple transformations (geo coords, text, …)
                                •    Complex transformations (geocoding, analytics, …)




Data publishing
•   Simple Web UI (navigate into the data)
•   API Factory (search, facetting, aggregation)


                                                                                         9
How do we solve this problem ?
Technologies

NoSQL
• Schema less
                                             Search
• Highly scalable
                                             • New flavor of applications
                                             • Mixing
                                                   – Traditionnal search approach
                         In the Cloud
                                                   – And Big Data analytics



  … and Python …
  because it’s cool !
  • Sustained by a brilliant and huge community
  • Allows for multi-facets development patterns

                                                                            10
How do we solve this problem ?
 Performances

                  One platform for any scale use case.



Store datasets of tens of millions of records or
    even hundreds of millions of records.



                     With sub-second response time in simple
                      real-time analytical processing tasks.


                                                               11
And, at the end ?
API factory => Application factory
   Smart Metering …




                                 … Mobile applications




   …


                                                         12
DEEP DIVE INTO
OPENDATASOFT’S API FACTORY

                             13
API Factory
Demo




              [DEMO …]


                         14
API Factory
Functionalities for rich modern applications

                                  Cross datasets search
   Full Text Search
                                 Numerical and rangesearch
           Field search
                      Using standards

Geographical filtering         Analytical processing


               Streaming of large results sets


                                                             15
API Factory
Developer oriented
  Documentation




                     Test console
                                    16
www.opendatasoft.com
twitter: @opendatasoft
Facebook: http://www.facebook.com/opendatasoft
LinkedIn: http://www.linkedin.com/company/opendatasoft




QUESTIONS ?


                                                         17

From open data to API-driven business

  • 1.
    From Open Datato Open APIs Future plants of sustainable innovation David Thoumas – CTO 12/4/2012 with OpenDataSoft 1 think bigdata. start smartdata. scale fastdata
  • 2.
  • 3.
    OpenDataSoft the data driveninnovation company Full featured cloud-based platform for • operating ones own data driven innovation hubs • speeding-up new data-centric services go-to-market • leverage both cloud elasticity & big data fields Smart metering, M2M, data API … thanks to its integrated platform of Data Management & Data Publishing, OpenDataSoft helps its customers to set up and operate their own data open platform dedicated to new services go-to-market, leveraging cloud computing & big data technologies. 3
  • 4.
    OpenDataSoft the data driveninnovation company OpenDataSoft builds a services centric platform 4
  • 5.
    OpenDataSoft the data driveninnovation company The 3 main platform pillars • Big Data Management • Data Smart Publishing • Data API Factory 5
  • 6.
  • 7.
    Open Data Strategy? « Open data strategy should be a top priority for any organization that uses the Web as a channel for delivering goods and services … Open data APIs are a lightweight approach to data exchange. Their use is now considered a best practice for opening data and functionality to developers and other businesses. » (Gartner – août 2012) 7
  • 8.
    What problem dowe solve ? Removing the barriers between Data and Applications. • For Business users / analysts • Who know their data • To think and design their applications • With a quick Go To Live • Without needing to instantiate a complex IT project Building applications in days, no more in months or years 8
  • 9.
    How do wesolve this problem ? Functionalities Data procurement • File extraction • Pulling from remote sources (Web, DB, …) • Pushing through APIs • And sometimes, MDM Data preparation • Fields mapping • Simple transformations (geo coords, text, …) • Complex transformations (geocoding, analytics, …) Data publishing • Simple Web UI (navigate into the data) • API Factory (search, facetting, aggregation) 9
  • 10.
    How do wesolve this problem ? Technologies NoSQL • Schema less Search • Highly scalable • New flavor of applications • Mixing – Traditionnal search approach In the Cloud – And Big Data analytics … and Python … because it’s cool ! • Sustained by a brilliant and huge community • Allows for multi-facets development patterns 10
  • 11.
    How do wesolve this problem ? Performances One platform for any scale use case. Store datasets of tens of millions of records or even hundreds of millions of records. With sub-second response time in simple real-time analytical processing tasks. 11
  • 12.
    And, at theend ? API factory => Application factory Smart Metering … … Mobile applications … 12
  • 13.
  • 14.
    API Factory Demo [DEMO …] 14
  • 15.
    API Factory Functionalities forrich modern applications Cross datasets search Full Text Search Numerical and rangesearch Field search Using standards Geographical filtering Analytical processing Streaming of large results sets 15
  • 16.
    API Factory Developer oriented Documentation Test console 16
  • 17.