KEMBAR78
RuleML 2015: When Processes Rule Events | PDF
RuleML, profile picture
Uploaded byRuleML
1,837 views

RuleML 2015: When Processes Rule Events

The document outlines a lecture on big data, highlighting key concepts such as complex event processing, data volume, velocity, variety, and veracity. It discusses the importance of data science skills, the optimization of event pattern matching, and methods for predicting traveling times in scheduled transportation. The content integrates theoretical principles with empirical evaluations in big data applications.

Downloaded 15 times
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules When Processes Rule Events Avigdor Gal Technion – Israel Institute of Technology
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Presentation Outline Big data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimizaion Process Mining with Schedules
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Big Data: is it a Storm in a Teacup?
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Big data is a game changer From Theory to Systems: empirical evaluation counts From Systems to Data: large scale empirical evaluation counts
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Who is a Data Scientist? The ability to take data – to be able to understand it, to process it, to extract value from it, to visualize it, to communicate it – that’s going to be a hugely important skill in the next decades. (Hal Varian, Google’s Chief Economist)
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Volume: No Longer the Size of a Teacup Volume Table: Big Data Cross Table Big data may be a single dataset with a lot of data
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Volume: No Longer the Size of a Teacup Table: Big Data Cross Table Big data may be a single dataset with a lot of data
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Velocity: Replacing a Teacup with a Tea Hose Volume Velocity Table: Big Data Cross Table Big data may be data that rapidly changes
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Velocity: Replacing a Teacup with a Tea Hose Table: Big Data Cross Table Big data may be data that rapidly changes
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Velocity: Replacing a Teacup with a Tea Hose Table: Big Data Cross Table Big data may be data that rapidly changes
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Velocity: Replacing a Teacup with a Tea Hose Table: Big Data Cross Table Big data may be data that rapidly changes
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Variety: When One Tea Type is Just not Enough Volume Velocity Variety Table: Big Data Cross Table Big data may be a small dataset with many different schemata
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Variety: When One Tea Type is Just not Enough Table: Big Data Cross Table Big data may be a small dataset with many different schemata
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Veracity: Is it Coffee or Black Tea with Milk? Volume Velocity Variety Veracity Table: Big Data Cross Table Big data may be data with varying levels of trustworthiness
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Veracity: Is it Coffee or Black Tea with Milk? Table: Big Data Cross Table Big data may be data with varying levels of trustworthiness
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Gathering: where and when to expect the fountain to burst Gathering Volume Velocity Variety Veracity Signal and Event Processing Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Gathering: where and when to expect the fountain to burst Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Management: Not your typical DBA anymore Gathering Managing Volume Velocity Variety Veracity Cloud Computing, NoSQL, NewSQL Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Analytics: When Data Analysis Explodes Multi-Dimensionally Gathering Managing Analyzing Volume Velocity Variety Veracity Data & Process Mining ML, IR, NLP Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Visualization: The Machine Offering to Mankind Gathering Managing Analyzing Visualizing Volume Velocity Variety Veracity User Experience Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Visualization: The Machine Offering to Mankind Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Big Data Cross Table Gathering Managing Analyzing Visualizing Volume Ev Pro Velocity en ce Variety t ss Veracity s es Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Event Processing Events An event e is an occurrence within a particular system or domain. It is something that has happened, or is contemplated as having happened in that domain. [Etzion and Niblett, 2010] Point-based semantics. An event type E ∈ E is a specification for a set of events that share the same semantic intent and structure. Complex Event Processing Systems: Amit [Adi and Etzion, 2004], SASE [Wu et al., 2006], Cayuga [Demers et al., 2007], CEDR [Barga et al., 2007], ESPER []. DEBS 2016: Oragne County, California
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Event Processing Urban Traffic Management
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Traffic Flow
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Bus Log
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Events and Big Data Volume: 23 Million records per month (∼ 4GB) Velocity: 770,000 new records per day (an event each 2-6 seconds) Variety: Homogeneous Veracity: GPS locations
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Processes Processes Process models describe time dependencies among activities: Business processes Scheduled activities Used as a template for execution by a process engine. A process model can be modeled as a graph containing activity nodes and control nodes: Petri nets [Reisig, 1985] BPMN [bpm, 2011]
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Process Models Bus Log Bus Model s d ω_2 ω_3 ω_i ω_{n-1}
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Between Events and Processes Given processes, detect (complex) events Given events, discover processes
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules From Processes to CEP Optimisation of event pattern matching on three levels Approach based on domain knowledge Results taken from: M. Weidlich, H. Ziekow, A. Gal, J. Mendling, M. Weske - Optimising Event Pattern Matching using Business Process Models. IEEE Transactions on Knowledge and Data Engineering (TKDE), accepted for publication, 2015.
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules From Processes to CEP Thanks Matthias Weidlich for the slides
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Optimization by Transformation Sequentialization Rule
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Optimization by Plan Selection Sequentialization Rule
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Optimization by Early Termination Sequentialization Rule
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis Datasets publicly available process log that contains recorded execution sequences of a paper reviewing process.a The model denes 20 activities. The log comprises 3730 events that are related to 100 process instances. Each event is associated with a timestamp and a reference to an activity of the process model. Process models of a German insurance company. 1021 process models, ranging from 4 to 339 nodes. The average size of the process models is around 23 nodes. The log was simulated using annotations of the process models. a http://www.processmining.org/logs/start
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Complex Events Processing with Processes Gathering ... Volume Velocity Optimization Variety Optimisation in event processing networks Veracity Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Complex Events Processing with Processes ... Analysis Volume Mining of constraints Velocity Variety Veracity Probabilistic mining of constraints Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules From Events to Processes Online Traveling Time Prediction: when Processes Rule Events Using information on bus stops, the prediction of the journey traveling time T( ω1, . . . , ωn , tω1 ) is traced back to the sum of traveling times per segment: T( ω1, . . . , ωn , tω1 ) = T( ω1, ω2 , tω1 ) + . . . + T( ωn−1, ωn , tωn−1 ) where tωn−1 = tω1 + T( ω1, ωn−1 , tω1 ). s d Traveling Time = Drive Time + Delay Time + Stop Time ω_2 ω_3 ω_i ω_{n-1} (Thanks to Arik Senderovich for the slides)
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules From Events to Processes Online Traveling Time Prediction: when Processes Rule Events Using information on bus stops, the prediction of the journey traveling time T( ω1, . . . , ωn , tω1 ) is traced back to the sum of traveling times per segment: T( ω1, . . . , ωn , tω1 ) = T( ω1, ω2 , tω1 ) + . . . + T( ωn−1, ωn , tωn−1 ) where tωn−1 = tω1 + T( ω1, ωn−1 , tω1 ). s d Traveling Time = Drive Time + Delay Time + Stop Time ω_2 ω_3 ω_i ω_{n-1} (Thanks to Arik Senderovich for the slides)
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Prediction: The Snapshot Principle in Single-Station Queues The snapshot principle stems from a heavy-traffic approximation of a queueing system under limits of its parameters, as the workload converges to capacity. Station1 The principle states that the total time in the station (waiting+service) remains constant. In our context, bus that passes through a segment, e.g., ωi, ωi+1 ∈ S × S, will have the same traveling time as another bus that has just passed through that segment (not necessarily of the same type, line, etc.).
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Prediction: The Snapshot Principle in Single-Station Queues The snapshot principle stems from a heavy-traffic approximation of a queueing system under limits of its parameters, as the workload converges to capacity. Station1 The principle states that the total time in the station (waiting+service) remains constant. In our context, bus that passes through a segment, e.g., ωi, ωi+1 ∈ S × S, will have the same traveling time as another bus that has just passed through that segment (not necessarily of the same type, line, etc.).
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Prediction: The Snapshot Principle in Single-Station Queues The snapshot principle stems from a heavy-traffic approximation of a queueing system under limits of its parameters, as the workload converges to capacity. Station1 The principle states that the total time in the station (waiting+service) remains constant. In our context, bus that passes through a segment, e.g., ωi, ωi+1 ∈ S × S, will have the same traveling time as another bus that has just passed through that segment (not necessarily of the same type, line, etc.).
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules The Snapshot Principle in Single-Station Queues Based on the above, we define a single-segment snapshot predictor, Last-Bus-to-Travel-Segment (LBTS), denoted by θLBTS( ωi, ωi+1 , tω1 ). In real-life settings, applicability of the snapshot principle predictors should be tested ad-hoc. The snapshot principle was shown to be of an empirical value in previous research, where queueing techniques were applied to predict delays.
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules The Snapshot Principle in Single-Station Queues Based on the above, we define a single-segment snapshot predictor, Last-Bus-to-Travel-Segment (LBTS), denoted by θLBTS( ωi, ωi+1 , tω1 ). In real-life settings, applicability of the snapshot principle predictors should be tested ad-hoc. The snapshot principle was shown to be of an empirical value in previous research, where queueing techniques were applied to predict delays.
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network In our case, the LBTS predictor needs to be lifted to a network setting. The snapshot principle holds for networks of queues, when the routing through this network is known in advance. In scheduled transportation such as buses this is the case as the order of stops (and segments) is predefined: Station1 Station2 Station3 Station5 Station6 Station4 Station7
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network In our case, the LBTS predictor needs to be lifted to a network setting. The snapshot principle holds for networks of queues, when the routing through this network is known in advance. In scheduled transportation such as buses this is the case as the order of stops (and segments) is predefined: Station1 Station2 Station3 Station5 Station6 Station4 Station7
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network In our case, the LBTS predictor needs to be lifted to a network setting. The snapshot principle holds for networks of queues, when the routing through this network is known in advance. In scheduled transportation such as buses this is the case as the order of stops (and segments) is predefined: Station1 Station2 Station3 Station5 Station6 Station4 Station7
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network We define a multi-segment (network) snapshot predictor that we refer to as the Last-Bus-to-Travel-Network or θLBTN ( ω1, ..., ωn , tω1 ), given a sequence of stops (with ω1 being the start stop and ωn being the end stop). According to the snapshot principle in networks we get that: θLBTN ( ω1, ..., ωn , tω1 ) = n i=1 θLBTS( ωi, ωi+1 , tω1 ).
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network We define a multi-segment (network) snapshot predictor that we refer to as the Last-Bus-to-Travel-Network or θLBTN ( ω1, ..., ωn , tω1 ), given a sequence of stops (with ω1 being the start stop and ωn being the end stop). According to the snapshot principle in networks we get that: θLBTN ( ω1, ..., ωn , tω1 ) = n i=1 θLBTS( ωi, ωi+1 , tω1 ).
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network We define a multi-segment (network) snapshot predictor that we refer to as the Last-Bus-to-Travel-Network or θLBTN ( ω1, ..., ωn , tω1 ), given a sequence of stops (with ω1 being the start stop and ωn being the end stop). According to the snapshot principle in networks we get that: θLBTN ( ω1, ..., ωn , tω1 ) = n i=1 θLBTS( ωi, ωi+1 , tω1 ).
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis Data 8 days of bus data, between September and October of 2014. Each day: approximately 11500 traveled segments. First trip for each day: no associated last travel time. Prediction for line 046A. Data comes from all buses that share segments with line 046A.
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis 10 20 30 40 50 Index of the segment in the trip 100 101 102 103 104 105 106 107 Samplesquareestimationerror 40 50 60 70 80 90 100 110 RootMeanSquareError
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Process Mining with Schedules ... Analysis Volume Better prediction Velocity Segmentation Variety Veracity Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Process Mining with Schedules ... Management ... Volume Velocity Variety Veracity Event Cleaning Table: Big Data Cross Table
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Thank You Avigdor Gal Technion – Israel Institute of Technology
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules A. Adi and O. Etzion. Amit - the situation manager. The International Journal on Very Large Data Bases, 13(2):177–203, May 2004. Roger S. Barga, Jonathan Goldstein, Mohamed H. Ali, and Mingsheng Hong. Consistent streaming through time: A vision for event stream processing. In CIDR [DBL, 2007], pages 363–374. Business Process Model and Notation (BPMN) Version 2.0. Technical report, Object Management Group (OMG), January 2011. CIDR 2007, Third Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 7-10, 2007, Online Proceedings. www.cidrdb.org, 2007. Alan J. Demers, Johannes Gehrke, Biswanath Panda, Mirek Riedewald, Varun Sharma, and Walker M. White. Cayuga: A general purpose event monitoring system. In CIDR [DBL, 2007], pages 412–422. Opher Etzion and Peter Niblett. Event Processing in Action. Manning Publications Company, 2010.
Lecture Outline Big Data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Wolfgang Reisig. Petri Nets: An Introduction, volume 4 of Monographs in Theoretical Computer Science. An EATCS Series. Springer, 1985. Eugene Wu, Yanlei Diao, and Shariq Rizvi. High-performance complex event processing over streams. In SIGMOD ’06: Proceedings of the 2006 ACM SIGMOD international conference on Management of data, pages 407–418, New York, NY, USA, 2006. ACM.

More Related Content

PPTX
Big Process for Big Data @ PNNL, May 2013
byIan Foster
 
PDF
Séminaire Big Data Alter Way - Elasticsearch - octobre 2014
byALTER WAY
 
PPTX
Are you ready for BIG DATA?
byPutchong Uthayopas
 
PDF
Lessons from building a stream-first metadata platform | Shirshanka Das, Stealth
byHostedbyConfluent
 
PPTX
Big Data, Baby Steps
byWilliam Yetman
 
PPTX
Владимир Слободянюк «DWH & BigData – architecture approaches»
byAnna Shymchenko
 
PPTX
LendingClub RealTime BigData Platform with Oracle GoldenGate
byRajit Saha
 
PDF
Visualising and Linking Open Data from Multiple Sources
byData Driven Innovation
 
Big Process for Big Data @ PNNL, May 2013
byIan Foster
 
Séminaire Big Data Alter Way - Elasticsearch - octobre 2014
byALTER WAY
 
Are you ready for BIG DATA?
byPutchong Uthayopas
 
Lessons from building a stream-first metadata platform | Shirshanka Das, Stealth
byHostedbyConfluent
 
Big Data, Baby Steps
byWilliam Yetman
 
Владимир Слободянюк «DWH & BigData – architecture approaches»
byAnna Shymchenko
 
LendingClub RealTime BigData Platform with Oracle GoldenGate
byRajit Saha
 
Visualising and Linking Open Data from Multiple Sources
byData Driven Innovation
 

What's hot

PDF
Tutorial - Modern Real Time Streaming Architectures
byKarthik Ramasamy
 
PPT
My other computer is a datacentre - 2012 edition
bySteve Loughran
 
PDF
Project
bySujith C.P
 
PDF
Building a Graph-based Analytics Platform
byKenny Bastani
 
PDF
Introduction to Big Data
byIMC Institute
 
PPTX
Stephen Dillon - Fast Data Presentation Sept 02
byStephen Dillon
 
PDF
Big and fast a quest for relevant and real-time analytics
byNatalino Busa
 
PDF
WorDS of Data Science in the Presence of Heterogenous Computing Architectures
byIlkay Altintas, Ph.D.
 
PPTX
American Century (Revolution Analytics Customer Day)
byRevolution Analytics
 
PDF
Are we reaching a Data Science Singularity? How Cognitive Computing is emergi...
byBig Data Spain
 
PPT
Big Graph Analytics on Neo4j with Apache Spark
byKenny Bastani
 
PDF
A Maturing Role of Workflows in the Presence of Heterogenous Computing Archit...
byIlkay Altintas, Ph.D.
 
PPTX
"Demystifying Big Data by AIBDP.org
byAIBDP
 
PPSX
De-Mystifying Big Data
byPrasad Mavuduri
 
PDF
Big Data Day LA 2016/ Big Data Track - Twitter Heron @ Scale - Karthik Ramasa...
byData Con LA
 
PPTX
Big Data Lessons from the Cloud
byMapR Technologies
 
PDF
The architecture of data analytics PaaS on AWS
byTreasure Data, Inc.
 
PPTX
Geolocation analysis using HiveQL
byPriyanka Kale
 
PPTX
Interactive Realtime Dashboards on Data Streams using Kafka, Druid and Superset
byHortonworks
 
PPT
Introduction to Large Scale Data Analysis with WSO2 Analytics Platform
bySrinath Perera
 
Tutorial - Modern Real Time Streaming Architectures
byKarthik Ramasamy
 
My other computer is a datacentre - 2012 edition
bySteve Loughran
 
Project
bySujith C.P
 
Building a Graph-based Analytics Platform
byKenny Bastani
 
Introduction to Big Data
byIMC Institute
 
Stephen Dillon - Fast Data Presentation Sept 02
byStephen Dillon
 
Big and fast a quest for relevant and real-time analytics
byNatalino Busa
 
WorDS of Data Science in the Presence of Heterogenous Computing Architectures
byIlkay Altintas, Ph.D.
 
American Century (Revolution Analytics Customer Day)
byRevolution Analytics
 
Are we reaching a Data Science Singularity? How Cognitive Computing is emergi...
byBig Data Spain
 
Big Graph Analytics on Neo4j with Apache Spark
byKenny Bastani
 
A Maturing Role of Workflows in the Presence of Heterogenous Computing Archit...
byIlkay Altintas, Ph.D.
 
"Demystifying Big Data by AIBDP.org
byAIBDP
 
De-Mystifying Big Data
byPrasad Mavuduri
 
Big Data Day LA 2016/ Big Data Track - Twitter Heron @ Scale - Karthik Ramasa...
byData Con LA
 
Big Data Lessons from the Cloud
byMapR Technologies
 
The architecture of data analytics PaaS on AWS
byTreasure Data, Inc.
 
Geolocation analysis using HiveQL
byPriyanka Kale
 
Interactive Realtime Dashboards on Data Streams using Kafka, Druid and Superset
byHortonworks
 
Introduction to Large Scale Data Analysis with WSO2 Analytics Platform
bySrinath Perera
 

Viewers also liked

PDF
RuleML 2015 Constraint Handling Rules - What Else?
byRuleML
 
PDF
RuleML 2015: Semantics of Notation3 Logic: A Solution for Implicit Quantifica...
byRuleML
 
PDF
RuleML2015: How to combine event stream reasoning with transactions for the...
byRuleML
 
DOCX
History of Induction and Recursion B
byDamien MacFarland
 
PPT
Induction and Decision Tree Learning (Part 1)
bybutest
 
PDF
RuleML 2015: Ontology Reasoning using Rules in an eHealth Context
byRuleML
 
PDF
11X1 T14 08 mathematical induction 1 (2011)
byNigel Simmons
 
PDF
Challenge@RuleML2015 Transformation and aggregation preprocessing for top-k r...
byRuleML
 
PDF
Challenge@rule ml2015 rule based recommender systems for the Web of Data
byRuleML
 
PDF
Harold Boley: RuleML/Grailog: The Rule Metalogic Visualized with Generalized ...
byPhiloWeb
 
PDF
Iteration, induction, and recursion
byMohammed Hussein
 
PDF
Math induction principle (slides)
byIIUM
 
PPSX
Mathematical induction
bysonia -
 
PPT
Mathematical induction
bySman Abbasi
 
PPTX
5.4 mathematical induction
bymath260
 
PPTX
Principle of mathematical induction
byKriti Varshney
 
PPT
mathematical induction
byankush_kumar
 
RuleML 2015 Constraint Handling Rules - What Else?
byRuleML
 
RuleML 2015: Semantics of Notation3 Logic: A Solution for Implicit Quantifica...
byRuleML
 
RuleML2015: How to combine event stream reasoning with transactions for the...
byRuleML
 
History of Induction and Recursion B
byDamien MacFarland
 
Induction and Decision Tree Learning (Part 1)
bybutest
 
RuleML 2015: Ontology Reasoning using Rules in an eHealth Context
byRuleML
 
11X1 T14 08 mathematical induction 1 (2011)
byNigel Simmons
 
Challenge@RuleML2015 Transformation and aggregation preprocessing for top-k r...
byRuleML
 
Challenge@rule ml2015 rule based recommender systems for the Web of Data
byRuleML
 
Harold Boley: RuleML/Grailog: The Rule Metalogic Visualized with Generalized ...
byPhiloWeb
 
Iteration, induction, and recursion
byMohammed Hussein
 
Math induction principle (slides)
byIIUM
 
Mathematical induction
bysonia -
 
Mathematical induction
bySman Abbasi
 
5.4 mathematical induction
bymath260
 
Principle of mathematical induction
byKriti Varshney
 
mathematical induction
byankush_kumar
 

Similar to RuleML 2015: When Processes Rule Events

PDF
Lecture1 introduction to big data
byhktripathy
 
PDF
Big Data & Social Analytics presentation
bygustavosouto
 
PDF
Big Data Mining and Complexity 1st Edition Brian C. Castellani
byclessgironxm
 
PDF
Big Data Mining and Complexity 1st Edition Brian C. Castellani
byclessgironxm
 
PPTX
Sands Fish - Knowing in the Age of Networked Knowledge
bysandsfish
 
PPTX
Lars Lyberg, Inizio: Rapport från konferensen BigSurv18
byAlf Fyhrlund
 
PPTX
Big Data and the Social Sciences
byAbe Usher
 
PPTX
Big Data and Data Mining - Lecture 3 in Introduction to Computational Social ...
byLauri Eloranta
 
PPTX
Big Data Driven Solutions to Combat Covid' 19
byProf.Balakrishnan S
 
PDF
00-01 DSnDA.pdf
bySugumarSarDurai
 
PPTX
PPT 1.1.2.pptx ehhllo hi hwi bdfhd dbdhu
bybhushanshashi818
 
PPT
Process Mining: Data Science in Action - Wil van der Aalst, TU/e, DSC/e, HSE
byYandex
 
PPTX
Big Data and Classification
by303Computing
 
PDF
KIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdf
byDr. Radhey Shyam
 
PDF
Shared time-series-analysis-using-an-event-streaming-platform -_v2
byconfluent
 
PPTX
Chapter -2- Data science Emerging Tech.pptx
bynahil6
 
PDF
Ch~2.pdf
byandualemtemesgen3
 
PDF
Introduction to Data Analytics and data analytics life cycle
byDr. Radhey Shyam
 
PPT
Chapter1-Introduction to big data analytics.ppt
byShafeenNagoor
 
PDF
INF2190_W1_2016_public
byAttila Barta
 
Lecture1 introduction to big data
byhktripathy
 
Big Data & Social Analytics presentation
bygustavosouto
 
Big Data Mining and Complexity 1st Edition Brian C. Castellani
byclessgironxm
 
Big Data Mining and Complexity 1st Edition Brian C. Castellani
byclessgironxm
 
Sands Fish - Knowing in the Age of Networked Knowledge
bysandsfish
 
Lars Lyberg, Inizio: Rapport från konferensen BigSurv18
byAlf Fyhrlund
 
Big Data and the Social Sciences
byAbe Usher
 
Big Data and Data Mining - Lecture 3 in Introduction to Computational Social ...
byLauri Eloranta
 
Big Data Driven Solutions to Combat Covid' 19
byProf.Balakrishnan S
 
00-01 DSnDA.pdf
bySugumarSarDurai
 
PPT 1.1.2.pptx ehhllo hi hwi bdfhd dbdhu
bybhushanshashi818
 
Process Mining: Data Science in Action - Wil van der Aalst, TU/e, DSC/e, HSE
byYandex
 
Big Data and Classification
by303Computing
 
KIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdf
byDr. Radhey Shyam
 
Shared time-series-analysis-using-an-event-streaming-platform -_v2
byconfluent
 
Chapter -2- Data science Emerging Tech.pptx
bynahil6
 
Ch~2.pdf
byandualemtemesgen3
 
Introduction to Data Analytics and data analytics life cycle
byDr. Radhey Shyam
 
Chapter1-Introduction to big data analytics.ppt
byShafeenNagoor
 
INF2190_W1_2016_public
byAttila Barta
 

More from RuleML

PDF
Aggregates in Recursion: Issues and Solutions
byRuleML
 
PDF
A software agent controlling 2 robot arms in co-operating concurrent tasks
byRuleML
 
PDF
Port Clearance Rules in PSOA RuleML: From Controlled-English Regulation to Ob...
byRuleML
 
PDF
Challenge@RuleML2015 Developing Situation-Aware Applications for Disaster Man...
byRuleML
 
PDF
Rule Generalization Strategies in Incremental Learning of Disjunctive Concepts
byRuleML
 
PDF
RuleML2015 The Herbrand Manifesto - Thinking Inside the Box
byRuleML
 
PDF
RuleML2015 PSOA RuleML: Integrated Object-Relational Data and Rules
byRuleML
 
PDF
Industry@RuleML2015: Norwegian State of Estate A Reporting Service for the St...
byRuleML
 
PDF
A Service for Improving the Assignments of Common Agriculture Policy Funds to...
byRuleML
 
PDF
Datalog+-Track Introduction & Reasoning on UML Class Diagrams via Datalog+-
byRuleML
 
PDF
RuleML2015: Binary Frontier-guarded ASP with Function Symbols
byRuleML
 
PDF
RuleML2015: API4KP Metamodel: A Meta-API for Heterogeneous Knowledge Platforms
byRuleML
 
PDF
RuleML2015: Rule-Based Exploration of Structured Data in the Browser
byRuleML
 
PDF
RuleML2015: Ontology-Based Multidimensional Contexts with Applications to Qua...
byRuleML
 
PDF
RuleML2015: Compact representation of conditional probability for rule-based...
byRuleML
 
PDF
RuleML2015: Learning Characteristic Rules in Geographic Information Systems
byRuleML
 
PDF
RuleML2015: Using Substitutive Itemset Mining Framework for Finding Synonymou...
byRuleML
 
PDF
RuleML2015: User Extensible System to Identify Problems in OWL Ontologies and...
byRuleML
 
PDF
RuleML2015: Representing Flexible Role-Based Access Control Policies Using Ob...
byRuleML
 
PDF
RuleML2015: Rule Generalization Strategies in Incremental Learning of Disjunc...
byRuleML
 
Aggregates in Recursion: Issues and Solutions
byRuleML
 
A software agent controlling 2 robot arms in co-operating concurrent tasks
byRuleML
 
Port Clearance Rules in PSOA RuleML: From Controlled-English Regulation to Ob...
byRuleML
 
Challenge@RuleML2015 Developing Situation-Aware Applications for Disaster Man...
byRuleML
 
Rule Generalization Strategies in Incremental Learning of Disjunctive Concepts
byRuleML
 
RuleML2015 The Herbrand Manifesto - Thinking Inside the Box
byRuleML
 
RuleML2015 PSOA RuleML: Integrated Object-Relational Data and Rules
byRuleML
 
Industry@RuleML2015: Norwegian State of Estate A Reporting Service for the St...
byRuleML
 
A Service for Improving the Assignments of Common Agriculture Policy Funds to...
byRuleML
 
Datalog+-Track Introduction & Reasoning on UML Class Diagrams via Datalog+-
byRuleML
 
RuleML2015: Binary Frontier-guarded ASP with Function Symbols
byRuleML
 
RuleML2015: API4KP Metamodel: A Meta-API for Heterogeneous Knowledge Platforms
byRuleML
 
RuleML2015: Rule-Based Exploration of Structured Data in the Browser
byRuleML
 
RuleML2015: Ontology-Based Multidimensional Contexts with Applications to Qua...
byRuleML
 
RuleML2015: Compact representation of conditional probability for rule-based...
byRuleML
 
RuleML2015: Learning Characteristic Rules in Geographic Information Systems
byRuleML
 
RuleML2015: Using Substitutive Itemset Mining Framework for Finding Synonymou...
byRuleML
 
RuleML2015: User Extensible System to Identify Problems in OWL Ontologies and...
byRuleML
 
RuleML2015: Representing Flexible Role-Based Access Control Policies Using Ob...
byRuleML
 
RuleML2015: Rule Generalization Strategies in Incremental Learning of Disjunc...
byRuleML
 

Recently uploaded

PPTX
tracheostomy .pptx
byNagaMalya
 
PDF
Understanding Work and Organisation. PDF
byNokwandaNzuza2
 
PDF
Science, Education and Innovations in the Context of Modern Problems.pdf
byRahilNecef
 
PPTX
PHARMACOLOGYhhgjiiuhkouhk9ijjuokhikkijiok
byMyatThandar9
 
PPTX
ota_Fractures of the Distal Humerus.pptx
bysefidsiyah2020
 
PDF
Near the Runaway: The Climate and Habitability of Teegarden’s Star b
bySérgio Sacani
 
PDF
Branches of Microbiology: An Overview of Key Fields
byMicrobiology Notes
 
PPTX
Introduction to Clinical Pharmacy-All.pptx
byfaysalphr
 
PPTX
presentationbiotechnologyandgeneticengineering-210822163345.pptx
byduaaalwakeel5
 
DOCX
I want to join occult for money ritual ✓❥❥+2349027025197 ❥❥.. join illuminati...
byOrldrado Brotherhood
 
PPT
Free Radicals: A cellular way to understand
byDRARUNKUMAR60
 
PDF
Recursive Compression Theory: A Systems Approach to Intelligence and Drift
byCognitive Drift Institute
 
PDF
Rigor Without Rigidity V2 with Table1.pdf
bydiffident1965
 
PDF
s13613-024-01355-6 jurnal terkait imun.pdf
byMuhammadSuyadi2
 
PDF
Bioactivity Data : Binding database and DrugBank
bySree
 
PDF
MedComm - 2024 - Wang - The interaction of innate immune and adaptive immune ...
byMuhammadSuyadi2
 
PPTX
ARTIFICIAL-INSEMINATION in Animal Science.pptx
byMingsot
 
PPTX
MUSCLE TWITCH,TETANY,MUSCLE FATIGUE, RIGOR MORTIS.pptx
bycathalinegeo
 
PPTX
KoH Prepration, CLASSIFICATION OF FUNGAL DISEASES
byMahesh Chandra. Adesh University Bathinda
 
PPTX
liquids2-211104045137 ftgv здравствуйтк до
bymrcody389
 
tracheostomy .pptx
byNagaMalya
 
Understanding Work and Organisation. PDF
byNokwandaNzuza2
 
Science, Education and Innovations in the Context of Modern Problems.pdf
byRahilNecef
 
PHARMACOLOGYhhgjiiuhkouhk9ijjuokhikkijiok
byMyatThandar9
 
ota_Fractures of the Distal Humerus.pptx
bysefidsiyah2020
 
Near the Runaway: The Climate and Habitability of Teegarden’s Star b
bySérgio Sacani
 
Branches of Microbiology: An Overview of Key Fields
byMicrobiology Notes
 
Introduction to Clinical Pharmacy-All.pptx
byfaysalphr
 
presentationbiotechnologyandgeneticengineering-210822163345.pptx
byduaaalwakeel5
 
I want to join occult for money ritual ✓❥❥+2349027025197 ❥❥.. join illuminati...
byOrldrado Brotherhood
 
Free Radicals: A cellular way to understand
byDRARUNKUMAR60
 
Recursive Compression Theory: A Systems Approach to Intelligence and Drift
byCognitive Drift Institute
 
Rigor Without Rigidity V2 with Table1.pdf
bydiffident1965
 
s13613-024-01355-6 jurnal terkait imun.pdf
byMuhammadSuyadi2
 
Bioactivity Data : Binding database and DrugBank
bySree
 
MedComm - 2024 - Wang - The interaction of innate immune and adaptive immune ...
byMuhammadSuyadi2
 
ARTIFICIAL-INSEMINATION in Animal Science.pptx
byMingsot
 
MUSCLE TWITCH,TETANY,MUSCLE FATIGUE, RIGOR MORTIS.pptx
bycathalinegeo
 
KoH Prepration, CLASSIFICATION OF FUNGAL DISEASES
byMahesh Chandra. Adesh University Bathinda
 
liquids2-211104045137 ftgv здравствуйтк до
bymrcody389
 

RuleML 2015: When Processes Rule Events

  • 1.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules When Processes Rule Events Avigdor Gal Technion – Israel Institute of Technology
  • 2.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Presentation Outline Big data: the New Playground Events, Processes, and Anything in Between Complex Event Processing Optimizaion Process Mining with Schedules
  • 3.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Big Data: is it a Storm in a Teacup?
  • 4.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Big data is a game changer From Theory to Systems: empirical evaluation counts From Systems to Data: large scale empirical evaluation counts
  • 5.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Who is a Data Scientist? The ability to take data – to be able to understand it, to process it, to extract value from it, to visualize it, to communicate it – that’s going to be a hugely important skill in the next decades. (Hal Varian, Google’s Chief Economist)
  • 6.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Volume: No Longer the Size of a Teacup Volume Table: Big Data Cross Table Big data may be a single dataset with a lot of data
  • 7.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Volume: No Longer the Size of a Teacup Table: Big Data Cross Table Big data may be a single dataset with a lot of data
  • 8.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Velocity: Replacing a Teacup with a Tea Hose Volume Velocity Table: Big Data Cross Table Big data may be data that rapidly changes
  • 9.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Velocity: Replacing a Teacup with a Tea Hose Table: Big Data Cross Table Big data may be data that rapidly changes
  • 10.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Velocity: Replacing a Teacup with a Tea Hose Table: Big Data Cross Table Big data may be data that rapidly changes
  • 11.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Velocity: Replacing a Teacup with a Tea Hose Table: Big Data Cross Table Big data may be data that rapidly changes
  • 12.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Variety: When One Tea Type is Just not Enough Volume Velocity Variety Table: Big Data Cross Table Big data may be a small dataset with many different schemata
  • 13.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Variety: When One Tea Type is Just not Enough Table: Big Data Cross Table Big data may be a small dataset with many different schemata
  • 14.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Veracity: Is it Coffee or Black Tea with Milk? Volume Velocity Variety Veracity Table: Big Data Cross Table Big data may be data with varying levels of trustworthiness
  • 15.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Veracity: Is it Coffee or Black Tea with Milk? Table: Big Data Cross Table Big data may be data with varying levels of trustworthiness
  • 16.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Gathering: where and when to expect the fountain to burst Gathering Volume Velocity Variety Veracity Signal and Event Processing Table: Big Data Cross Table
  • 17.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Gathering: where and when to expect the fountain to burst Table: Big Data Cross Table
  • 18.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Management: Not your typical DBA anymore Gathering Managing Volume Velocity Variety Veracity Cloud Computing, NoSQL, NewSQL Table: Big Data Cross Table
  • 19.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Analytics: When Data Analysis Explodes Multi-Dimensionally Gathering Managing Analyzing Volume Velocity Variety Veracity Data & Process Mining ML, IR, NLP Table: Big Data Cross Table
  • 20.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Visualization: The Machine Offering to Mankind Gathering Managing Analyzing Visualizing Volume Velocity Variety Veracity User Experience Table: Big Data Cross Table
  • 21.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Data Visualization: The Machine Offering to Mankind Table: Big Data Cross Table
  • 22.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Big Data Cross Table Gathering Managing Analyzing Visualizing Volume Ev Pro Velocity en ce Variety t ss Veracity s es Table: Big Data Cross Table
  • 23.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Event Processing Events An event e is an occurrence within a particular system or domain. It is something that has happened, or is contemplated as having happened in that domain. [Etzion and Niblett, 2010] Point-based semantics. An event type E ∈ E is a specification for a set of events that share the same semantic intent and structure. Complex Event Processing Systems: Amit [Adi and Etzion, 2004], SASE [Wu et al., 2006], Cayuga [Demers et al., 2007], CEDR [Barga et al., 2007], ESPER []. DEBS 2016: Oragne County, California
  • 24.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Event Processing Urban Traffic Management
  • 25.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Traffic Flow
  • 26.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Bus Log
  • 27.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Events and Big Data Volume: 23 Million records per month (∼ 4GB) Velocity: 770,000 new records per day (an event each 2-6 seconds) Variety: Homogeneous Veracity: GPS locations
  • 28.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Processes Processes Process models describe time dependencies among activities: Business processes Scheduled activities Used as a template for execution by a process engine. A process model can be modeled as a graph containing activity nodes and control nodes: Petri nets [Reisig, 1985] BPMN [bpm, 2011]
  • 29.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Process Models Bus Log Bus Model s d ω_2 ω_3 ω_i ω_{n-1}
  • 30.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Events Processes Complex Event Processing Optimization Process Mining with Schedules Between Events and Processes Given processes, detect (complex) events Given events, discover processes
  • 31.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules From Processes to CEP Optimisation of event pattern matching on three levels Approach based on domain knowledge Results taken from: M. Weidlich, H. Ziekow, A. Gal, J. Mendling, M. Weske - Optimising Event Pattern Matching using Business Process Models. IEEE Transactions on Knowledge and Data Engineering (TKDE), accepted for publication, 2015.
  • 32.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules From Processes to CEP Thanks Matthias Weidlich for the slides
  • 33.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Optimization by Transformation Sequentialization Rule
  • 34.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Optimization by Plan Selection Sequentialization Rule
  • 35.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Optimization by Early Termination Sequentialization Rule
  • 36.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis Datasets publicly available process log that contains recorded execution sequences of a paper reviewing process.a The model denes 20 activities. The log comprises 3730 events that are related to 100 process instances. Each event is associated with a timestamp and a reference to an activity of the process model. Process models of a German insurance company. 1021 process models, ranging from 4 to 339 nodes. The average size of the process models is around 23 nodes. The log was simulated using annotations of the process models. a http://www.processmining.org/logs/start
  • 37.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis
  • 38.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis
  • 39.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Complex Events Processing with Processes Gathering ... Volume Velocity Optimization Variety Optimisation in event processing networks Veracity Table: Big Data Cross Table
  • 40.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Complex Events Processing with Processes ... Analysis Volume Mining of constraints Velocity Variety Veracity Probabilistic mining of constraints Table: Big Data Cross Table
  • 41.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules From Events to Processes Online Traveling Time Prediction: when Processes Rule Events Using information on bus stops, the prediction of the journey traveling time T( ω1, . . . , ωn , tω1 ) is traced back to the sum of traveling times per segment: T( ω1, . . . , ωn , tω1 ) = T( ω1, ω2 , tω1 ) + . . . + T( ωn−1, ωn , tωn−1 ) where tωn−1 = tω1 + T( ω1, ωn−1 , tω1 ). s d Traveling Time = Drive Time + Delay Time + Stop Time ω_2 ω_3 ω_i ω_{n-1} (Thanks to Arik Senderovich for the slides)
  • 42.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules From Events to Processes Online Traveling Time Prediction: when Processes Rule Events Using information on bus stops, the prediction of the journey traveling time T( ω1, . . . , ωn , tω1 ) is traced back to the sum of traveling times per segment: T( ω1, . . . , ωn , tω1 ) = T( ω1, ω2 , tω1 ) + . . . + T( ωn−1, ωn , tωn−1 ) where tωn−1 = tω1 + T( ω1, ωn−1 , tω1 ). s d Traveling Time = Drive Time + Delay Time + Stop Time ω_2 ω_3 ω_i ω_{n-1} (Thanks to Arik Senderovich for the slides)
  • 43.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Prediction: The Snapshot Principle in Single-Station Queues The snapshot principle stems from a heavy-traffic approximation of a queueing system under limits of its parameters, as the workload converges to capacity. Station1 The principle states that the total time in the station (waiting+service) remains constant. In our context, bus that passes through a segment, e.g., ωi, ωi+1 ∈ S × S, will have the same traveling time as another bus that has just passed through that segment (not necessarily of the same type, line, etc.).
  • 44.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Prediction: The Snapshot Principle in Single-Station Queues The snapshot principle stems from a heavy-traffic approximation of a queueing system under limits of its parameters, as the workload converges to capacity. Station1 The principle states that the total time in the station (waiting+service) remains constant. In our context, bus that passes through a segment, e.g., ωi, ωi+1 ∈ S × S, will have the same traveling time as another bus that has just passed through that segment (not necessarily of the same type, line, etc.).
  • 45.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Prediction: The Snapshot Principle in Single-Station Queues The snapshot principle stems from a heavy-traffic approximation of a queueing system under limits of its parameters, as the workload converges to capacity. Station1 The principle states that the total time in the station (waiting+service) remains constant. In our context, bus that passes through a segment, e.g., ωi, ωi+1 ∈ S × S, will have the same traveling time as another bus that has just passed through that segment (not necessarily of the same type, line, etc.).
  • 46.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules The Snapshot Principle in Single-Station Queues Based on the above, we define a single-segment snapshot predictor, Last-Bus-to-Travel-Segment (LBTS), denoted by θLBTS( ωi, ωi+1 , tω1 ). In real-life settings, applicability of the snapshot principle predictors should be tested ad-hoc. The snapshot principle was shown to be of an empirical value in previous research, where queueing techniques were applied to predict delays.
  • 47.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules The Snapshot Principle in Single-Station Queues Based on the above, we define a single-segment snapshot predictor, Last-Bus-to-Travel-Segment (LBTS), denoted by θLBTS( ωi, ωi+1 , tω1 ). In real-life settings, applicability of the snapshot principle predictors should be tested ad-hoc. The snapshot principle was shown to be of an empirical value in previous research, where queueing techniques were applied to predict delays.
  • 48.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network In our case, the LBTS predictor needs to be lifted to a network setting. The snapshot principle holds for networks of queues, when the routing through this network is known in advance. In scheduled transportation such as buses this is the case as the order of stops (and segments) is predefined: Station1 Station2 Station3 Station5 Station6 Station4 Station7
  • 49.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network In our case, the LBTS predictor needs to be lifted to a network setting. The snapshot principle holds for networks of queues, when the routing through this network is known in advance. In scheduled transportation such as buses this is the case as the order of stops (and segments) is predefined: Station1 Station2 Station3 Station5 Station6 Station4 Station7
  • 50.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network In our case, the LBTS predictor needs to be lifted to a network setting. The snapshot principle holds for networks of queues, when the routing through this network is known in advance. In scheduled transportation such as buses this is the case as the order of stops (and segments) is predefined: Station1 Station2 Station3 Station5 Station6 Station4 Station7
  • 51.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network We define a multi-segment (network) snapshot predictor that we refer to as the Last-Bus-to-Travel-Network or θLBTN ( ω1, ..., ωn , tω1 ), given a sequence of stops (with ω1 being the start stop and ωn being the end stop). According to the snapshot principle in networks we get that: θLBTN ( ω1, ..., ωn , tω1 ) = n i=1 θLBTS( ωi, ωi+1 , tω1 ).
  • 52.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network We define a multi-segment (network) snapshot predictor that we refer to as the Last-Bus-to-Travel-Network or θLBTN ( ω1, ..., ωn , tω1 ), given a sequence of stops (with ω1 being the start stop and ωn being the end stop). According to the snapshot principle in networks we get that: θLBTN ( ω1, ..., ωn , tω1 ) = n i=1 θLBTS( ωi, ωi+1 , tω1 ).
  • 53.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Snapshot Principle in a Network We define a multi-segment (network) snapshot predictor that we refer to as the Last-Bus-to-Travel-Network or θLBTN ( ω1, ..., ωn , tω1 ), given a sequence of stops (with ω1 being the start stop and ωn being the end stop). According to the snapshot principle in networks we get that: θLBTN ( ω1, ..., ωn , tω1 ) = n i=1 θLBTS( ωi, ωi+1 , tω1 ).
  • 54.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis Data 8 days of bus data, between September and October of 2014. Each day: approximately 11500 traveled segments. First trip for each day: no associated last travel time. Prediction for line 046A. Data comes from all buses that share segments with line 046A.
  • 55.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Performance Analysis 10 20 30 40 50 Index of the segment in the trip 100 101 102 103 104 105 106 107 Samplesquareestimationerror 40 50 60 70 80 90 100 110 RootMeanSquareError
  • 56.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Process Mining with Schedules ... Analysis Volume Better prediction Velocity Segmentation Variety Veracity Table: Big Data Cross Table
  • 57.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Process Mining with Schedules ... Management ... Volume Velocity Variety Veracity Event Cleaning Table: Big Data Cross Table
  • 58.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Thank You Avigdor Gal Technion – Israel Institute of Technology
  • 59.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules A. Adi and O. Etzion. Amit - the situation manager. The International Journal on Very Large Data Bases, 13(2):177–203, May 2004. Roger S. Barga, Jonathan Goldstein, Mohamed H. Ali, and Mingsheng Hong. Consistent streaming through time: A vision for event stream processing. In CIDR [DBL, 2007], pages 363–374. Business Process Model and Notation (BPMN) Version 2.0. Technical report, Object Management Group (OMG), January 2011. CIDR 2007, Third Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 7-10, 2007, Online Proceedings. www.cidrdb.org, 2007. Alan J. Demers, Johannes Gehrke, Biswanath Panda, Mirek Riedewald, Varun Sharma, and Walker M. White. Cayuga: A general purpose event monitoring system. In CIDR [DBL, 2007], pages 412–422. Opher Etzion and Peter Niblett. Event Processing in Action. Manning Publications Company, 2010.
  • 60.
    Lecture Outline Big Data: the New Playground Events, Processes,and Anything in Between Complex Event Processing Optimization Process Mining with Schedules Wolfgang Reisig. Petri Nets: An Introduction, volume 4 of Monographs in Theoretical Computer Science. An EATCS Series. Springer, 1985. Eugene Wu, Yanlei Diao, and Shariq Rizvi. High-performance complex event processing over streams. In SIGMOD ’06: Proceedings of the 2006 ACM SIGMOD international conference on Management of data, pages 407–418, New York, NY, USA, 2006. ACM.