SlideShare a Scribd company logo
1 of 10
Life in the Fast Lane: A Line-Rate
Linear Road
Theo Jepsen, Masoud Moshref, Antonio Carzaniga ,Nate Foster, Robert Soulé
Ajay Kharat 2019H1030011G
BITS-Pilani
Motivation
• Network hardware was simple and fixed.
• Cannot change the underlying code.
• As new generation of programmable switches which match the performance of
fixed function devices has become commercially available
like consensus protocols, in-network caching etc..
• One common feature of all these applications is that they depend on stateful
computations.
• If this trend continues—as appears likely—then it is worth identifying which
abstractions are needed to support a more general form of stateful processing.
How?
Problem Statement
• The answer is in the domain of stream processing.
• Stream processing naturally generalizes the basic model of
computation offered by these devices to a graph, where the edges
are streams and the nodes are operators.
• As a case study, it describes an implementation of the Linear Road
benchmark for stream processing systems written in P4 on chips with
an RMT architecture.
• We now describe some key implementation techniques and some
limitations in our implementation.
Linear Road
• Linear Road is a streaming application that monitors vehicles on a highway
using 5 queries .
• First three execute on streaming data and next two on historic data.
• This benchmark defines five queries. Out of which three queries depend
on continuous streams of data and other two on historical data.
1. Toll Notification
2. Accident Alert Continuous streams of data
3. Account Balance
4. Travel Time Estimation
5. Daily Expenditures Historical Data
Approach and Solution
• Toll Notification: Upon entering a segment of an expressway, a
vehicle should be notified of the toll for that segment, which is based
on the segment’s level of congestion.
• Travel Time Estimation : Given a time of day and day of week,
calculates the estimated travel time between two segments.
• Challenges of the implementation:
• No loop Constructs:
Explicit Loop Unrolling. P4 excludes looping constructs,
which are undesirable in hardware pipelines. Therefore, all
loops in our queries must be explicitly unrolled. For example,
the Accident Alert and Toll Notification queries must explicitly
check the next four segments for stopped cars, which is done
in the blue tables in Figure 1.
• Each stage can access only single register entry:
Multiple Register Arrays. For example, when a car crosses
from segment 5 to 6, the query must decrement the volume of
cars in the previous segment, and increment the next. Rather
than express this as segment[5]--; segment[6]++, we keep two
register arrays, one for even and one for odd segments:
segmentOdd[5/2]--; segmentEven[6/2]++.
• TOWARDS A GENERAL QUERY LANGUAGE
– Input Data:
• Time Varying Streams
• Static Relations
– Query Operators:
• Set Operators
• Join Operators
• Filtering Operators
• Aggregate Operators
• Window Operators
Over 4 billion events/second of Linear Road Events
For context only (not like-for-like):
The most recent published implementation of Linear Road running on a
single node (dual-core 3GHz Xeon CPU with 2GB RAM) could handle
around 2M events/second with 1.67 seconds of latency.
A more recent streaming engine, Drizzle, does not evaluate Linear Road,
but reports 100M events/second for the Yahoo streaming benchmark,
using Amazon EC2 instances.
Evaluation of the Solution
Related Work
P4 Benchmarks:
• Whippersnapper is a P4 benchmark. It describes an implementation of a benchmark as
a case study for stateful dataplane programming.
Implementations of Linear Road:
• Linear Road was first described in a language-agnostic logical specification.
• It has since been implemented for various streaming systems.
• Notably, a version written in CQL, ran on the Stanford STREAM data stream
management system .
• It was used to benchmark the Aurora and Borealis streaming engines.
• Implementation written in SPL running on IBM’s Infosphere Streams.
Future Work
• This paper argues for using stream processing as a model for the types of
abstractions we will need to support general stateful computations in
programmable network hardware.
• As a case study, it describes an implementation of Linear Road benchmark in P4.
This exercise not only provides a line-rate implementation of Linear Road, but also
helps to identify constraints and challenges for stateful processing.
• P4 is great for programming networking applications, but there is a need of a
completely new streaming language for the switch.

More Related Content

What's hot

Tech Days 2015: User Presentation Vermont Technical College
Tech Days 2015: User Presentation Vermont Technical CollegeTech Days 2015: User Presentation Vermont Technical College
Tech Days 2015: User Presentation Vermont Technical College
AdaCore
 
Briefing - The Atlast V Aft Bulkhead Carrier Update - Past Missions, Upcoming...
Briefing - The Atlast V Aft Bulkhead Carrier Update - Past Missions, Upcoming...Briefing - The Atlast V Aft Bulkhead Carrier Update - Past Missions, Upcoming...
Briefing - The Atlast V Aft Bulkhead Carrier Update - Past Missions, Upcoming...
Dave Callen
 

What's hot (20)

CArcMOOC 03.05 - RTL design
CArcMOOC 03.05 - RTL designCArcMOOC 03.05 - RTL design
CArcMOOC 03.05 - RTL design
 
demandlocker_TRB_v3
demandlocker_TRB_v3demandlocker_TRB_v3
demandlocker_TRB_v3
 
Project ppt
Project pptProject ppt
Project ppt
 
Appointment system tru x_usc_hackathon
Appointment system tru x_usc_hackathonAppointment system tru x_usc_hackathon
Appointment system tru x_usc_hackathon
 
Trimble
TrimbleTrimble
Trimble
 
Daniel lamblin week4_demo
Daniel lamblin week4_demoDaniel lamblin week4_demo
Daniel lamblin week4_demo
 
Whole Life Cost Modelling
Whole Life Cost ModellingWhole Life Cost Modelling
Whole Life Cost Modelling
 
Raising Abstraction in Timing Analysis for Vehicular Embedded Systems through...
Raising Abstraction in Timing Analysis for Vehicular Embedded Systems through...Raising Abstraction in Timing Analysis for Vehicular Embedded Systems through...
Raising Abstraction in Timing Analysis for Vehicular Embedded Systems through...
 
CArcMOOC 03.02 - Switching networks and combinational circuits
CArcMOOC 03.02 - Switching networks and combinational circuitsCArcMOOC 03.02 - Switching networks and combinational circuits
CArcMOOC 03.02 - Switching networks and combinational circuits
 
Tech Days 2015: User Presentation Vermont Technical College
Tech Days 2015: User Presentation Vermont Technical CollegeTech Days 2015: User Presentation Vermont Technical College
Tech Days 2015: User Presentation Vermont Technical College
 
Design and Implementation of Single Precision Pipelined Floating Point Co-Pro...
Design and Implementation of Single Precision Pipelined Floating Point Co-Pro...Design and Implementation of Single Precision Pipelined Floating Point Co-Pro...
Design and Implementation of Single Precision Pipelined Floating Point Co-Pro...
 
Briefing - The Atlast V Aft Bulkhead Carrier Update - Past Missions, Upcoming...
Briefing - The Atlast V Aft Bulkhead Carrier Update - Past Missions, Upcoming...Briefing - The Atlast V Aft Bulkhead Carrier Update - Past Missions, Upcoming...
Briefing - The Atlast V Aft Bulkhead Carrier Update - Past Missions, Upcoming...
 
Highway traffic optimization by variable speed limits
Highway traffic optimization by variable speed limitsHighway traffic optimization by variable speed limits
Highway traffic optimization by variable speed limits
 
A Pioneering Approach to Parallel Array Processing in Quantitative and Mathem...
A Pioneering Approach to Parallel Array Processing in Quantitative and Mathem...A Pioneering Approach to Parallel Array Processing in Quantitative and Mathem...
A Pioneering Approach to Parallel Array Processing in Quantitative and Mathem...
 
Vlsi ieee projects
Vlsi ieee projectsVlsi ieee projects
Vlsi ieee projects
 
5 Stage Pipeline Semi-custom Design
5 Stage Pipeline Semi-custom Design5 Stage Pipeline Semi-custom Design
5 Stage Pipeline Semi-custom Design
 
Development of a Validation Regime for an Autonomous Campus Shuttle
Development of a Validation Regime for an Autonomous Campus ShuttleDevelopment of a Validation Regime for an Autonomous Campus Shuttle
Development of a Validation Regime for an Autonomous Campus Shuttle
 
Design & implementation of high speed carry select adder
Design & implementation of high speed carry select adderDesign & implementation of high speed carry select adder
Design & implementation of high speed carry select adder
 
Modeling & Simulation of CubeSat-based Missions'Concept of Operations
Modeling & Simulation of CubeSat-based Missions'Concept of OperationsModeling & Simulation of CubeSat-based Missions'Concept of Operations
Modeling & Simulation of CubeSat-based Missions'Concept of Operations
 
Enabling Active Flow Manipulation (AFM) in Silicon-based Network Forwarding E...
Enabling Active Flow Manipulation (AFM) in Silicon-based Network Forwarding E...Enabling Active Flow Manipulation (AFM) in Silicon-based Network Forwarding E...
Enabling Active Flow Manipulation (AFM) in Silicon-based Network Forwarding E...
 

Similar to Life in the Fast Lane: A Line-Rate Linear Road

IPLC Analytic Dashboard - Mohd Rizal bin Mohd Ramly
IPLC Analytic Dashboard - Mohd Rizal bin Mohd RamlyIPLC Analytic Dashboard - Mohd Rizal bin Mohd Ramly
IPLC Analytic Dashboard - Mohd Rizal bin Mohd Ramly
MyNOG
 
A3: application-aware acceleration for wireless data networks
A3: application-aware acceleration for wireless data networksA3: application-aware acceleration for wireless data networks
A3: application-aware acceleration for wireless data networks
Zhenyun Zhuang
 
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERSROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
Deepak Shankar
 

Similar to Life in the Fast Lane: A Line-Rate Linear Road (20)

Review of the paper: Traffic-aware Frequency Scaling for Balanced On-Chip Net...
Review of the paper: Traffic-aware Frequency Scaling for Balanced On-Chip Net...Review of the paper: Traffic-aware Frequency Scaling for Balanced On-Chip Net...
Review of the paper: Traffic-aware Frequency Scaling for Balanced On-Chip Net...
 
A Low-Cost IoT Application for the Urban Traffic of Vehicles, Based on Wirele...
A Low-Cost IoT Application for the Urban Traffic of Vehicles, Based on Wirele...A Low-Cost IoT Application for the Urban Traffic of Vehicles, Based on Wirele...
A Low-Cost IoT Application for the Urban Traffic of Vehicles, Based on Wirele...
 
2014 IEEE JAVA NETWORKING COMPUTING PROJECT Cost effective resource allocatio...
2014 IEEE JAVA NETWORKING COMPUTING PROJECT Cost effective resource allocatio...2014 IEEE JAVA NETWORKING COMPUTING PROJECT Cost effective resource allocatio...
2014 IEEE JAVA NETWORKING COMPUTING PROJECT Cost effective resource allocatio...
 
IEEE 2014 JAVA NETWORKING PROJECTS Cost effective resource allocation of over...
IEEE 2014 JAVA NETWORKING PROJECTS Cost effective resource allocation of over...IEEE 2014 JAVA NETWORKING PROJECTS Cost effective resource allocation of over...
IEEE 2014 JAVA NETWORKING PROJECTS Cost effective resource allocation of over...
 
2014 IEEE JAVA NETWORKING PROJECT Cost effective resource allocation of overl...
2014 IEEE JAVA NETWORKING PROJECT Cost effective resource allocation of overl...2014 IEEE JAVA NETWORKING PROJECT Cost effective resource allocation of overl...
2014 IEEE JAVA NETWORKING PROJECT Cost effective resource allocation of overl...
 
Pretzel: optimized Machine Learning framework for low-latency and high throug...
Pretzel: optimized Machine Learning framework for low-latency and high throug...Pretzel: optimized Machine Learning framework for low-latency and high throug...
Pretzel: optimized Machine Learning framework for low-latency and high throug...
 
Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)
 
Accelerated development in Automotive E/E Systems using VisualSim Architect
Accelerated development in Automotive E/E Systems using VisualSim ArchitectAccelerated development in Automotive E/E Systems using VisualSim Architect
Accelerated development in Automotive E/E Systems using VisualSim Architect
 
JPJ1433 Cost-Effective Resource Allocation of Overlay Routing Relay Nodes
JPJ1433 Cost-Effective Resource Allocation of Overlay Routing Relay NodesJPJ1433 Cost-Effective Resource Allocation of Overlay Routing Relay Nodes
JPJ1433 Cost-Effective Resource Allocation of Overlay Routing Relay Nodes
 
IPLC Analytic Dashboard - Mohd Rizal bin Mohd Ramly
IPLC Analytic Dashboard - Mohd Rizal bin Mohd RamlyIPLC Analytic Dashboard - Mohd Rizal bin Mohd Ramly
IPLC Analytic Dashboard - Mohd Rizal bin Mohd Ramly
 
Presentazione tesi magistrale Martino Marangon
Presentazione tesi magistrale Martino MarangonPresentazione tesi magistrale Martino Marangon
Presentazione tesi magistrale Martino Marangon
 
A3: application-aware acceleration for wireless data networks
A3: application-aware acceleration for wireless data networksA3: application-aware acceleration for wireless data networks
A3: application-aware acceleration for wireless data networks
 
Testing tool for an automated ticketing system
Testing tool for an automated ticketing systemTesting tool for an automated ticketing system
Testing tool for an automated ticketing system
 
Mobile Ad Hoc Network of Simulation Framework Based on OPNET
Mobile Ad Hoc Network of Simulation Framework Based on OPNETMobile Ad Hoc Network of Simulation Framework Based on OPNET
Mobile Ad Hoc Network of Simulation Framework Based on OPNET
 
Traffic Simulator
Traffic SimulatorTraffic Simulator
Traffic Simulator
 
cost effective resource allocation of overlay routing relay nodes
cost effective resource allocation of overlay routing relay nodescost effective resource allocation of overlay routing relay nodes
cost effective resource allocation of overlay routing relay nodes
 
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERSROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
 
AMBA 2.0 REPORT
AMBA 2.0 REPORTAMBA 2.0 REPORT
AMBA 2.0 REPORT
 
Multicore_Architecture Book.pdf
Multicore_Architecture Book.pdfMulticore_Architecture Book.pdf
Multicore_Architecture Book.pdf
 
Simulation Based EIGRP with two Autonomous systems Performance Analysis
Simulation Based EIGRP with two Autonomous systems Performance Analysis Simulation Based EIGRP with two Autonomous systems Performance Analysis
Simulation Based EIGRP with two Autonomous systems Performance Analysis
 

More from AJAY KHARAT

More from AJAY KHARAT (12)

Uncovering Bugs in P4 Programs with Assertion-based Verification
Uncovering Bugs in P4 Programs with Assertion-based VerificationUncovering Bugs in P4 Programs with Assertion-based Verification
Uncovering Bugs in P4 Programs with Assertion-based Verification
 
SDPROBER: A SOFTWARE DEFINED PROBER FOR SDN
SDPROBER: A SOFTWARE DEFINED PROBER FOR SDNSDPROBER: A SOFTWARE DEFINED PROBER FOR SDN
SDPROBER: A SOFTWARE DEFINED PROBER FOR SDN
 
Instrumenting Open vSwitch with Monitoring Capabilities: Designs and Challenges
Instrumenting Open vSwitch with Monitoring Capabilities: Designs and ChallengesInstrumenting Open vSwitch with Monitoring Capabilities: Designs and Challenges
Instrumenting Open vSwitch with Monitoring Capabilities: Designs and Challenges
 
Memory and Performance Isolation for a Multi-tenant Function-based Data-plane
Memory and Performance Isolation for a Multi-tenant Function-based Data-planeMemory and Performance Isolation for a Multi-tenant Function-based Data-plane
Memory and Performance Isolation for a Multi-tenant Function-based Data-plane
 
NS4: Enabling Programmable Data Plane Simulation
NS4: Enabling Programmable Data Plane SimulationNS4: Enabling Programmable Data Plane Simulation
NS4: Enabling Programmable Data Plane Simulation
 
YATES: Rapid Prototyping for Traffic Engineering Systems
YATES: Rapid Prototyping forTraffic Engineering SystemsYATES: Rapid Prototyping forTraffic Engineering Systems
YATES: Rapid Prototyping for Traffic Engineering Systems
 
How to implement complex policies on existing network infrastructure
How to implement complex policies on existing network infrastructure How to implement complex policies on existing network infrastructure
How to implement complex policies on existing network infrastructure
 
Network-Wide Heavy-Hitter Detection with Commodity Switches
Network-Wide Heavy-Hitter Detection with Commodity SwitchesNetwork-Wide Heavy-Hitter Detection with Commodity Switches
Network-Wide Heavy-Hitter Detection with Commodity Switches
 
p4pktgen: Automated Test Case Generation for P4 Programs
p4pktgen:  Automated Test Case  Generation for P4 Programsp4pktgen:  Automated Test Case  Generation for P4 Programs
p4pktgen: Automated Test Case Generation for P4 Programs
 
Mutual exclusion in distributed systems
Mutual exclusion in distributed systemsMutual exclusion in distributed systems
Mutual exclusion in distributed systems
 
virtual memory management in multi processor mach os
virtual memory management in multi processor mach osvirtual memory management in multi processor mach os
virtual memory management in multi processor mach os
 
Solutions to byzantine agreement problem
Solutions to byzantine agreement problem Solutions to byzantine agreement problem
Solutions to byzantine agreement problem
 

Recently uploaded

Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
dharasingh5698
 
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Christo Ananth
 

Recently uploaded (20)

BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxBSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdf
 
UNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular ConduitsUNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular Conduits
 
Roadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and RoutesRoadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and Routes
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
 
UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performance
 
Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024
 
Vivazz, Mieres Social Housing Design Spain
Vivazz, Mieres Social Housing Design SpainVivazz, Mieres Social Housing Design Spain
Vivazz, Mieres Social Housing Design Spain
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
 
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptx
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
 
UNIT-III FMM. DIMENSIONAL ANALYSIS
UNIT-III FMM.        DIMENSIONAL ANALYSISUNIT-III FMM.        DIMENSIONAL ANALYSIS
UNIT-III FMM. DIMENSIONAL ANALYSIS
 
chapter 5.pptx: drainage and irrigation engineering
chapter 5.pptx: drainage and irrigation engineeringchapter 5.pptx: drainage and irrigation engineering
chapter 5.pptx: drainage and irrigation engineering
 
NFPA 5000 2024 standard .
NFPA 5000 2024 standard                                  .NFPA 5000 2024 standard                                  .
NFPA 5000 2024 standard .
 

Life in the Fast Lane: A Line-Rate Linear Road

  • 1. Life in the Fast Lane: A Line-Rate Linear Road Theo Jepsen, Masoud Moshref, Antonio Carzaniga ,Nate Foster, Robert Soulé Ajay Kharat 2019H1030011G BITS-Pilani
  • 2. Motivation • Network hardware was simple and fixed. • Cannot change the underlying code. • As new generation of programmable switches which match the performance of fixed function devices has become commercially available like consensus protocols, in-network caching etc.. • One common feature of all these applications is that they depend on stateful computations. • If this trend continues—as appears likely—then it is worth identifying which abstractions are needed to support a more general form of stateful processing. How?
  • 3. Problem Statement • The answer is in the domain of stream processing. • Stream processing naturally generalizes the basic model of computation offered by these devices to a graph, where the edges are streams and the nodes are operators. • As a case study, it describes an implementation of the Linear Road benchmark for stream processing systems written in P4 on chips with an RMT architecture. • We now describe some key implementation techniques and some limitations in our implementation.
  • 4. Linear Road • Linear Road is a streaming application that monitors vehicles on a highway using 5 queries . • First three execute on streaming data and next two on historic data. • This benchmark defines five queries. Out of which three queries depend on continuous streams of data and other two on historical data. 1. Toll Notification 2. Accident Alert Continuous streams of data 3. Account Balance 4. Travel Time Estimation 5. Daily Expenditures Historical Data
  • 5. Approach and Solution • Toll Notification: Upon entering a segment of an expressway, a vehicle should be notified of the toll for that segment, which is based on the segment’s level of congestion. • Travel Time Estimation : Given a time of day and day of week, calculates the estimated travel time between two segments.
  • 6. • Challenges of the implementation: • No loop Constructs: Explicit Loop Unrolling. P4 excludes looping constructs, which are undesirable in hardware pipelines. Therefore, all loops in our queries must be explicitly unrolled. For example, the Accident Alert and Toll Notification queries must explicitly check the next four segments for stopped cars, which is done in the blue tables in Figure 1. • Each stage can access only single register entry: Multiple Register Arrays. For example, when a car crosses from segment 5 to 6, the query must decrement the volume of cars in the previous segment, and increment the next. Rather than express this as segment[5]--; segment[6]++, we keep two register arrays, one for even and one for odd segments: segmentOdd[5/2]--; segmentEven[6/2]++.
  • 7. • TOWARDS A GENERAL QUERY LANGUAGE – Input Data: • Time Varying Streams • Static Relations – Query Operators: • Set Operators • Join Operators • Filtering Operators • Aggregate Operators • Window Operators
  • 8. Over 4 billion events/second of Linear Road Events For context only (not like-for-like): The most recent published implementation of Linear Road running on a single node (dual-core 3GHz Xeon CPU with 2GB RAM) could handle around 2M events/second with 1.67 seconds of latency. A more recent streaming engine, Drizzle, does not evaluate Linear Road, but reports 100M events/second for the Yahoo streaming benchmark, using Amazon EC2 instances. Evaluation of the Solution
  • 9. Related Work P4 Benchmarks: • Whippersnapper is a P4 benchmark. It describes an implementation of a benchmark as a case study for stateful dataplane programming. Implementations of Linear Road: • Linear Road was first described in a language-agnostic logical specification. • It has since been implemented for various streaming systems. • Notably, a version written in CQL, ran on the Stanford STREAM data stream management system . • It was used to benchmark the Aurora and Borealis streaming engines. • Implementation written in SPL running on IBM’s Infosphere Streams.
  • 10. Future Work • This paper argues for using stream processing as a model for the types of abstractions we will need to support general stateful computations in programmable network hardware. • As a case study, it describes an implementation of Linear Road benchmark in P4. This exercise not only provides a line-rate implementation of Linear Road, but also helps to identify constraints and challenges for stateful processing. • P4 is great for programming networking applications, but there is a need of a completely new streaming language for the switch.