SlideShare une entreprise Scribd logo
1  sur  24
Télécharger pour lire hors ligne
Comet with node.js and V8


          by amix
About me
•   Cofounder and lead developer of Plurk.com
    Coded most of the frontend and backend


• Mostly code in Python and JavaScript
    But I am proficient in other languages as well (C, Java, Lisp, Lua etc.)


• I have coded since I was 12
    24 years old now and still love to program :-)


• Not a node.js expert...
    But I find it very interesting
Overview of the talk
• Why JavaScript matters
• What makes V8 VM special
• node.js in some details
• Characteristics of comet communication
•   Implementing comet using node.js and WebSockets

• Perspective: JavaScript as the future platform
Why JavaScript matters
• The pool of JavaScript programmers is huge
    and it’s getting bigger
• JavaScript’sbrowsers that support it and allthe mobile
  think of all the
                   distribution is among
                                               the
                                                   largest
    platforms that support it or will support it... Think of Flash

•   Big companies like Adobe, Google, Apple and Microsoft
    are spending tons of $ in improving JavaScript

• JavaScript is likely to become one of the
    most popular languages
• JavaScript is gaining ground on the backend
What makes V8 special
•   V8 JavaScript VM is used in Google Chrome
    and is developed by a small Google team in
    Denmark. V8 is open-source

• V8 team is led by Lars Bak, one of the
    leading VM engineers in the world with 20
    years of experience in building VMs
• Lars Bak was the technical lead behind
    HotSpot (Sun’s Java VM). HotSpot improved
    Java’s performance 20x times
•   Before HotSpot Lars Bak worked on a Smalltalk VM
What makes V8 special
• No JIT, all JavaScript is compiled to assembler
• Hidden classes optimization properties, instead it
  V8 does not dynamically lookup access
                                        from Self
  uses hidden classes that are created behind the scene

• Improved garbage collector garbage collector
  stop-the-world, generational, accurate,

• V8 is independent of Google Chrome
• Remarks / “limitations”: threads, no processes
  No bytecode language, no
What is node.js?
• A system built on top of V8
• Introduces: IO
    - non-blocking
      - ability to do system calls
      - HTTP libraries
      - module system (+ other things)

• The non-blocking nature makes node.js a
    good fit for comet and next generation
    realtime web-applications
•   8000 lines of C/C++, 2000 lines of Javascript, 14 contributors
Advantages of non-blocking




• nginx: non-blocking apache: threaded
• non-blocking can handle more req. pr. sec
    and uses a lot less memory
•   comet does not scale at all for threaded servers...

                       graph source: http://blog.webfaction.com/a-little-holiday-present
Major point
JavaScript programming is already geared
towards event based programming:
• Events in browsers....
• Closures (anonymous functions) are natural part
   of the language

  document.addEventListener("click", function(event) {
  	 alert(event)
  }, false)
Hello world using node.js
var	
  sys	
  =	
  require('sys'),	
  
	
  	
  	
  	
  http	
  =	
  require('http')

http.createServer(function	
  (req,	
  res)	
  {
	
   setTimeout(function	
  ()	
  {
	
   	
     res.sendHeader(200,	
  {'Content-­‐Type':	
  'text/plain'})
	
   	
     res.sendBody('Hello	
  World')
	
   	
     res.finish()
	
   },	
  2000)
}).listen(8000)

sys.puts('Server	
  running	
  at	
  http://127.0.0.1:8000/')




                                                                          hello_world.js
Blocking vs. non-blocking
The way to do it            The way to do
in most other               it in node.js!
languages:                  puts("Enter your name: ")
                            gets(function (name) {
                                puts("Name: " + name)
puts("Enter your name: ")   })
var name = gets()
puts("Name: " + name)




           node.js design philosophy:
     To receive data from disk, network or
   another process there must be a callback.
Events in node.js
    • All objects which emit events are are
        instances of process.EventEmitter
    • A promise is a EventEmitter which emits
        either success or error, but not both
var tcp = require("tcp")       var stat = require("posix").stat,
                                   puts = require("sys").puts
var s = tcp.createServer()
                               var promise = stat("/etc/passwd")
s.addListener("connection",
                               promise.addCallback(function (s) {
   function (c) {
                                  puts("modified: " + s.mtime)
      c.send("hello nasty!")
                               })
      c.close()                promise.addErrback(function(orgi_promise) {
})                                  puts("Could not fetch stats on /etc/passwd")
s.listen(8000)                 })
Comet vs. Ajax
                Ajax is so yesterday...
      Comet is the new superhero on the block




Comet can be used to create real time web-applications
     Examples include Plurk and Google Wave. Demo of Plurk real time messaging
Ajax vs. Comet
          Ajax                          Comet (long poll)                     Comet (streaming)
Browser              Server           Browser              Server           Browser              Server
          request                               request                               request

          response


                                                               x seconds

                              event



                                                response                              response
          request
                                                                    event                                 event
                                                request
          response
                                                                                      response
                                                                                                          event




  How most do it today                  How some do it today                 How we will do it soon
Major point
• Comet servers need to have a lot of open
  connections
• One thread pr. connection does not scale
• The solution is to use event based servers
• It’s only possible to create event based
  servers in node.js!
Implementing comet
• Long polling parts. Used in Plurk
  - works for most
  - is more expensive and problematic than streaming

• Streaming withoutto proxies and firewalls
  - Very problematic due
                         WebSockets:

• Streaming with WebSockets (HTML5):side
  - Makes comet trivial on both client and server

• In this presentation we will focus on the
  future: Building a chat application with
  WebSockets and node.js
WebSockets
•   Aims to expose TCP/IP sockets to browsers,
    while respecting the constraints of the web
    (security, proxies and firewalls)

• A thin layer on top of TCP/IP that adds:
    •   origin based security model

    •   Addressing and protocol naming mechanism for supporting multiple
        services on one port and multiple host names on one IP address

    •   framing mechanism for data transporation

•   More information: http://dev.w3.org/html5/websockets/

•   Currently implemented in Google Chrome
node.websocket.js implementation
                                                                                                      demo
var	
  sys	
  =	
  require('sys')                                    Room = {
	
   	
  members	
  =	
  []                                          	 init: function() {
                                                                     	 	       Room.ws = new WebSocket('ws://127.0.0.1:8080/chat')
var	
  Module	
  =	
  this.Module	
  =	
  function()	
  {	
  }       	 	       Room.ws.onopen = Room._onopen
                                                                     	 	       Room.ws.onmessage = Room._onmessage
Module.prototype.onData	
  =	
  function(data,	
  connection)	
  {   	 	       Room.ws.onclose = Room._onclose
	
   for(var	
  i	
  in	
  members)                                  	 },
                                                                         //...
	
   	
    members[i].send(data)
                                                                         _send: function(user, message){
};
                                                                     	 	       Room.ws.send(serializeJSON({
                                                                     	 	       	    'from': user,
Module.prototype.onConnect	
  =	
  function(connection)	
  {         	 	       	    'message': message
	
   members.push(connection)                                        	 	       }))
}                                                                    	 },
                                                                         _onmessage: function(m) {
Module.prototype.onDisconnect	
  =	
  function(connection)	
  {      	 	       if (m.data) {
	
   for(var	
  i	
  in	
  members)	
  {                             	 	       	    var data = evalTxt(m.data)
	
   	
    if(members[i]	
  ==	
  connection)	
  {
	
   	
    	
        members.splice(i,	
  1)                         	   	      	   from = data.from
	
   	
    	
        break;                                          	   	      	   message = data.message
	
   	
    }                                                              //...
	
   }
}



                                          Note: I have patched
                                 node.websocket.js to include onConnect...
Other comet servers
• JBoss Netty: Java library for doing non-
  blocking networking, based on java.nio
  used by Plurk to handle 200.000+ open connections


• erlycomet: Erlang comet server based on
  MochiWeb
• Tornado: FriendFeed’s Python non-
  blocking server
• I have tried most of the popular approaches
  and none of them feel as natural as node.js!
How does node.js perfrom?
   • Hello World benchmark node.js vs. Tornado
        non scientific - take it with a grain of salt!

   •    Tornado is one of the fastest Python based servers
$ ab -c 100 -n 1000 http://127.0.0.1:8000/          $ ab -c 100 -n 1000 http://127.0.0.1:8000/
Concurrency Level:      100                         Concurrency Level:      100
Time taken for tests:   0.230 seconds               Time taken for tests:   0.427 seconds
Complete requests:      1000                        Complete requests:      1000
Failed requests:        0                           Failed requests:        0
Write errors:           0                           Write errors:           0
Total transferred:      75075 bytes                 Total transferred:      171864 bytes
HTML transferred:       11011 bytes                 HTML transferred:       12276 bytes
Requests per second:    4340.26 [#/sec] (mean)      Requests per second:    2344.36 [#/sec] (mean)
Time per request:       23.040 [ms] (mean)          Time per request:       42.656 [ms] (mean)
Time per request:       0.230 [ms]                  Time per request:       0.427 [ms]
Transfer rate:          318.21 [Kbytes/sec]         Transfer rate:          393.47 [Kbytes/sec]


           node.js                                             Tornado
CoffeScript
      •     A Ruby inspired language that compiles to JavaScript
             CoffeScript                                                         JavaScript
  square: x => x * x.                                         var cube, square;
  cube:   x => square(x) * x.                                 square = function(x) {
                                                                return x * x
                                                              }
                                                              cube = function(x) {
                                                                return square(x) * x
                                                              }


sys = require('sys')                                          var sys = require('sys'),
http = require('http')                                        http = require('http')

http.createServer( req, res =>                                http.createServer(function (req, res) {
    setTimeout( =>                                            	 setTimeout(function () {
        res.sendHeader(200, {'Content-Type': 'text/plain'})   	 	      res.sendHeader(200, {'Content-Type': 'text/plain'})
        res.sendBody('Hello World')                           	 	      res.sendBody('Hello World')
        res.finish()., 2000).                                 	 	      res.finish()
).listen(8000)                                                	 }, 2000)
                                                              }).listen(8000)




                 JavaScript: The platform of the future?
References
•   Official page of node.js: http://nodejs.org/

•   Official page of V8: http://code.google.com/p/v8/

•   CoffeScript: http://jashkenas.github.com/coffee-script/

•   Websockets spec: http://dev.w3.org/html5/websockets/

•   node.websocket.js: http://github.com/guille/node.websocket.js/

•   Tornado: http://www.tornadoweb.org/

•   JBoss Netty: http://jboss.org/netty

•   erlycomet: http://code.google.com/p/erlycomet/
PS: Plurk API
•   Plurk API is now available:
    http://www.plurk.com/API

•   Python, Ruby, PHP and Java implementations are under
    development

•   Use it to build cool applications :-)
Questions?

•   These slides will be posted to:
    www.amix.dk (my blog)


•   You can private plurk me on Plurk:
    http://www.plurk.com/amix

Contenu connexe

Tendances

Node.js and How JavaScript is Changing Server Programming
Node.js and How JavaScript is Changing Server Programming  Node.js and How JavaScript is Changing Server Programming
Node.js and How JavaScript is Changing Server Programming
Tom Croucher
 
Building servers with Node.js
Building servers with Node.jsBuilding servers with Node.js
Building servers with Node.js
ConFoo
 

Tendances (20)

Introduction Node.js
Introduction Node.jsIntroduction Node.js
Introduction Node.js
 
Node.js - A Quick Tour
Node.js - A Quick TourNode.js - A Quick Tour
Node.js - A Quick Tour
 
Node.js and How JavaScript is Changing Server Programming
Node.js and How JavaScript is Changing Server Programming  Node.js and How JavaScript is Changing Server Programming
Node.js and How JavaScript is Changing Server Programming
 
Intro to Node.js (v1)
Intro to Node.js (v1)Intro to Node.js (v1)
Intro to Node.js (v1)
 
node.js: Javascript's in your backend
node.js: Javascript's in your backendnode.js: Javascript's in your backend
node.js: Javascript's in your backend
 
RESTful API In Node Js using Express
RESTful API In Node Js using Express RESTful API In Node Js using Express
RESTful API In Node Js using Express
 
NodeJS for Beginner
NodeJS for BeginnerNodeJS for Beginner
NodeJS for Beginner
 
Building your first Node app with Connect & Express
Building your first Node app with Connect & ExpressBuilding your first Node app with Connect & Express
Building your first Node app with Connect & Express
 
Building servers with Node.js
Building servers with Node.jsBuilding servers with Node.js
Building servers with Node.js
 
Non-blocking I/O, Event loops and node.js
Non-blocking I/O, Event loops and node.jsNon-blocking I/O, Event loops and node.js
Non-blocking I/O, Event loops and node.js
 
Introduction to Node.js: What, why and how?
Introduction to Node.js: What, why and how?Introduction to Node.js: What, why and how?
Introduction to Node.js: What, why and how?
 
Building a real life application in node js
Building a real life application in node jsBuilding a real life application in node js
Building a real life application in node js
 
Express node js
Express node jsExpress node js
Express node js
 
Node ppt
Node pptNode ppt
Node ppt
 
Node Architecture and Getting Started with Express
Node Architecture and Getting Started with ExpressNode Architecture and Getting Started with Express
Node Architecture and Getting Started with Express
 
Node.js
Node.jsNode.js
Node.js
 
Server Side Event Driven Programming
Server Side Event Driven ProgrammingServer Side Event Driven Programming
Server Side Event Driven Programming
 
NodeJS
NodeJSNodeJS
NodeJS
 
All aboard the NodeJS Express
All aboard the NodeJS ExpressAll aboard the NodeJS Express
All aboard the NodeJS Express
 
Nodejs intro
Nodejs introNodejs intro
Nodejs intro
 

En vedette

Distributed app development with nodejs and zeromq
Distributed app development with nodejs and zeromqDistributed app development with nodejs and zeromq
Distributed app development with nodejs and zeromq
Ruben Tan
 

En vedette (20)

Reverse ajax in 2014
Reverse ajax in 2014Reverse ajax in 2014
Reverse ajax in 2014
 
Safari Push Notification
Safari Push NotificationSafari Push Notification
Safari Push Notification
 
Time for Comet?
Time for Comet?Time for Comet?
Time for Comet?
 
Node.js Core State of the Union- James Snell
Node.js Core State of the Union- James SnellNode.js Core State of the Union- James Snell
Node.js Core State of the Union- James Snell
 
State of the CLI- Kat Marchan
State of the CLI- Kat MarchanState of the CLI- Kat Marchan
State of the CLI- Kat Marchan
 
Hitchhiker's Guide to"'Serverless" Javascript - Steven Faulkner, Bustle
Hitchhiker's Guide to"'Serverless" Javascript - Steven Faulkner, BustleHitchhiker's Guide to"'Serverless" Javascript - Steven Faulkner, Bustle
Hitchhiker's Guide to"'Serverless" Javascript - Steven Faulkner, Bustle
 
Take Data Validation Seriously - Paul Milham, WildWorks
Take Data Validation Seriously - Paul Milham, WildWorksTake Data Validation Seriously - Paul Milham, WildWorks
Take Data Validation Seriously - Paul Milham, WildWorks
 
Real-Life Node.js Troubleshooting - Damian Schenkelman, Auth0
Real-Life Node.js Troubleshooting - Damian Schenkelman, Auth0Real-Life Node.js Troubleshooting - Damian Schenkelman, Auth0
Real-Life Node.js Troubleshooting - Damian Schenkelman, Auth0
 
Multimodal Interactions & JS: The What, The Why and The How - Diego Paez, Des...
Multimodal Interactions & JS: The What, The Why and The How - Diego Paez, Des...Multimodal Interactions & JS: The What, The Why and The How - Diego Paez, Des...
Multimodal Interactions & JS: The What, The Why and The How - Diego Paez, Des...
 
Developing Nirvana - Corey A. Butler, Author.io
Developing Nirvana - Corey A. Butler, Author.ioDeveloping Nirvana - Corey A. Butler, Author.io
Developing Nirvana - Corey A. Butler, Author.io
 
From Pterodactyls and Cactus to Artificial Intelligence - Ivan Seidel Gomes, ...
From Pterodactyls and Cactus to Artificial Intelligence - Ivan Seidel Gomes, ...From Pterodactyls and Cactus to Artificial Intelligence - Ivan Seidel Gomes, ...
From Pterodactyls and Cactus to Artificial Intelligence - Ivan Seidel Gomes, ...
 
Are your v8 garbage collection logs speaking to you?Joyee Cheung -Alibaba Clo...
Are your v8 garbage collection logs speaking to you?Joyee Cheung -Alibaba Clo...Are your v8 garbage collection logs speaking to you?Joyee Cheung -Alibaba Clo...
Are your v8 garbage collection logs speaking to you?Joyee Cheung -Alibaba Clo...
 
Node's Event Loop From the Inside Out - Sam Roberts, IBM
Node's Event Loop From the Inside Out - Sam Roberts, IBMNode's Event Loop From the Inside Out - Sam Roberts, IBM
Node's Event Loop From the Inside Out - Sam Roberts, IBM
 
Real-Time Machine Learning with Node.js - Philipp Burckhardt, Carnegie Mellon...
Real-Time Machine Learning with Node.js - Philipp Burckhardt, Carnegie Mellon...Real-Time Machine Learning with Node.js - Philipp Burckhardt, Carnegie Mellon...
Real-Time Machine Learning with Node.js - Philipp Burckhardt, Carnegie Mellon...
 
Math in V8 is Broken and How We Can Fix It - Athan Reines, Fourier
Math in V8 is Broken and How We Can Fix It - Athan Reines, FourierMath in V8 is Broken and How We Can Fix It - Athan Reines, Fourier
Math in V8 is Broken and How We Can Fix It - Athan Reines, Fourier
 
Web MIDI API - the paster, the present, and the future -
Web MIDI API - the paster, the present, and the future -Web MIDI API - the paster, the present, and the future -
Web MIDI API - the paster, the present, and the future -
 
IBM MQ v8 and JMS 2.0
IBM MQ v8 and JMS 2.0IBM MQ v8 and JMS 2.0
IBM MQ v8 and JMS 2.0
 
Distributed app development with nodejs and zeromq
Distributed app development with nodejs and zeromqDistributed app development with nodejs and zeromq
Distributed app development with nodejs and zeromq
 
Nodifying the Enterprise - Prince Soni, TO THE NEW
Nodifying the Enterprise - Prince Soni, TO THE NEWNodifying the Enterprise - Prince Soni, TO THE NEW
Nodifying the Enterprise - Prince Soni, TO THE NEW
 
Text Mining with Node.js - Philipp Burckhardt, Carnegie Mellon University
Text Mining with Node.js - Philipp Burckhardt, Carnegie Mellon UniversityText Mining with Node.js - Philipp Burckhardt, Carnegie Mellon University
Text Mining with Node.js - Philipp Burckhardt, Carnegie Mellon University
 

Similaire à Comet with node.js and V8

Why Node.js
Why Node.jsWhy Node.js
Why Node.js
guileen
 
Node.js Enterprise Middleware
Node.js Enterprise MiddlewareNode.js Enterprise Middleware
Node.js Enterprise Middleware
Behrad Zari
 
Intro to node and mongodb 1
Intro to node and mongodb   1Intro to node and mongodb   1
Intro to node and mongodb 1
Mohammad Qureshi
 
540slidesofnodejsbackendhopeitworkforu.pdf
540slidesofnodejsbackendhopeitworkforu.pdf540slidesofnodejsbackendhopeitworkforu.pdf
540slidesofnodejsbackendhopeitworkforu.pdf
hamzadamani7
 

Similaire à Comet with node.js and V8 (20)

soft-shake.ch - Hands on Node.js
soft-shake.ch - Hands on Node.jssoft-shake.ch - Hands on Node.js
soft-shake.ch - Hands on Node.js
 
Event-driven IO server-side JavaScript environment based on V8 Engine
Event-driven IO server-side JavaScript environment based on V8 EngineEvent-driven IO server-side JavaScript environment based on V8 Engine
Event-driven IO server-side JavaScript environment based on V8 Engine
 
Why Nodejs Guilin Shanghai
Why Nodejs Guilin ShanghaiWhy Nodejs Guilin Shanghai
Why Nodejs Guilin Shanghai
 
Why Node.js
Why Node.jsWhy Node.js
Why Node.js
 
Node azure
Node azureNode azure
Node azure
 
Original slides from Ryan Dahl's NodeJs intro talk
Original slides from Ryan Dahl's NodeJs intro talkOriginal slides from Ryan Dahl's NodeJs intro talk
Original slides from Ryan Dahl's NodeJs intro talk
 
Node.js: A Guided Tour
Node.js: A Guided TourNode.js: A Guided Tour
Node.js: A Guided Tour
 
Introduce about Nodejs - duyetdev.com
Introduce about Nodejs - duyetdev.comIntroduce about Nodejs - duyetdev.com
Introduce about Nodejs - duyetdev.com
 
Introduction to REST API with Node.js
Introduction to REST API with Node.jsIntroduction to REST API with Node.js
Introduction to REST API with Node.js
 
Node.js - async for the rest of us.
Node.js - async for the rest of us.Node.js - async for the rest of us.
Node.js - async for the rest of us.
 
Node.js Enterprise Middleware
Node.js Enterprise MiddlewareNode.js Enterprise Middleware
Node.js Enterprise Middleware
 
Intro to node and mongodb 1
Intro to node and mongodb   1Intro to node and mongodb   1
Intro to node and mongodb 1
 
Communication in Node.js
Communication in Node.jsCommunication in Node.js
Communication in Node.js
 
Hazelcast and MongoDB at Cloud CMS
Hazelcast and MongoDB at Cloud CMSHazelcast and MongoDB at Cloud CMS
Hazelcast and MongoDB at Cloud CMS
 
JAX London 2015: Java vs Nodejs
JAX London 2015: Java vs NodejsJAX London 2015: Java vs Nodejs
JAX London 2015: Java vs Nodejs
 
NodeJS
NodeJSNodeJS
NodeJS
 
Practical Use of MongoDB for Node.js
Practical Use of MongoDB for Node.jsPractical Use of MongoDB for Node.js
Practical Use of MongoDB for Node.js
 
Groovy & Grails eXchange 2012 vert.x presentation
Groovy & Grails eXchange 2012 vert.x presentationGroovy & Grails eXchange 2012 vert.x presentation
Groovy & Grails eXchange 2012 vert.x presentation
 
Java vs. Java Script for enterprise web applications - Chris Bailey
Java vs. Java Script for enterprise web applications - Chris BaileyJava vs. Java Script for enterprise web applications - Chris Bailey
Java vs. Java Script for enterprise web applications - Chris Bailey
 
540slidesofnodejsbackendhopeitworkforu.pdf
540slidesofnodejsbackendhopeitworkforu.pdf540slidesofnodejsbackendhopeitworkforu.pdf
540slidesofnodejsbackendhopeitworkforu.pdf
 

Dernier

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 

Dernier (20)

FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 

Comet with node.js and V8

  • 1. Comet with node.js and V8 by amix
  • 2. About me • Cofounder and lead developer of Plurk.com Coded most of the frontend and backend • Mostly code in Python and JavaScript But I am proficient in other languages as well (C, Java, Lisp, Lua etc.) • I have coded since I was 12 24 years old now and still love to program :-) • Not a node.js expert... But I find it very interesting
  • 3. Overview of the talk • Why JavaScript matters • What makes V8 VM special • node.js in some details • Characteristics of comet communication • Implementing comet using node.js and WebSockets • Perspective: JavaScript as the future platform
  • 4. Why JavaScript matters • The pool of JavaScript programmers is huge and it’s getting bigger • JavaScript’sbrowsers that support it and allthe mobile think of all the distribution is among the largest platforms that support it or will support it... Think of Flash • Big companies like Adobe, Google, Apple and Microsoft are spending tons of $ in improving JavaScript • JavaScript is likely to become one of the most popular languages • JavaScript is gaining ground on the backend
  • 5. What makes V8 special • V8 JavaScript VM is used in Google Chrome and is developed by a small Google team in Denmark. V8 is open-source • V8 team is led by Lars Bak, one of the leading VM engineers in the world with 20 years of experience in building VMs • Lars Bak was the technical lead behind HotSpot (Sun’s Java VM). HotSpot improved Java’s performance 20x times • Before HotSpot Lars Bak worked on a Smalltalk VM
  • 6. What makes V8 special • No JIT, all JavaScript is compiled to assembler • Hidden classes optimization properties, instead it V8 does not dynamically lookup access from Self uses hidden classes that are created behind the scene • Improved garbage collector garbage collector stop-the-world, generational, accurate, • V8 is independent of Google Chrome • Remarks / “limitations”: threads, no processes No bytecode language, no
  • 7. What is node.js? • A system built on top of V8 • Introduces: IO - non-blocking - ability to do system calls - HTTP libraries - module system (+ other things) • The non-blocking nature makes node.js a good fit for comet and next generation realtime web-applications • 8000 lines of C/C++, 2000 lines of Javascript, 14 contributors
  • 8. Advantages of non-blocking • nginx: non-blocking apache: threaded • non-blocking can handle more req. pr. sec and uses a lot less memory • comet does not scale at all for threaded servers... graph source: http://blog.webfaction.com/a-little-holiday-present
  • 9. Major point JavaScript programming is already geared towards event based programming: • Events in browsers.... • Closures (anonymous functions) are natural part of the language document.addEventListener("click", function(event) { alert(event) }, false)
  • 10. Hello world using node.js var  sys  =  require('sys'),          http  =  require('http') http.createServer(function  (req,  res)  {   setTimeout(function  ()  {     res.sendHeader(200,  {'Content-­‐Type':  'text/plain'})     res.sendBody('Hello  World')     res.finish()   },  2000) }).listen(8000) sys.puts('Server  running  at  http://127.0.0.1:8000/') hello_world.js
  • 11. Blocking vs. non-blocking The way to do it The way to do in most other it in node.js! languages: puts("Enter your name: ") gets(function (name) { puts("Name: " + name) puts("Enter your name: ") }) var name = gets() puts("Name: " + name) node.js design philosophy: To receive data from disk, network or another process there must be a callback.
  • 12. Events in node.js • All objects which emit events are are instances of process.EventEmitter • A promise is a EventEmitter which emits either success or error, but not both var tcp = require("tcp") var stat = require("posix").stat, puts = require("sys").puts var s = tcp.createServer() var promise = stat("/etc/passwd") s.addListener("connection", promise.addCallback(function (s) { function (c) { puts("modified: " + s.mtime) c.send("hello nasty!") }) c.close() promise.addErrback(function(orgi_promise) { }) puts("Could not fetch stats on /etc/passwd") s.listen(8000) })
  • 13. Comet vs. Ajax Ajax is so yesterday... Comet is the new superhero on the block Comet can be used to create real time web-applications Examples include Plurk and Google Wave. Demo of Plurk real time messaging
  • 14. Ajax vs. Comet Ajax Comet (long poll) Comet (streaming) Browser Server Browser Server Browser Server request request request response x seconds event response response request event event request response response event How most do it today How some do it today How we will do it soon
  • 15. Major point • Comet servers need to have a lot of open connections • One thread pr. connection does not scale • The solution is to use event based servers • It’s only possible to create event based servers in node.js!
  • 16. Implementing comet • Long polling parts. Used in Plurk - works for most - is more expensive and problematic than streaming • Streaming withoutto proxies and firewalls - Very problematic due WebSockets: • Streaming with WebSockets (HTML5):side - Makes comet trivial on both client and server • In this presentation we will focus on the future: Building a chat application with WebSockets and node.js
  • 17. WebSockets • Aims to expose TCP/IP sockets to browsers, while respecting the constraints of the web (security, proxies and firewalls) • A thin layer on top of TCP/IP that adds: • origin based security model • Addressing and protocol naming mechanism for supporting multiple services on one port and multiple host names on one IP address • framing mechanism for data transporation • More information: http://dev.w3.org/html5/websockets/ • Currently implemented in Google Chrome
  • 18. node.websocket.js implementation demo var  sys  =  require('sys') Room = {    members  =  [] init: function() { Room.ws = new WebSocket('ws://127.0.0.1:8080/chat') var  Module  =  this.Module  =  function()  {  } Room.ws.onopen = Room._onopen Room.ws.onmessage = Room._onmessage Module.prototype.onData  =  function(data,  connection)  { Room.ws.onclose = Room._onclose   for(var  i  in  members) }, //...     members[i].send(data) _send: function(user, message){ }; Room.ws.send(serializeJSON({ 'from': user, Module.prototype.onConnect  =  function(connection)  { 'message': message   members.push(connection) })) } }, _onmessage: function(m) { Module.prototype.onDisconnect  =  function(connection)  { if (m.data) {   for(var  i  in  members)  { var data = evalTxt(m.data)     if(members[i]  ==  connection)  {       members.splice(i,  1) from = data.from       break; message = data.message     } //...   } } Note: I have patched node.websocket.js to include onConnect...
  • 19. Other comet servers • JBoss Netty: Java library for doing non- blocking networking, based on java.nio used by Plurk to handle 200.000+ open connections • erlycomet: Erlang comet server based on MochiWeb • Tornado: FriendFeed’s Python non- blocking server • I have tried most of the popular approaches and none of them feel as natural as node.js!
  • 20. How does node.js perfrom? • Hello World benchmark node.js vs. Tornado non scientific - take it with a grain of salt! • Tornado is one of the fastest Python based servers $ ab -c 100 -n 1000 http://127.0.0.1:8000/ $ ab -c 100 -n 1000 http://127.0.0.1:8000/ Concurrency Level: 100 Concurrency Level: 100 Time taken for tests: 0.230 seconds Time taken for tests: 0.427 seconds Complete requests: 1000 Complete requests: 1000 Failed requests: 0 Failed requests: 0 Write errors: 0 Write errors: 0 Total transferred: 75075 bytes Total transferred: 171864 bytes HTML transferred: 11011 bytes HTML transferred: 12276 bytes Requests per second: 4340.26 [#/sec] (mean) Requests per second: 2344.36 [#/sec] (mean) Time per request: 23.040 [ms] (mean) Time per request: 42.656 [ms] (mean) Time per request: 0.230 [ms] Time per request: 0.427 [ms] Transfer rate: 318.21 [Kbytes/sec] Transfer rate: 393.47 [Kbytes/sec] node.js Tornado
  • 21. CoffeScript • A Ruby inspired language that compiles to JavaScript CoffeScript JavaScript square: x => x * x. var cube, square; cube: x => square(x) * x. square = function(x) { return x * x } cube = function(x) { return square(x) * x } sys = require('sys') var sys = require('sys'), http = require('http') http = require('http') http.createServer( req, res => http.createServer(function (req, res) { setTimeout( => setTimeout(function () { res.sendHeader(200, {'Content-Type': 'text/plain'}) res.sendHeader(200, {'Content-Type': 'text/plain'}) res.sendBody('Hello World') res.sendBody('Hello World') res.finish()., 2000). res.finish() ).listen(8000) }, 2000) }).listen(8000) JavaScript: The platform of the future?
  • 22. References • Official page of node.js: http://nodejs.org/ • Official page of V8: http://code.google.com/p/v8/ • CoffeScript: http://jashkenas.github.com/coffee-script/ • Websockets spec: http://dev.w3.org/html5/websockets/ • node.websocket.js: http://github.com/guille/node.websocket.js/ • Tornado: http://www.tornadoweb.org/ • JBoss Netty: http://jboss.org/netty • erlycomet: http://code.google.com/p/erlycomet/
  • 23. PS: Plurk API • Plurk API is now available: http://www.plurk.com/API • Python, Ruby, PHP and Java implementations are under development • Use it to build cool applications :-)
  • 24. Questions? • These slides will be posted to: www.amix.dk (my blog) • You can private plurk me on Plurk: http://www.plurk.com/amix