SlideShare une entreprise Scribd logo
1  sur  17
Télécharger pour lire hors ligne
AdaptiveBlue @
   AWS NYC Meetup
           June 4, 2009



Mark Tabry, Software Engineer
    http://getglue.com
Agenda


   About AdaptiveBlue
   Glue: The Network of People and Things
   Glue: Building on Amazon Web Services
   Glue: Semantic Technology Stack
About AdaptiveBlue

 Founded in 2006, based in New York

 Focuses on enhancing browsing experience

 Launched BlueOrganizer and Glue add-ons for
  Firefox and SmartLinks Widgets for blogs
Get Glue. The Network That
      Sticks With You.
    http://getglue.com
What is Glue?

Glue is a contextual network that uses
semantic technology to automatically
connect people around everyday things -
books, music, movies, stars, artists,
stocks, wine, restaurants and more.
1. Contextual: Glue is distributed and appears
  when it makes sense on popular sites.

2. Automatic: Users participate in Glue just by
  browsing their favorite sites.

3. Simple: Glue removes the friction involved
  in networking - the network comes to you.
Glue Demo
Glue:
Building on Amazon
    Web Services
AWS-based Architecture
                                                                                    Client Layer

Browser Add-Ons         Widgets         iPhones          Facebook Apps             API Clients

                                                                                   Load Balancer Layer
                                    Round Robin DNS


            Load Balancer 1                                    Load Balancer 2

                                                                                    Web Service Layer


             Host 1 (EC2)                                                Host N (EC2)


           Glue Web Service                                            Glue Web Service

                                                  ...
             Batch Services                                              Batch Services



                                                                                     Database Layer


             Amazon S3                                     Rackspace MySQL
                                  Amazon SimpleDB
           Object Database/                                  User accounts
                                  Interactions between
            People Profiles                                    Analytics
                                   People and Things
AdaptiveBlue AWS Stack


    Relating People and Things ( SimpleDB )

Records of people’s interactions around things are stored
 in SimpleDB Domains using duplication for fast access.


          Storing Object Meta Data ( S3 )

    XML representation of millions of books, music,
       movies, etc. is stored using Amazon S3


    Transactional and Batch Support ( EC2 )

        Web Service Requests and batches are
          distributed through EC2 instances.
Amazon SimpleDB in a Nutshell

        Simple DB Domain
                                      Idea:
             Record 1
   Key1      Attributes: A1,A2…       Create flat database with
                                      auto-indexed tables.
               …
             Record N                 Main Features:
   Key2      Attributes: A1,A2…
                                         Each attribute is indexed.
                                         Record structure is flexible.
                      Get record         Basic operators in queries
Put record            Query records      Supports sorting.


             Client
How Glue uses SimpleDB

                           Interaction Record
                     Key1        Attributes: A1,A2…




          Object Domains                          People Domains

    OD1    OD2   …         ODN              PD1    PD2   …         PDN




    Each record is duplicated into Object and Person Domain
    The Key is a combination of USER_ID and OBJECT_KEY
    Djb2hash is used to calculate the domain for each record

Records for each USER and each OBJECT inside the same domain.
Amazon S3 in a Nutshell


             Amazon S3                  Idea:

  Bucket 1               Bucket N       Put/Get objects into buckets
                …                       based on unique keys.




Put object             Get object   Main Features:

                                         Public/Private access.
                                         Support for large objects.
              Client
How Glue Uses S3


            Object Bucket                       People Bucket




    XML-files with object information   XML-files with user and friends info




     XML is serialized as string and written to S3
     Each file has a unique key: OBJECT_ID or USER_ID/profile, etc.
Amazon EC2 in the Nutshell


                Usage:

                    Create Machine Image
                    Deploy the image to S3
                    Start 1 or more instances
                    Use it as regular machine(s)



                 Main Options:
  Machine           Dynamic/Static IPS
   Image            Choose cores
(OS + Apps)         Choose locations
                    Persistence via EBS
How Glue uses EC2
                                Round Robin DNS


           Load Balancer 1                        Load Balancer 2




       Host 1 (EC2/Rackspace)                       Host N (EC2/Rackspace)


          Glue Web Service                             Glue Web Service

                                         ...
           Batch Services                                Batch Services




   Web Service processes transactional requests
   Batch Services are time-based & run on sets of USERS and OBJECTS

The system scales by equally partitioning Data and Requests
http://getglue.com
http://twitter/marktabry
Mark.Tabry@gmail.com

Contenu connexe

Tendances

SWUG - June 2010 - AD LDS by Andrew Cheng
SWUG - June 2010 - AD LDS by Andrew ChengSWUG - June 2010 - AD LDS by Andrew Cheng
SWUG - June 2010 - AD LDS by Andrew Cheng
Dennis Chung
 
Arnia-Cubrid - Programatica2010
Arnia-Cubrid - Programatica2010Arnia-Cubrid - Programatica2010
Arnia-Cubrid - Programatica2010
Agora Group
 
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
Amazon Web Services Korea
 

Tendances (17)

Angular JS and Magento
Angular JS and MagentoAngular JS and Magento
Angular JS and Magento
 
Windows Azure: Lessons From the Field
Windows Azure: Lessons From the FieldWindows Azure: Lessons From the Field
Windows Azure: Lessons From the Field
 
Building Silverlight Applications Using .NET (Part 2 of 2)
Building Silverlight Applications Using .NET (Part 2 of 2)Building Silverlight Applications Using .NET (Part 2 of 2)
Building Silverlight Applications Using .NET (Part 2 of 2)
 
Move to azure
Move to azureMove to azure
Move to azure
 
SWUG - June 2010 - AD LDS by Andrew Cheng
SWUG - June 2010 - AD LDS by Andrew ChengSWUG - June 2010 - AD LDS by Andrew Cheng
SWUG - June 2010 - AD LDS by Andrew Cheng
 
Games + Amazon = Love - Presentation quo vadis 2011
Games + Amazon = Love - Presentation quo vadis 2011Games + Amazon = Love - Presentation quo vadis 2011
Games + Amazon = Love - Presentation quo vadis 2011
 
Windows Azure for Developers - Building Block Services
Windows Azure for Developers - Building Block ServicesWindows Azure for Developers - Building Block Services
Windows Azure for Developers - Building Block Services
 
Offline Html5 3days
Offline Html5 3daysOffline Html5 3days
Offline Html5 3days
 
Arnia-Cubrid - Programatica2010
Arnia-Cubrid - Programatica2010Arnia-Cubrid - Programatica2010
Arnia-Cubrid - Programatica2010
 
Node.CQ - Creating Real-time Data Mashups with Node.JS and Adobe CQ
Node.CQ - Creating Real-time Data Mashups with Node.JS and Adobe CQNode.CQ - Creating Real-time Data Mashups with Node.JS and Adobe CQ
Node.CQ - Creating Real-time Data Mashups with Node.JS and Adobe CQ
 
C fowler intro-azure
C fowler intro-azureC fowler intro-azure
C fowler intro-azure
 
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
 
What's New for the Windows Azure Developer? Lots!!
What's New for the Windows Azure Developer?  Lots!!What's New for the Windows Azure Developer?  Lots!!
What's New for the Windows Azure Developer? Lots!!
 
Day Of Cloud - Windows Azure Platform
Day Of Cloud - Windows Azure PlatformDay Of Cloud - Windows Azure Platform
Day Of Cloud - Windows Azure Platform
 
Getting Started with Docker on AWS
Getting Started with Docker on AWSGetting Started with Docker on AWS
Getting Started with Docker on AWS
 
[React Native] Lecture 4: Basic Elements and UI Layout by using FlexBox
[React Native] Lecture 4: Basic Elements and UI Layout by using FlexBox[React Native] Lecture 4: Basic Elements and UI Layout by using FlexBox
[React Native] Lecture 4: Basic Elements and UI Layout by using FlexBox
 
Amazon Lumberyard: end-to-end solutions for game developers
Amazon Lumberyard: end-to-end solutions for game developersAmazon Lumberyard: end-to-end solutions for game developers
Amazon Lumberyard: end-to-end solutions for game developers
 

Similaire à NYC Amazon Web Services Meetup: How Glue uses AWS

Jeff Barr Amazon Services Cloud Computing
Jeff Barr Amazon Services Cloud ComputingJeff Barr Amazon Services Cloud Computing
Jeff Barr Amazon Services Cloud Computing
deimos
 
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
IndicThreads
 

Similaire à NYC Amazon Web Services Meetup: How Glue uses AWS (20)

AWS Customer Presentation - AdaptiveBlue
AWS Customer Presentation - AdaptiveBlueAWS Customer Presentation - AdaptiveBlue
AWS Customer Presentation - AdaptiveBlue
 
Taking Web Application Deployment from Infancy to Maturity in AWS
Taking Web Application Deployment from Infancy to Maturity in AWSTaking Web Application Deployment from Infancy to Maturity in AWS
Taking Web Application Deployment from Infancy to Maturity in AWS
 
Building Scalable Windows and .NET Apps on AWS (TLS302) | AWS re:Invent 2013
Building Scalable Windows and .NET Apps on AWS (TLS302) | AWS re:Invent 2013Building Scalable Windows and .NET Apps on AWS (TLS302) | AWS re:Invent 2013
Building Scalable Windows and .NET Apps on AWS (TLS302) | AWS re:Invent 2013
 
Log Analysis At Scale
Log Analysis At ScaleLog Analysis At Scale
Log Analysis At Scale
 
Architecting Cloud Apps
Architecting Cloud AppsArchitecting Cloud Apps
Architecting Cloud Apps
 
202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...
202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...
202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...
 
AWS Innovate: Build a Data Lake on AWS- Johnathon Meichtry
AWS Innovate: Build a Data Lake on AWS- Johnathon MeichtryAWS Innovate: Build a Data Lake on AWS- Johnathon Meichtry
AWS Innovate: Build a Data Lake on AWS- Johnathon Meichtry
 
Cloud Architectures - Jinesh Varia - GrepTheWeb
Cloud Architectures - Jinesh Varia - GrepTheWebCloud Architectures - Jinesh Varia - GrepTheWeb
Cloud Architectures - Jinesh Varia - GrepTheWeb
 
Infopark AG - AWS Customer Presentation
Infopark AG - AWS Customer PresentationInfopark AG - AWS Customer Presentation
Infopark AG - AWS Customer Presentation
 
Scaling Up to Your First 10 Million Users
Scaling Up to Your First 10 Million UsersScaling Up to Your First 10 Million Users
Scaling Up to Your First 10 Million Users
 
Jeff Barr Amazon Services Cloud Computing
Jeff Barr Amazon Services Cloud ComputingJeff Barr Amazon Services Cloud Computing
Jeff Barr Amazon Services Cloud Computing
 
AWS User Group December 2016
AWS User Group December 2016AWS User Group December 2016
AWS User Group December 2016
 
Data In Cloud
Data In CloudData In Cloud
Data In Cloud
 
Introducing SQL Server Data Services
Introducing SQL Server Data ServicesIntroducing SQL Server Data Services
Introducing SQL Server Data Services
 
Introducing SQL Server Data Services
Introducing SQL Server Data ServicesIntroducing SQL Server Data Services
Introducing SQL Server Data Services
 
Big data and serverless - AWS UG The Netherlands
Big data and serverless - AWS UG The NetherlandsBig data and serverless - AWS UG The Netherlands
Big data and serverless - AWS UG The Netherlands
 
Born in the Cloud; Build it Like a Startup
Born in the Cloud; Build it Like a StartupBorn in the Cloud; Build it Like a Startup
Born in the Cloud; Build it Like a Startup
 
CloudFork
CloudForkCloudFork
CloudFork
 
NHGRI Cloud Computing talk
NHGRI Cloud Computing talkNHGRI Cloud Computing talk
NHGRI Cloud Computing talk
 
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
 

Plus de Alex Iskold (9)

Skopenow
Skopenow Skopenow
Skopenow
 
Leblum
LeblumLeblum
Leblum
 
Techstars NYC Fall 2015 Program Overview
Techstars NYC Fall 2015 Program OverviewTechstars NYC Fall 2015 Program Overview
Techstars NYC Fall 2015 Program Overview
 
Seed funding gotchas
Seed funding gotchasSeed funding gotchas
Seed funding gotchas
 
GetGlue Pepsi/X Factor Campaign
GetGlue Pepsi/X Factor CampaignGetGlue Pepsi/X Factor Campaign
GetGlue Pepsi/X Factor Campaign
 
GetGlue QR Codes Announcement at Ad:Tech
GetGlue QR Codes Announcement at Ad:TechGetGlue QR Codes Announcement at Ad:Tech
GetGlue QR Codes Announcement at Ad:Tech
 
Danger Of Free
Danger Of FreeDanger Of Free
Danger Of Free
 
Adaptive Blue Sem Tech Meetup Nyc
Adaptive Blue Sem Tech Meetup NycAdaptive Blue Sem Tech Meetup Nyc
Adaptive Blue Sem Tech Meetup Nyc
 
How to run your startup on Amazon Web Services, by Alex Iskold
How to run your startup on Amazon Web Services, by Alex IskoldHow to run your startup on Amazon Web Services, by Alex Iskold
How to run your startup on Amazon Web Services, by Alex Iskold
 

Dernier

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Dernier (20)

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 

NYC Amazon Web Services Meetup: How Glue uses AWS

  • 1. AdaptiveBlue @ AWS NYC Meetup June 4, 2009 Mark Tabry, Software Engineer http://getglue.com
  • 2. Agenda  About AdaptiveBlue  Glue: The Network of People and Things  Glue: Building on Amazon Web Services  Glue: Semantic Technology Stack
  • 3. About AdaptiveBlue  Founded in 2006, based in New York  Focuses on enhancing browsing experience  Launched BlueOrganizer and Glue add-ons for Firefox and SmartLinks Widgets for blogs
  • 4. Get Glue. The Network That Sticks With You. http://getglue.com
  • 5. What is Glue? Glue is a contextual network that uses semantic technology to automatically connect people around everyday things - books, music, movies, stars, artists, stocks, wine, restaurants and more.
  • 6. 1. Contextual: Glue is distributed and appears when it makes sense on popular sites. 2. Automatic: Users participate in Glue just by browsing their favorite sites. 3. Simple: Glue removes the friction involved in networking - the network comes to you.
  • 9. AWS-based Architecture Client Layer Browser Add-Ons Widgets iPhones Facebook Apps API Clients Load Balancer Layer Round Robin DNS Load Balancer 1 Load Balancer 2 Web Service Layer Host 1 (EC2) Host N (EC2) Glue Web Service Glue Web Service ... Batch Services Batch Services Database Layer Amazon S3 Rackspace MySQL Amazon SimpleDB Object Database/ User accounts Interactions between People Profiles Analytics People and Things
  • 10. AdaptiveBlue AWS Stack Relating People and Things ( SimpleDB ) Records of people’s interactions around things are stored in SimpleDB Domains using duplication for fast access. Storing Object Meta Data ( S3 ) XML representation of millions of books, music, movies, etc. is stored using Amazon S3 Transactional and Batch Support ( EC2 ) Web Service Requests and batches are distributed through EC2 instances.
  • 11. Amazon SimpleDB in a Nutshell Simple DB Domain Idea: Record 1 Key1 Attributes: A1,A2… Create flat database with auto-indexed tables. … Record N Main Features: Key2 Attributes: A1,A2…  Each attribute is indexed.  Record structure is flexible. Get record  Basic operators in queries Put record Query records  Supports sorting. Client
  • 12. How Glue uses SimpleDB Interaction Record Key1 Attributes: A1,A2… Object Domains People Domains OD1 OD2 … ODN PD1 PD2 … PDN  Each record is duplicated into Object and Person Domain  The Key is a combination of USER_ID and OBJECT_KEY  Djb2hash is used to calculate the domain for each record Records for each USER and each OBJECT inside the same domain.
  • 13. Amazon S3 in a Nutshell Amazon S3 Idea: Bucket 1 Bucket N Put/Get objects into buckets … based on unique keys. Put object Get object Main Features:  Public/Private access.  Support for large objects. Client
  • 14. How Glue Uses S3 Object Bucket People Bucket XML-files with object information XML-files with user and friends info  XML is serialized as string and written to S3  Each file has a unique key: OBJECT_ID or USER_ID/profile, etc.
  • 15. Amazon EC2 in the Nutshell Usage:  Create Machine Image  Deploy the image to S3  Start 1 or more instances  Use it as regular machine(s) Main Options: Machine  Dynamic/Static IPS Image  Choose cores (OS + Apps)  Choose locations  Persistence via EBS
  • 16. How Glue uses EC2 Round Robin DNS Load Balancer 1 Load Balancer 2 Host 1 (EC2/Rackspace) Host N (EC2/Rackspace) Glue Web Service Glue Web Service ... Batch Services Batch Services  Web Service processes transactional requests  Batch Services are time-based & run on sets of USERS and OBJECTS The system scales by equally partitioning Data and Requests