SlideShare une entreprise Scribd logo
1  sur  31
Télécharger pour lire hors ligne
NY:DISRUPT API HACKATHON
Drag and Drop Data Science




Contact Us!                                             http://api.metalayer.com
developers@metalayer.com                                @metaLayer
BIG DATA
    IS
   BIG
PUNY
HUMANS ARE
   PUNY
http://TEDglobe.com
by Kate Starbird, Bill Morris, Chris Danforth and GeoSprocket
Data Sets + APIs + Visualizations




      Made
     Simple.
Data Sets + APIs + Visualizations




      Made
     Simple.
SCHWAG ALERT


   We’ve got hoodies (as many as you can take)

Prize! Apple TV for best in show using our Image API

  Prize! Kindle for best in show using our Text API

                   We’re hiring!
Using the MetaLayer
      Text API
Our Text API offers methods for extracting contextual features
from text documents using various forms of entity extraction.

  •Find place names in documents and turn them into lat/lon
   coordinates for mapping
  •Perform auto-tagging and classification using uncommon
   keywords
  •Utilize our sentiment analysis algorithms
ARCHITECTURE
Built using pyNLTK (python natural language toolkit)

Brown Corpus (Brown University Standard Corpus of Present-Day
American English)

Extended to deal with short form text like Tweets

Corpus can be extended to optimize the API for specific use cases.

60,000 items per minute on a single server

Scales horizontally for ‘bigger data’ streams
FUNCTIONS


Sentiment Analysis

Tagging (Uncommon Keywords)

Location Disambiguation

Bundle (a Buffet of Awesome)
FORMAT
Post: “This is some excellent text that needs to be tagged especially if
we can pick the location Philadelphia, PA out of it.”


Response Example: { "status": "success", "method": "bundle", "service":
"datalayer", "response": { "datalayer": { "text": "this is some excellent text
that needs to be tagged especially if we can pick the location
Philadelphia PA out of it", "locations": [ { "latitude":
39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US",
"longitude": -75.162400000000005 } ], "sentiment":
0.63960214906683133, "tags": [ "excellent", "text", "location",
"Philadelphia", "PA" ] } } }
FORMAT
Post: “This is some excellent text that needs to be tagged especially if
we can pick the location Philadelphia, PA out of it.”


Response Example: { "status": "success", "method": "bundle", "service":
"datalayer", "response": { "datalayer": { "text": "this is some excellent text
that needs to be tagged especially if we can pick the location
Philadelphia PA out of it", "locations": [ { "latitude":
39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US",
"longitude": -75.162400000000005 } ], "sentiment":
0.63960214906683133, "tags": [ "excellent", "text", "location",
"Philadelphia", "PA" ] } } }
Using the MetaLayer
     Image API
Our Image API offers methods for extracting contextual features
from photos and image documents.

  •Find all the objects in a photo along with their relative
   coordinates in the frame
  •Extract color/histogram profiles
  •Parse text from the image to make it actionable
ARCHITECTURE

Built using Teeseract OCR with a proprietary training set.

Extensible and Adaptive

20,000 items per minute on a single server

Scales horizontally

Parses JPG and PNG documents
FUNCTIONS
Color Profile (all colors in an image)

Histogram (the distribution of color in an image)

Optical Character Recognition (OCR)

Object Recognition

Bundle (Awesome Reloaded!)
MetaLayer Dashboard API
  *Coming soon young, Padawan.*
Our Dashboard API offers methods for interacting with
MetaLayer Dashboard products through scripting.

  •Remotely create and configure dashboard environments
  •Push data to RESTful Dashboard hook (ex. real-time streams)
  •Poll/Request data from Dashboard hook (ex. historic data)
  •Analytics from Dashboard activity streams
  •Create data mashups, consume the JSON output
ARCHITECTURE


Dashboard is build with Python and Django

Adds GUI elements to working with APIs

Drag and drop data science. Anyone can use it to mash up data.

Background tasks distributed across horizontal servers.
FUNCTIONS

Control Administration & User Roles

Modify GUI Features

Data Acquisition

Data Consumption

Analytics
API.METALAYER.COM
Drag and Drop Insights




Contact Us!                                         http://api.metalayer.com
developers@metalayer.com                            @metaLayer
MetaLayer Presentation at TechCrunch Disrupt NY 2012

Contenu connexe

Plus de Jon Gosier

Plus de Jon Gosier (20)

IOT4I Internet of Things for Impact | Netherlands
IOT4I Internet of Things for Impact | NetherlandsIOT4I Internet of Things for Impact | Netherlands
IOT4I Internet of Things for Impact | Netherlands
 
Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015
Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015
Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015
 
Africa's Third Act: Why the Continent Matters Now More than Ever
Africa's Third Act: Why the Continent Matters Now More than EverAfrica's Third Act: Why the Continent Matters Now More than Ever
Africa's Third Act: Why the Continent Matters Now More than Ever
 
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Pa...
Predicting Macroeconomic Trends  Through Real-Time Mobile Data Collection [Pa...Predicting Macroeconomic Trends  Through Real-Time Mobile Data Collection [Pa...
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Pa...
 
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...
 
21st Century Strategies for Financial Inclusion
21st Century Strategies for Financial Inclusion21st Century Strategies for Financial Inclusion
21st Century Strategies for Financial Inclusion
 
About Ebola Deeply - Slides from Foreign Press Center
About Ebola Deeply - Slides from Foreign Press CenterAbout Ebola Deeply - Slides from Foreign Press Center
About Ebola Deeply - Slides from Foreign Press Center
 
Philly Tech Week 2014 - The Future of Digital Marketing - Data-Mining
Philly Tech Week 2014 - The Future of Digital Marketing - Data-MiningPhilly Tech Week 2014 - The Future of Digital Marketing - Data-Mining
Philly Tech Week 2014 - The Future of Digital Marketing - Data-Mining
 
Using Predictive Analytics for Anticipatory Investigation and Intervention
Using Predictive Analytics for Anticipatory Investigation and InterventionUsing Predictive Analytics for Anticipatory Investigation and Intervention
Using Predictive Analytics for Anticipatory Investigation and Intervention
 
Data Mining Online Audiences with D8A Group
Data Mining Online Audiences with D8A GroupData Mining Online Audiences with D8A Group
Data Mining Online Audiences with D8A Group
 
Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...
Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...
Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...
 
The Humanitarian Face of Big Data | ICCM 2013
The Humanitarian Face of Big Data | ICCM 2013The Humanitarian Face of Big Data | ICCM 2013
The Humanitarian Face of Big Data | ICCM 2013
 
Structuring Your Social Enterprise #FTW
Structuring Your Social Enterprise #FTWStructuring Your Social Enterprise #FTW
Structuring Your Social Enterprise #FTW
 
Platform to Playform: The Gamification of Civic Action
Platform to Playform: The Gamification of Civic ActionPlatform to Playform: The Gamification of Civic Action
Platform to Playform: The Gamification of Civic Action
 
SiftDeck: Predictive Analytics for Disaster and Risk
SiftDeck: Predictive Analytics for Disaster and RiskSiftDeck: Predictive Analytics for Disaster and Risk
SiftDeck: Predictive Analytics for Disaster and Risk
 
Abayima Crisis Communications igKnight Talk
Abayima Crisis Communications igKnight TalkAbayima Crisis Communications igKnight Talk
Abayima Crisis Communications igKnight Talk
 
The New Business of Africa
The New Business of AfricaThe New Business of Africa
The New Business of Africa
 
Keynote from 7th Annual Carole I Smith Technology Symposium
Keynote from 7th Annual Carole I Smith Technology SymposiumKeynote from 7th Annual Carole I Smith Technology Symposium
Keynote from 7th Annual Carole I Smith Technology Symposium
 
Africa's Fifth Estate
Africa's Fifth EstateAfrica's Fifth Estate
Africa's Fifth Estate
 
Apps4Africa Accelerator 2013
Apps4Africa Accelerator 2013Apps4Africa Accelerator 2013
Apps4Africa Accelerator 2013
 

Dernier

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Dernier (20)

Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 

MetaLayer Presentation at TechCrunch Disrupt NY 2012

  • 2. Drag and Drop Data Science Contact Us! http://api.metalayer.com developers@metalayer.com @metaLayer
  • 3. BIG DATA IS BIG
  • 5.
  • 6.
  • 8. by Kate Starbird, Bill Morris, Chris Danforth and GeoSprocket
  • 9.
  • 10. Data Sets + APIs + Visualizations Made Simple.
  • 11. Data Sets + APIs + Visualizations Made Simple.
  • 12. SCHWAG ALERT We’ve got hoodies (as many as you can take) Prize! Apple TV for best in show using our Image API Prize! Kindle for best in show using our Text API We’re hiring!
  • 13.
  • 14.
  • 16. Our Text API offers methods for extracting contextual features from text documents using various forms of entity extraction. •Find place names in documents and turn them into lat/lon coordinates for mapping •Perform auto-tagging and classification using uncommon keywords •Utilize our sentiment analysis algorithms
  • 17. ARCHITECTURE Built using pyNLTK (python natural language toolkit) Brown Corpus (Brown University Standard Corpus of Present-Day American English) Extended to deal with short form text like Tweets Corpus can be extended to optimize the API for specific use cases. 60,000 items per minute on a single server Scales horizontally for ‘bigger data’ streams
  • 18. FUNCTIONS Sentiment Analysis Tagging (Uncommon Keywords) Location Disambiguation Bundle (a Buffet of Awesome)
  • 19. FORMAT Post: “This is some excellent text that needs to be tagged especially if we can pick the location Philadelphia, PA out of it.” Response Example: { "status": "success", "method": "bundle", "service": "datalayer", "response": { "datalayer": { "text": "this is some excellent text that needs to be tagged especially if we can pick the location Philadelphia PA out of it", "locations": [ { "latitude": 39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US", "longitude": -75.162400000000005 } ], "sentiment": 0.63960214906683133, "tags": [ "excellent", "text", "location", "Philadelphia", "PA" ] } } }
  • 20. FORMAT Post: “This is some excellent text that needs to be tagged especially if we can pick the location Philadelphia, PA out of it.” Response Example: { "status": "success", "method": "bundle", "service": "datalayer", "response": { "datalayer": { "text": "this is some excellent text that needs to be tagged especially if we can pick the location Philadelphia PA out of it", "locations": [ { "latitude": 39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US", "longitude": -75.162400000000005 } ], "sentiment": 0.63960214906683133, "tags": [ "excellent", "text", "location", "Philadelphia", "PA" ] } } }
  • 21. Using the MetaLayer Image API
  • 22. Our Image API offers methods for extracting contextual features from photos and image documents. •Find all the objects in a photo along with their relative coordinates in the frame •Extract color/histogram profiles •Parse text from the image to make it actionable
  • 23. ARCHITECTURE Built using Teeseract OCR with a proprietary training set. Extensible and Adaptive 20,000 items per minute on a single server Scales horizontally Parses JPG and PNG documents
  • 24. FUNCTIONS Color Profile (all colors in an image) Histogram (the distribution of color in an image) Optical Character Recognition (OCR) Object Recognition Bundle (Awesome Reloaded!)
  • 25. MetaLayer Dashboard API *Coming soon young, Padawan.*
  • 26. Our Dashboard API offers methods for interacting with MetaLayer Dashboard products through scripting. •Remotely create and configure dashboard environments •Push data to RESTful Dashboard hook (ex. real-time streams) •Poll/Request data from Dashboard hook (ex. historic data) •Analytics from Dashboard activity streams •Create data mashups, consume the JSON output
  • 27. ARCHITECTURE Dashboard is build with Python and Django Adds GUI elements to working with APIs Drag and drop data science. Anyone can use it to mash up data. Background tasks distributed across horizontal servers.
  • 28. FUNCTIONS Control Administration & User Roles Modify GUI Features Data Acquisition Data Consumption Analytics
  • 30. Drag and Drop Insights Contact Us! http://api.metalayer.com developers@metalayer.com @metaLayer