7. Disrupt SF 2015
A.I. = Increasingly Embedded Everywhere
Monitoring your credit card
transactions for fraud…
Recommending products on
retail websites...
Understanding your voice on
your mobile phone…
Analyzing your tax returns…
Reading your handwriting on
personal checks…
Blocking spam in your inbox…
8. Disrupt SF 2015
Using A.I. Cloud APIs - No PhD Required
Speech Recognition Machine Translation
Computer Vision Natural Language
Processing
Question Answering Automated Dialog
Vast array of A.I. technologies, one HTTP call away. Even a Raspberry Pi can use it!
9. Disrupt SF 2015
Watson Developer Cloud
IBM is democratizing “Full Stack A.I.” via the Watson Developer Cloud
10. Disrupt SF 2015
Building an A.I.- enabled Hack
"Is this
poisonous?"
Example app: "Voice + visual
assistant for hikers in any
country"
Intended use case:
Answer verbal and visual
questions about plants
and animals encountered
on a hike
“Es esta
venenosa?"
11. Disrupt SF 2015
Cloud APIs provide speech recognition capability to
any network-enabled device, across many different
spoken languages.
What you can do: respond to spoken commands,
transcribe audio and video files, search audio
streams for specific key phrases ...
Moving beyond the keyboard: Speech Recognition
12. Disrupt SF 2015
Integrating Speech Recognition into your App
● APIs support analyzing audio files or streaming audio data in real-time
● Innovators include IBM Watson, Nuance, Google, and AT&T
● IBM Watson speech API info available at:
○ https://www.ibm.com/smarterplanet/us/en/ibmwatson/developerclou
d/speech-to-text.html
Speech recognition example:
curl -k -u “username:password” -X POST --limit-rate 40K
--header "Content-Type: audio/flac” --header "Transfer-Encoding: chunked"
--data-binary @audio.flac
“https://stream.watsonplatform.net/speech-to-
text/api/v1/recognize?continuous=true”
13. Disrupt SF 2015
{
"results": [
{
"alternatives": [
{
"confidence": 0.8691191673278809,
"transcript": “this is some transcribed speech"
}
Integrating Speech Recognition into your App
curl -k -u “username:password” -X POST --limit-rate 40K
--header "Content-Type: audio/flac” --header "Transfer-Encoding: chunked"
--data-binary @audio.flac
“https://stream.watsonplatform.net/speech-to-
text/api/v1/recognize?continuous=true”
14. Disrupt SF 2015
Giving machines sight: Computer Vision
Cloud APIs provide the ability to recognize objects
(buildings, cars, ...), logos, and faces contained
within photographs.
What you can do: drive search in your application
with camera-phone images, automatically organize
photo libraries, "visually" index video files, filter
inappropriate content ...
15. Disrupt SF 2015
Integrating Computer Vision into your App
● APIs tag photos with what they contain, recognize faces, read signs
/product labels, and more
● Innovators include IBM Watson, AlchemyAPI, Google, Baidu, and others
● IBM Watson + AlchemyAPI computer vision API info available at:
○ http://www.alchemyapi.com/products/alchemyvision
○ http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/vi
sual-recognition.html
Computer Vision 1-liner:
curl --data-binary @photo.jpg ”http://access.alchemyapi.com/image/
ImageGetRankedImageKeywords?imagePostMode=raw&apikey="$API_K
EY
17. Disrupt SF 2015
Cloud APIs provide automatic translation of text
across many different languages.
What you can do: automatically translate foreign-
language content for your users, real-time
translation of forum posts or chat sessions, search
within foreign language documents ...
Breaking language barriers: Machine Translation
18. Disrupt SF 2015
Integrating Machine Translation into your App
● APIs automatically translate between many different languages.
● Innovators include IBM Watson, Google, and Microsoft
● IBM Watson translation API info available here:
○ https://www.ibm.com/smarterplanet/us/en/ibmwatson/developerclou
d/language-translation/api/v2/
Language Translation example:
curl -u “username:password“ -H "content-type: plain/text“ -X POST -d "text=Hello world.“
"https://gateway.watsonplatform.net/language-
translation/api/v2/translate?source=en&target=es"
19. Disrupt SF 2015
Integrating Machine Translation into your App
"translations": [
{
"translatedText": ”Where is my hotel?"
}
]
“¿Dónde está mi
hotel?"
curl -u “username:password“ -H "content-type: plain/text“ -X POST -d "text=¿Dónde está mi hotel?"
"https://gateway.watsonplatform.net/language-translation/api/v2/translate?source=es&target=en"
20. Disrupt SF 2015
Cloud APIs provide the ability for computers to
derive "meaning" from text (documents, web pages,
tweets, …)
What you can do: tag documents by topic, drive
content recommendation engines, contextually
target advertisements ...
Reading like a Human: Natural Language Processing
21. Disrupt SF 2015
Integrating Natural Language Processing
into your App
● APIs automatically tag documents, extract facts and events, ...
● Innovators include IBM Watson, AlchemyAPI, Google, and others
● IBM Watson + AlchemyAPI language API info available here:
○ https://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/
services-catalog.html
○ http://www.alchemyapi.com/
Named entity tagging + sentiment analysis 1-liner:
curl "http://access.alchemyapi.com/calls/text/
TextGetRankedNamedEntities?apikey=$API_KEY&sentiment=1&text=Woohoo
+I+am+coming+to+San+Fran!"
22. Disrupt SF 2015
"language": "english",
"entities": [
{
"type": "City",
"relevance": "0.33",
"sentiment": {
"type": "positive",
"score": "0.325672"
},
"count": "1",
"text": ”San Fran",
"disambiguated": {
"name": ”San Francisco",
"website": "http://www.sfgov.org",
"dbpedia": "http://dbpedia.org/resource/San_Francisco",
"freebase": "http://rdf.freebase.com/ns/m.0d61p"
”Woohoo I am coming to San Fran! #TCDisrupt"
Integrating Natural Language Processing into your App
curl "http://access.alchemyapi.com/calls/text/
TextGetRankedNamedEntities?apikey=$API_KEY&sentiment=1&text=Woohoo
+I+am+coming+to+San+Fran!"
23. Disrupt SF 2015
Expert in a box: Question Answering
Cloud APIs provide the ability to answer natural
language questions, such as "Who invented the
Segway?"
What you can do: leverage questions like "was this
company acquired?" to trigger processes in data
pipelines or GUI displays, automatically answer
questions from your own corpus of data ...
24. Disrupt SF 2015
Integrating Question Answering into your App
● APIs automatically answer questions posed in plain language
● Innovators include IBM Watson, AlchemyAPI, Google, and others
● IBM Watson question answering API info available here:
○ https://www.ibmdw.net/watson/docs/
IBM Watson Example API Call JSON:
{
"question":{
"questionText":"His 1983 hit "Beat it" featured Eddie Van Halen on guitar."
}
}
25. Disrupt SF 2015
Integrating Question Answering into your App
"answers": [
{
"id": 0,
"text": "Michael Jackson",
"confidence": 0.42276
}
{
"question":{
"questionText":"His 1983 hit "Beat it" featured Eddie Van Halen on guitar."
}
}
26. Disrupt SF 2015
Putting it all together: Sample A.I. App Workflow
Use Watson Speech API to accept speech input
Use Watson Translation API to convert to English
“Es esta venenosa?"
"Is this poisonous?"
Take a picture of the item the question is about
Use AlchemyVision API to interpret the photograph
"fly agaric"
Use Watson Q&A API to answer the question
Is this poisonous + fly
agaric
Example app: "Voice + visual assistant for international hikers"
27. Disrupt SF 2015
Getting Started: Watson + Alchemy Resources
Sign up for Bluemix (Get API keys!)
https://console.ng.bluemix.net/registration/
GitHub (Sample code!)
Watson: https://github.com/watson-developer-cloud
AlchemyAPI: https://github.com/AlchemyAPI
App Gallery (Get inspired!)
http://devpost.com/software/built-with/ibm-watson
Ask for help! Just look for someone wearing a Watson shirt.
28. Disrupt SF 2015
Hackathons: Where great ideas are born!
• I’ve been sponsoring and judging hackathons for the past 5
years
• Seen multiple teams raise funding, build companies, have
successful exits
• We hold internal hackathons monthly and frequently see
innovations pushed into production
• If your startup isn’t doing internal hackathons yet – get going!
They’re *awesome*
Let’s go build something amazing. Change the world. Use A.I. to make it happen!
29. Disrupt SF 2015
Thanks for listening! Questions ?
Elliot Turner
Director of Alchemy, IBM Watson
CEO & Founder, AlchemyAPI
eturner@us.ibm.com