http://imatge-upc.github.io/telecombcn-2016-dlcv/ Deep learning technologies are at the core of the current revolution in artificial intelligence for multimedia data analysis. The convergence of big annotated data and affordable GPU hardware has allowed the training of neural networks for data analysis tasks which had been addressed until now with hand-crafted features. Architectures such as convolutional neural networks, recurrent neural networks and Q-nets for reinforcement learning have shaped a brand new scenario in signal processing. This course will cover the basic principles and applications of deep learning to computer vision problems, such as image classification, object detection or text captioning.

1. Day 5
Closing
[course site]

2. 2
Computer vision is large scale deployed...
...is because they have learned to see.
Learning only to see ?

3. Learning only to see ?
Nexi, del MIT Media Lab (Foto: Spencer Lowel)
3

4. Big data
Internet of things - IoT
Learning only to see ?
4

5. Personal data
Big data
Learning only to see ?
5

6. Atlas, de Boston Dynamics
Robust manipulation and motion
Learning only to see ?
6

7. Playing with other computers
Learning only to see ?
Mnih, Volodymyr, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller.
"Playing atari with deep reinforcement learning." arXiv preprint arXiv:1312.5602 (2013).
DeepMind
7

8. Playing with humans
AlphaGo (Google DeepMind)
Learning only to see ?
8

9. Autonomous Driving
Google Self-driving car
Learning only to see ?
9

10. Google Research, “Going deeper into neural networks” - DeepDream (2015)
Learning only to see ?
10
Visual arts

11. Google Research, “Going deeper into neural networks” - DeepDream (2015)
Visual arts
Only open their eyes ?
11

12. http://turing.deepart.io/
Visual arts
Learning only to see ?
12

13. Music composition
Manuel Araoz, “Training a Recurrent Neural Network to Compose Music” (2016).
Learning only to see ?
13

14. Poetry
Ross Goodwin, Neuralsnap (2016).
Learning only to see ?
14

15. “Scripts” (!?)
Darknet
JON
He leaned close and onions, barefoot from his shoulder. "I am not a purple girl," he said as he stood
over him. "The sight of you sell your father with you a little choice."
"I say to swear up his sea or a boy of stone and heart, down," Lord Tywin said. "I love your word
or her to me."
Learning only to see ?
15

16. “Scripts” (!?)
Learning only to see ?
16
Ars Technica, “Movie written by algorithm turns out to be hilarious and intense” (2016)

17. Public Health
Announcement of Google DeepMind Health (24/02/2016)
Learning only to see ?
17

18. Nacho Hernandez, “Why artificial intelligence will democratize healthcare”
(TEDx Talk, 2014)
Public health
Learning only to see ?
18

19. Nancy Lublin, “The heartbreaking text that inspired a crisis helpline” (TED Talk
2015)
Mental health
Learning only to see ?
19

20. Psychological support and counseling ?
Learning only to see ?
20

21. 21
Affective computing
Rana el Kalioubi, “This app know how you feel, from the look on your face”,
TEDTalks 2015.
Learning only to see ?

22. 22
Nexi Project,
from MIT Media Lab
(Photos: Spencer Lowel)
[video]
Affective computing
Learning only to see ?

23. “Google’s chairman (Eric Schmidth) thinks artificial intelligence will let
scientists solve some of the world’s "hard problems," like population
growth, climate change, human development, and education.”
(Bloomberg Business, 11/01/2016)
[+info @ MIT Technology Review]
Artificial intelligence
23

24. Google’s CEO Sundar Pichai: “Era Of Computers Will End Very Soon, AI Will
Rule” (Fossbytes, 03/05/2016)
Artificial intelligence
24

25. Jeremy Howard, “The wonderful and terrifying implications of computers
that can learn”, TEDTalks 2014.
Artificial intelligence
25

26. Artificial intelligence
Stephen Hawking, “Artificial intelligence could spell out the human race.”
(2014)
26

27. Artificial intelligence
27

28. Elon Musk (Tesla), one of OpenAI promoters
Artificial intelligence
28
Andrej Karpathy

29. Neil Lawrence, OpenAI won’t benefit humanity without
open data sharing (The Guardian, 14/12/2015)
Phd Comics:
Who owns your
data ?
(Hint: it is not you)
Artificial intelligence
29

30. 30
Artificial intelligence

31. 31
Xavier Sala-i-Martin (Columbia University),
“Les conclusions del Fòrum de Davos”
(TV3, 03/02/2016) - in Catalan
Carles Boix (Princeton University),
“La quarta revolució industrial”
(Diari Ara, 08/02/2016) - in Catalan
Artificial intelligence

32. 32
Artificial intelligence
The White House: “How to prepare the future for the Future
Intelligence”

33. Artificial intelligence
Open question: in which jobs will robots replace humans first ?
33

34. Learn more
From 24 to 31 January 2017 (10:00-14:00)
34
Deep Learning for Speech and Language
?
https://telecombcn-dl.github.io/2017-dlsl/

35. Learn more
June/July 2017
● Course content will be updated
with the latest advances.
● Current BSc students enrolled
in MSc program can do the
project.
● Second edition will be bettter
(and worse than the third one).
35

36. Learn more (for BSc students)
36
http://pagines.uab.cat/mcv/
Master MET

37. 37
Learn more
● Reading Group with public listing of videos, slides and papers.
● E-mail to xavier.giro@upc.edu if you want to join in Fall 2016.

38. Learn more
[Website]
Consider extending your project to a workshop paper (not announced yet)
and apply for some volunteer opportunities for free registration.
Also: specific
workshop and
social event for
Women in
Machine Learning
38

39. 39
Learn more
http://cs231n.stanford.edu/

40. Learn more with Nat & Lo 20% Google Project:
Learn more
40

41. 41
?
Learn more

42. 42
Learn more
“Machine learning” sub-Reddit.

43. 43
Learn more

44. 44
Learn more
Grup d’estudi de machine learning Barcelona

45. BSc, MSc & Phd @ UPC
45

46. BSc, MSc & Phd @ UPC
46
● Language and Vision
New visual Turing test

47. BSc, MSc & Phd @ UPC
47
● Saliency vs Attention

48. BSc, MSc & Phd @ UPC
48
● Image and Video Retrieval

49. BSc, MSc & Phd @ UPC
49
● Wearables & Egocentric Vision

50. BSc, MSc & Phd @ UPC
50
● Affective Computing
CNN

51. BSc, MSc & Phd @ UPC
51
● Medical Imaging

52. BSc, MSc & Phd @ UPC
52
● Multimodal People Recognition

53. BSc, MSc & Phd @ DCU - Insight
53

54. Eva Mohedano
Prof Noel O’Connor
Dublin City University
Insight Centre for Data Analytics
BSc, MSc & Phd @ DCU - Insight
Kevin McGuinnes
54

55. BSc, MSc & Phd @ DCU - Insight
55

56. 56