SlideShare une entreprise Scribd logo
1  sur  23
The First SIGIR
Workshop on
Neural
Information
Retrieval
Neu-IR 2016
(Pronounced “new IR”)
https://www.microsoft.com/en-us/research/neuir2016
https://twitter.com/neuir2016
W. Bruce Croft
University of Massachusetts
Amherst, US
Jiafeng Guo
Chinese Academy of Sciences
Beijing, China
Maarten de Rijke
University of Amsterdam
Amsterdam, The Netherlands
Bhaskar Mitra
Bing, Microsoft
Cambridge, UK
Nick Craswell
Bing, Microsoft
Bellevue, US
A big welcome from all
The Organizers
I’m certain that deep learning will come to
dominate SIGIR over the next couple of years …
just like speech, vision, and NLP before it. This is
a good thing. Deep learning provides some
powerful new techniques that are just being
amazingly successful on many hard applied
problems. However, we should realize that there
is also currently a huge amount of hype about
deep learning and artificial intelligence. We
should not let a genuine enthusiasm for
important and successful new techniques lead
to irrational exuberance or a diminished
appreciation of other approaches…
We love the excitement!
Neu-IR 2016
Word Cloud
Neu-IR 2016
Word Cloud
SIGIR 2016
Word Cloud
SIGIR 2016
Word Cloud
Neu-IR 2016 in numbers
# of registrations
121as of July 19 (Tuesday)
# of submissions
27excluding 3 incomplete submissions
# of accepted papers
19excluding 1 withdrawn by the author
% of accepted papers
73%excluding 1 withdrawn by the author
# of accepted papers on word embeddings
8
# of accepted papers on deep NNs
10
# of accepted papers on document ranking
7Other tasks: QA, proactive, conversational…
# of accepted papers from academia
17based on first author’s affiliation
# of countries based on first author
9spread across 3 continents
# of reviewers
14including 9 PC members
Program Committee
Call for Papers
Discuss,
Share,
Learn.
Non-archival submissions
to encourage more
presentations
Lessons from the Trenches
to share learnings
Poster sessions to facilitate
1:1 discussions
https://twitter.com/neuir2016
The rest of this day…MorningI
Keynote: Tomas
Mikolov
Paper
presentations
Coffee break
MorningII
Lessons from
the Trenches
Poster
presentations
Lunch
AfternoonI
Keynote: Hang
Li
Paper
presentations
Coffee break
AfternoonII
Breakout
session
Breakout
session
retrospective
Closing
comments

Contenu connexe

En vedette

Exploring Session Context using Distributed Representations of Queries and Re...
Exploring Session Context using Distributed Representations of Queries and Re...Exploring Session Context using Distributed Representations of Queries and Re...
Exploring Session Context using Distributed Representations of Queries and Re...
Bhaskar Mitra
 

En vedette (6)

Neu-IR 2016: Lessons from the Trenches
Neu-IR 2016: Lessons from the TrenchesNeu-IR 2016: Lessons from the Trenches
Neu-IR 2016: Lessons from the Trenches
 
A Simple Introduction to Word Embeddings
A Simple Introduction to Word EmbeddingsA Simple Introduction to Word Embeddings
A Simple Introduction to Word Embeddings
 
Vectorland: Brief Notes from Using Text Embeddings for Search
Vectorland: Brief Notes from Using Text Embeddings for SearchVectorland: Brief Notes from Using Text Embeddings for Search
Vectorland: Brief Notes from Using Text Embeddings for Search
 
Natural Language Processing with Graph Databases and Neo4j
Natural Language Processing with Graph Databases and Neo4jNatural Language Processing with Graph Databases and Neo4j
Natural Language Processing with Graph Databases and Neo4j
 
Exploring Session Context using Distributed Representations of Queries and Re...
Exploring Session Context using Distributed Representations of Queries and Re...Exploring Session Context using Distributed Representations of Queries and Re...
Exploring Session Context using Distributed Representations of Queries and Re...
 
Deep Learning for NLP: An Introduction to Neural Word Embeddings
Deep Learning for NLP: An Introduction to Neural Word EmbeddingsDeep Learning for NLP: An Introduction to Neural Word Embeddings
Deep Learning for NLP: An Introduction to Neural Word Embeddings
 

Similaire à Neu-ir 2016: Opening note

from_physics_to_data_science
from_physics_to_data_sciencefrom_physics_to_data_science
from_physics_to_data_science
Martina Pugliese
 

Similaire à Neu-ir 2016: Opening note (20)

The International Information Conference on Search, Data Mining and Visualiza...
The International Information Conference on Search, Data Mining and Visualiza...The International Information Conference on Search, Data Mining and Visualiza...
The International Information Conference on Search, Data Mining and Visualiza...
 
IronHacks Live: Info session #3 - COVID-19 Data Science Challenge
IronHacks Live: Info session #3 - COVID-19 Data Science ChallengeIronHacks Live: Info session #3 - COVID-19 Data Science Challenge
IronHacks Live: Info session #3 - COVID-19 Data Science Challenge
 
II-SDV 2017 in Nice - The International Information Conference on Search, Dat...
II-SDV 2017 in Nice - The International Information Conference on Search, Dat...II-SDV 2017 in Nice - The International Information Conference on Search, Dat...
II-SDV 2017 in Nice - The International Information Conference on Search, Dat...
 
II-SDV 2017 - The International Information Conference on Search, Data Mining...
II-SDV 2017 - The International Information Conference on Search, Data Mining...II-SDV 2017 - The International Information Conference on Search, Data Mining...
II-SDV 2017 - The International Information Conference on Search, Data Mining...
 
IC-SDV 2018 The International Conference on Search, Data and Text Mining and ...
IC-SDV 2018 The International Conference on Search, Data and Text Mining and ...IC-SDV 2018 The International Conference on Search, Data and Text Mining and ...
IC-SDV 2018 The International Conference on Search, Data and Text Mining and ...
 
10/13 Top 5 Deep Learning Stories
10/13 Top 5 Deep Learning Stories10/13 Top 5 Deep Learning Stories
10/13 Top 5 Deep Learning Stories
 
SkillsFuture Festival at NUS 2019- Industrial Deep Learning and Latest AI Al...
 SkillsFuture Festival at NUS 2019- Industrial Deep Learning and Latest AI Al... SkillsFuture Festival at NUS 2019- Industrial Deep Learning and Latest AI Al...
SkillsFuture Festival at NUS 2019- Industrial Deep Learning and Latest AI Al...
 
from_physics_to_data_science
from_physics_to_data_sciencefrom_physics_to_data_science
from_physics_to_data_science
 
Gutenberg H4D Stanford 2019
Gutenberg H4D Stanford 2019Gutenberg H4D Stanford 2019
Gutenberg H4D Stanford 2019
 
Experience Probes for Exploring the Impact of Novel Products
Experience Probes for Exploring the Impact of Novel ProductsExperience Probes for Exploring the Impact of Novel Products
Experience Probes for Exploring the Impact of Novel Products
 
Top 5 Deep Learning and AI Stories - November 3, 2017
Top 5 Deep Learning and AI Stories - November 3, 2017Top 5 Deep Learning and AI Stories - November 3, 2017
Top 5 Deep Learning and AI Stories - November 3, 2017
 
Keynote Presentation at Moscow State University.
Keynote Presentation at Moscow State University.Keynote Presentation at Moscow State University.
Keynote Presentation at Moscow State University.
 
How academic institutions best support PhDs and postdocs in the transition to...
How academic institutions best support PhDs and postdocs in the transition to...How academic institutions best support PhDs and postdocs in the transition to...
How academic institutions best support PhDs and postdocs in the transition to...
 
Big Data Challenges
Big Data ChallengesBig Data Challenges
Big Data Challenges
 
Big Data LDN 2017: Deep Learning Demystified
Big Data LDN 2017: Deep Learning DemystifiedBig Data LDN 2017: Deep Learning Demystified
Big Data LDN 2017: Deep Learning Demystified
 
MIT to the NYSE: Journey from University Tech to M&A
MIT to the NYSE: Journey from University Tech to M&AMIT to the NYSE: Journey from University Tech to M&A
MIT to the NYSE: Journey from University Tech to M&A
 
Norway frontiers 20160624 v3
Norway frontiers 20160624 v3Norway frontiers 20160624 v3
Norway frontiers 20160624 v3
 
NUS PhD e-open day 2020
NUS PhD e-open day 2020NUS PhD e-open day 2020
NUS PhD e-open day 2020
 
II-SDV 2016 The Meeting The International Information Conference on Search, D...
II-SDV 2016 The Meeting The International Information Conference on Search, D...II-SDV 2016 The Meeting The International Information Conference on Search, D...
II-SDV 2016 The Meeting The International Information Conference on Search, D...
 
European Innovation Academy Kick-off 2014
European Innovation Academy Kick-off 2014European Innovation Academy Kick-off 2014
European Innovation Academy Kick-off 2014
 

Plus de Bhaskar Mitra

Efficient Machine Learning and Machine Learning for Efficiency in Information...
Efficient Machine Learning and Machine Learning for Efficiency in Information...Efficient Machine Learning and Machine Learning for Efficiency in Information...
Efficient Machine Learning and Machine Learning for Efficiency in Information...
Bhaskar Mitra
 
Multisided Exposure Fairness for Search and Recommendation
Multisided Exposure Fairness for Search and RecommendationMultisided Exposure Fairness for Search and Recommendation
Multisided Exposure Fairness for Search and Recommendation
Bhaskar Mitra
 
Dual Embedding Space Model (DESM)
Dual Embedding Space Model (DESM)Dual Embedding Space Model (DESM)
Dual Embedding Space Model (DESM)
Bhaskar Mitra
 

Plus de Bhaskar Mitra (20)

Joint Multisided Exposure Fairness for Search and Recommendation
Joint Multisided Exposure Fairness for Search and RecommendationJoint Multisided Exposure Fairness for Search and Recommendation
Joint Multisided Exposure Fairness for Search and Recommendation
 
What’s next for deep learning for Search?
What’s next for deep learning for Search?What’s next for deep learning for Search?
What’s next for deep learning for Search?
 
So, You Want to Release a Dataset? Reflections on Benchmark Development, Comm...
So, You Want to Release a Dataset? Reflections on Benchmark Development, Comm...So, You Want to Release a Dataset? Reflections on Benchmark Development, Comm...
So, You Want to Release a Dataset? Reflections on Benchmark Development, Comm...
 
Efficient Machine Learning and Machine Learning for Efficiency in Information...
Efficient Machine Learning and Machine Learning for Efficiency in Information...Efficient Machine Learning and Machine Learning for Efficiency in Information...
Efficient Machine Learning and Machine Learning for Efficiency in Information...
 
Multisided Exposure Fairness for Search and Recommendation
Multisided Exposure Fairness for Search and RecommendationMultisided Exposure Fairness for Search and Recommendation
Multisided Exposure Fairness for Search and Recommendation
 
Neural Learning to Rank
Neural Learning to RankNeural Learning to Rank
Neural Learning to Rank
 
Neural Information Retrieval: In search of meaningful progress
Neural Information Retrieval: In search of meaningful progressNeural Information Retrieval: In search of meaningful progress
Neural Information Retrieval: In search of meaningful progress
 
Conformer-Kernel with Query Term Independence @ TREC 2020 Deep Learning Track
Conformer-Kernel with Query Term Independence @ TREC 2020 Deep Learning TrackConformer-Kernel with Query Term Independence @ TREC 2020 Deep Learning Track
Conformer-Kernel with Query Term Independence @ TREC 2020 Deep Learning Track
 
Neural Learning to Rank
Neural Learning to RankNeural Learning to Rank
Neural Learning to Rank
 
Duet @ TREC 2019 Deep Learning Track
Duet @ TREC 2019 Deep Learning TrackDuet @ TREC 2019 Deep Learning Track
Duet @ TREC 2019 Deep Learning Track
 
Benchmarking for Neural Information Retrieval: MS MARCO, TREC, and Beyond
Benchmarking for Neural Information Retrieval: MS MARCO, TREC, and BeyondBenchmarking for Neural Information Retrieval: MS MARCO, TREC, and Beyond
Benchmarking for Neural Information Retrieval: MS MARCO, TREC, and Beyond
 
Deep Neural Methods for Retrieval
Deep Neural Methods for RetrievalDeep Neural Methods for Retrieval
Deep Neural Methods for Retrieval
 
Neural Learning to Rank
Neural Learning to RankNeural Learning to Rank
Neural Learning to Rank
 
Learning to Rank with Neural Networks
Learning to Rank with Neural NetworksLearning to Rank with Neural Networks
Learning to Rank with Neural Networks
 
Deep Learning for Search
Deep Learning for SearchDeep Learning for Search
Deep Learning for Search
 
Deep Learning for Search
Deep Learning for SearchDeep Learning for Search
Deep Learning for Search
 
Neural Learning to Rank
Neural Learning to RankNeural Learning to Rank
Neural Learning to Rank
 
Deep Learning for Search
Deep Learning for SearchDeep Learning for Search
Deep Learning for Search
 
Dual Embedding Space Model (DESM)
Dual Embedding Space Model (DESM)Dual Embedding Space Model (DESM)
Dual Embedding Space Model (DESM)
 
Adversarial and reinforcement learning-based approaches to information retrieval
Adversarial and reinforcement learning-based approaches to information retrievalAdversarial and reinforcement learning-based approaches to information retrieval
Adversarial and reinforcement learning-based approaches to information retrieval
 

Dernier

Dernier (20)

Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 

Neu-ir 2016: Opening note

Notes de l'éditeur

  1. A very big welcome to everyone to the first ever SIGIR workshop on Neural Information Retrieval.
  2. This year we kicked-off SIGIR with a very optimistic note from Christopher Manning about the field of Neural IR, which was also justifiably accompanied by a note of caution about some of the disproportionate exuberance in the field.
  3. As organizers, when we submitted our workshop proposal we were optimistic that this is an area that a big part of the SIGIR community is excited about. But we were still pleasantly overwhelmed by the actual response we received for a first time workshop.
  4. It is super exciting to see the broad range of themes…
  5. …in the accepted papers.
  6. Interestingly if we look for the same topics in the SIGIR main conference papers…
  7. …we find that they are still relatively under-represented. This in fact validates one of our intuitions that led us to propose this workshop - that in spite of all the excitement, the field of neural IR is actually progressing slowly and might benefit from bringing a focused community together.
  8. So given how much we love our metrics in the SIGIR community, I would love to quickly share some numbers about today’s workshop.
  9. We have more than 120 registrations as of last Tuesday.
  10. We had close to 30 submissions in response to our call for papers…
  11. …of which 19 will be presented today in the form of posters. In addition, the organizers have also selected 5 papers, keeping both the interestingness and the diversity of the papers in mind, for oral presentations.
  12. …Our acceptance rate for submissions was 73%.
  13. Among the accepted papers we noticed some broad themes. 8 papers focused on improving or leveraging word embeddings.
  14. More than half of the papers studied deeper models for IR tasks.
  15. A large number of papers evaluated on the document ranking task, but there were also papers on QnA, proactive IR, knowledge-based IR, and conversational search.
  16. Based on first author’s affiliation most papers came from academia, although a few of them had co-authors from the industry.
  17. We also noticed a good geographic spread, which included 4 papers each from France and India.
  18. A large number of submissions means a large number of papers to review. We had at least 2 reviews for every submitted paper and every reviewer on average reviewed 4-5 papers.
  19. I would like to say a special thanks to all the PC members for their invaluable effort in finishing all the reviews on time in spite of the larger than expected number of submissions, and keeping us on track for all our deadlines. Thank you!
  20. This is also a good time to announce the call for paper for a special issue of the Information Retrieval Journal on Neural Information Retrieval. I hope that many of you in this room will consider submitting to this journal.
  21. Through the course of today I request everyone to ask questions, express opinions and initiate discussions. Tell us live via Twitter what’s going well and what we should do differently. We will try our best to adapt as the day progresses based on your live feedback.
  22. OK, we have a packed day and I know everyone one of you is eagerly waiting to hear from Tomas Mikolov. So I will shut up now. :) Tomas as you all already know is a research scientist at Facebook AI Research. He has previously been part of the Google Brain team and a long time back also interned at Microsoft Research. But probably what many of us in the IR community know Tomas for is his work on word2vec and other vector representations of text which many of us have used or extended in our own work. Tomas has also promised me that he will hang around after his talk – so hopefully many of you will get an opportunity to have more detailed discussions with him during the course of this day. So without further adieu I invite Tomas to come up on stage and tell us more about his Recurrent networks and beyond.