SlideShare une entreprise Scribd logo
1  sur  20
Télécharger pour lire hors ligne
www.opensourceconnections.com
Test Driven Relevance
opensourceconnections.com.com
Eric Pugh - @dep4b - epugh@opensourceconnections.com
Dublin TestHeads Meetup - Lockdown Series
1st December 2020
www.opensourceconnections.com
Who am I?
● Co-founder of OpenSource Connections
● Apache Software Foundation member
● Committer on the Apache Solr project
● Steward of Quepid: A Query Relevance Workbench
● Creator of Chorus: An Open Source Search Stack for Ecommerce
● Member of The Search Network
www.opensourceconnections.com
OpenSource Connections
● “Empowering The World’s Search Teams”
● Elasticsearch & Solr experts, committers
● Consultancy & training - “Think Like a
Relevance Engineer”, LTR, NLP
● US & UK offices
● Clients include USPTO, NHS Wales,
LexisNexis, Wikimedia Foundation,
Snagajob, Under Armour
● Community initiatives include Meetups &
conferences, Relevance Slack - join at
www.opensourceconnections.com/slack
www.haystackconf.com
The Search Relevance Conference
(Haystack LIVE! Meetups every few weeks)
www.opensourceconnections.com
Your search relevance is
probably broken!!
www.opensourceconnections.com
What is Bad Relevance? Easier to show versus tell...
Nike.com - shirts without stripes
Tesco Ireland - Guinness
Tesco Ireland - Organic Cat Food
Aldi UK - Almond Milk
www.opensourceconnections.com
How I break (test?) Relevance!
● Pick a site (Sainsbury, Gap…)
● Types of Test queries
○ “White sugar” - Descriptive Language
○ “Cafiteer” - Spelling Errors
○ “Coffee maker” vs. “cafetiere” - Jargon/Terminology
○ “Cheap” vs “Expensive” - Vague yet specific
○ “Tshirt” and “T Shirt” - Abbreviations
○ “Shirt without stripes” - Natural Language Style
www.opensourceconnections.com
This is why your search is broken!
www.opensourceconnections.com
A broken workflow!
● Our collaboration stinks
● Search testing is hard
● Iterations are slow
Where you come in!
www.opensourceconnections.com
Why is this important?
● Better search means better conversion rates
○ Your customers aren’t using the same language as you are
○ Zero results pages burn money
○ Great search helps retention
● Search knowledge informs strategy
○ What’s in your query logs?
○ Understanding intent
● Search is a gateway to personalisation
○ A ‘virtual aisle’ for each customer
○ ML, LTR, recommendations, chat bots...
“UK retail ecommerce sales will account
for 27.5% of total retail sales this year,
and that proportion will approach
one-third by 2024. The post-pandemic
hit to physical retail will be felt far into
the future.”
Emarketer
“Online sales are now expected to grow
from initial predictions of 11% to 19% in
2020, reaching £78.9bn, this is up from
£66.3bn in 2019….Amazon is expected
to benefit the most from this surge in
demand for online retail”
Edge by Ascential
www.opensourceconnections.com
How OSC tunes search
www.opensourceconnections.com
5 Steps to Better Relevance
● Measurement
● Experimentation
● Rapidity
● Collaboration
● Help
www.opensourceconnections.com
LAB
EVALUATION
OFFLINE
RELEVANCE
AUTOMATED
TESTING
Search Quality: A Business-Friendly
Perspective
Peter Fries - Haystack 2018
Relevancy Framework
www.opensourceconnections.com
LAB
OPERATIONS
INTEGRATION
CLICKSTREAM
A/B TESTING
EVALUATION
OFFLINE
RELEVANCE
ONLINE
AUTOMATED
TESTING
Search Quality: A Business-Friendly
Perspective
Peter Fries - Haystack 2018
Relevancy Framework
www.opensourceconnections.com
Tools & Processes
www.opensourceconnections.com
Demo time of Quepid!
www.opensourceconnections.com
Quepid
● Search Relevance dashboard & testing
● Used by clients such as Advance Auto,
O'Reilly Media, Historic England,
Salesforce - and NICE!
● 1500+ registered users
● Free hosted version at www.quepid.com
● Open source at github.com/o19s/quepid
● iSpy - Prototype connectors to any website
frontend (in development )
www.opensourceconnections.com
What’s next?
www.opensourceconnections.com
State of play
LAB
OPERATIONS
INTEGRATION
CLICKSTREAM
A/B TESTING
EVALUATION
OFFLINE
RELEVANCE
ONLINE
AUTOMATED
TESTING
RRE
AgentQ
Quepid
Supahands?
Ugh.. Google Analytics?
Nothing good
www.opensourceconnections.com
We need more QA folks in the Relevancy World!
● Test your site with ww.opensourceconnections.com/guide/ecommerce
● Meet Pete the Product Owner - blog & video series on the OSC website
● https://github.com/o19s/quepid for code
● www.quepid.com for documentation
● Free online workshops running at https://plainschwarz.com/ps-salon/
● Join Relevance Slack at www.opensourceconnections.com/slack
● Let OSC help you build better ecommerce search!
www.opensourceconnections.com
Thank you.
Contact me at epugh@opensourceconnections.com and follow @dep4b

Contenu connexe

Similaire à Test driven relevancy

How Can Your IT Business Succeed Internationally?
How Can Your IT Business Succeed Internationally?How Can Your IT Business Succeed Internationally?
How Can Your IT Business Succeed Internationally?Milena Milicevic
 
Web-based business models in 2015
Web-based business models in 2015Web-based business models in 2015
Web-based business models in 2015Eduardo Larrain
 
How to Improve Performance with Audience-first SEO & Content Marketing
How to Improve Performance with Audience-first SEO & Content MarketingHow to Improve Performance with Audience-first SEO & Content Marketing
How to Improve Performance with Audience-first SEO & Content MarketingSemetrical
 
Open House - Prodo Housing Presentation
Open House -  Prodo Housing PresentationOpen House -  Prodo Housing Presentation
Open House - Prodo Housing PresentationProdoDigital
 
Workshop on create slides 17.07.14.pptx (2)
Workshop on create slides 17.07.14.pptx (2)Workshop on create slides 17.07.14.pptx (2)
Workshop on create slides 17.07.14.pptx (2)Ernact Create
 
The Power of Big Data - Transformation Day Public Sector London 2017
The Power of Big Data - Transformation Day Public Sector London 2017The Power of Big Data - Transformation Day Public Sector London 2017
The Power of Big Data - Transformation Day Public Sector London 2017Amazon Web Services
 
Managing Digital Marketing
Managing Digital MarketingManaging Digital Marketing
Managing Digital MarketingJohn Chacksfield
 
Skapa - West Sweden Chamber of Commerce Aug 31, 2018
Skapa - West Sweden Chamber of Commerce Aug 31, 2018Skapa - West Sweden Chamber of Commerce Aug 31, 2018
Skapa - West Sweden Chamber of Commerce Aug 31, 2018Erik Ekholm
 
Intra.NET Reloaded London 2016 - Post Event Report
Intra.NET Reloaded London 2016 - Post Event ReportIntra.NET Reloaded London 2016 - Post Event Report
Intra.NET Reloaded London 2016 - Post Event ReportRamona Kohrs
 
Network of Networks Discussion and Charter Document
Network of Networks Discussion and Charter DocumentNetwork of Networks Discussion and Charter Document
Network of Networks Discussion and Charter DocumentLora Cecere
 
Social Recruiting - Peek at 2015
Social Recruiting - Peek at 2015Social Recruiting - Peek at 2015
Social Recruiting - Peek at 2015Alex Putman
 
Big Data & Marketing Analytics - How to Use Available Data, and How to Prepar...
Big Data & Marketing Analytics - How to Use Available Data, and How to Prepar...Big Data & Marketing Analytics - How to Use Available Data, and How to Prepar...
Big Data & Marketing Analytics - How to Use Available Data, and How to Prepar...Luciano Pesci, PhD
 
How to generate high quality B2B leads with international digital marketing
How to generate high quality B2B leads with international digital marketingHow to generate high quality B2B leads with international digital marketing
How to generate high quality B2B leads with international digital marketingOban International
 
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...Connotate
 
How to leverage E-E-A-T to boost your international expansion
How to leverage E-E-A-T to boost your international expansionHow to leverage E-E-A-T to boost your international expansion
How to leverage E-E-A-T to boost your international expansionGemma Fontane
 
Digital libraries with ict and innovation
Digital libraries with ict and innovationDigital libraries with ict and innovation
Digital libraries with ict and innovationMaykin Likitboonyalit
 
The Classical School Of Management
The Classical School Of ManagementThe Classical School Of Management
The Classical School Of ManagementAngie Lee
 
AALL Webinar: Technology Tools for Law Librarians
AALL Webinar:  Technology Tools for Law LibrariansAALL Webinar:  Technology Tools for Law Librarians
AALL Webinar: Technology Tools for Law LibrariansLisa Smith-Butler
 

Similaire à Test driven relevancy (20)

How Can Your IT Business Succeed Internationally?
How Can Your IT Business Succeed Internationally?How Can Your IT Business Succeed Internationally?
How Can Your IT Business Succeed Internationally?
 
Web-based business models in 2015
Web-based business models in 2015Web-based business models in 2015
Web-based business models in 2015
 
How to Improve Performance with Audience-first SEO & Content Marketing
How to Improve Performance with Audience-first SEO & Content MarketingHow to Improve Performance with Audience-first SEO & Content Marketing
How to Improve Performance with Audience-first SEO & Content Marketing
 
Open House - Prodo Housing Presentation
Open House -  Prodo Housing PresentationOpen House -  Prodo Housing Presentation
Open House - Prodo Housing Presentation
 
Workshop on create slides 17.07.14.pptx (2)
Workshop on create slides 17.07.14.pptx (2)Workshop on create slides 17.07.14.pptx (2)
Workshop on create slides 17.07.14.pptx (2)
 
Throwaway
ThrowawayThrowaway
Throwaway
 
The Power of Big Data - Transformation Day Public Sector London 2017
The Power of Big Data - Transformation Day Public Sector London 2017The Power of Big Data - Transformation Day Public Sector London 2017
The Power of Big Data - Transformation Day Public Sector London 2017
 
Managing Digital Marketing
Managing Digital MarketingManaging Digital Marketing
Managing Digital Marketing
 
Skapa - West Sweden Chamber of Commerce Aug 31, 2018
Skapa - West Sweden Chamber of Commerce Aug 31, 2018Skapa - West Sweden Chamber of Commerce Aug 31, 2018
Skapa - West Sweden Chamber of Commerce Aug 31, 2018
 
Intra.NET Reloaded London 2016 - Post Event Report
Intra.NET Reloaded London 2016 - Post Event ReportIntra.NET Reloaded London 2016 - Post Event Report
Intra.NET Reloaded London 2016 - Post Event Report
 
Network of Networks Discussion and Charter Document
Network of Networks Discussion and Charter DocumentNetwork of Networks Discussion and Charter Document
Network of Networks Discussion and Charter Document
 
Social Recruiting - Peek at 2015
Social Recruiting - Peek at 2015Social Recruiting - Peek at 2015
Social Recruiting - Peek at 2015
 
Big Data & Marketing Analytics - How to Use Available Data, and How to Prepar...
Big Data & Marketing Analytics - How to Use Available Data, and How to Prepar...Big Data & Marketing Analytics - How to Use Available Data, and How to Prepar...
Big Data & Marketing Analytics - How to Use Available Data, and How to Prepar...
 
How to generate high quality B2B leads with international digital marketing
How to generate high quality B2B leads with international digital marketingHow to generate high quality B2B leads with international digital marketing
How to generate high quality B2B leads with international digital marketing
 
The Rules Around Tools
The Rules Around ToolsThe Rules Around Tools
The Rules Around Tools
 
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
 
How to leverage E-E-A-T to boost your international expansion
How to leverage E-E-A-T to boost your international expansionHow to leverage E-E-A-T to boost your international expansion
How to leverage E-E-A-T to boost your international expansion
 
Digital libraries with ict and innovation
Digital libraries with ict and innovationDigital libraries with ict and innovation
Digital libraries with ict and innovation
 
The Classical School Of Management
The Classical School Of ManagementThe Classical School Of Management
The Classical School Of Management
 
AALL Webinar: Technology Tools for Law Librarians
AALL Webinar:  Technology Tools for Law LibrariansAALL Webinar:  Technology Tools for Law Librarians
AALL Webinar: Technology Tools for Law Librarians
 

Plus de OpenSource Connections

How To Structure Your Search Team for Success
How To Structure Your Search Team for SuccessHow To Structure Your Search Team for Success
How To Structure Your Search Team for SuccessOpenSource Connections
 
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie HullHaystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie HullOpenSource Connections
 
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim AllisonHaystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim AllisonOpenSource Connections
 
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...OpenSource Connections
 
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj BharadwajHaystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj BharadwajOpenSource Connections
 
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...OpenSource Connections
 
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan KohlHaystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan KohlOpenSource Connections
 
Haystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon HughesHaystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon HughesOpenSource Connections
 
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey GraingerHaystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey GraingerOpenSource Connections
 
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...OpenSource Connections
 
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...OpenSource Connections
 
Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...OpenSource Connections
 
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...OpenSource Connections
 
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...OpenSource Connections
 
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...OpenSource Connections
 
2019 Haystack - How The New York Times Tackles Relevance - Jeremiah Via
2019 Haystack - How The New York Times Tackles Relevance - Jeremiah Via2019 Haystack - How The New York Times Tackles Relevance - Jeremiah Via
2019 Haystack - How The New York Times Tackles Relevance - Jeremiah ViaOpenSource Connections
 
Haystack 2019 - Addressing variance in AB tests: Interleaved evaluation of ra...
Haystack 2019 - Addressing variance in AB tests: Interleaved evaluation of ra...Haystack 2019 - Addressing variance in AB tests: Interleaved evaluation of ra...
Haystack 2019 - Addressing variance in AB tests: Interleaved evaluation of ra...OpenSource Connections
 
Haystack 2019 - Beyond The Search Engine: Improving Relevancy through Query E...
Haystack 2019 - Beyond The Search Engine: Improving Relevancy through Query E...Haystack 2019 - Beyond The Search Engine: Improving Relevancy through Query E...
Haystack 2019 - Beyond The Search Engine: Improving Relevancy through Query E...OpenSource Connections
 
Haystack 2019 - Evolution of Yelp search to a generalized ranking platform - ...
Haystack 2019 - Evolution of Yelp search to a generalized ranking platform - ...Haystack 2019 - Evolution of Yelp search to a generalized ranking platform - ...
Haystack 2019 - Evolution of Yelp search to a generalized ranking platform - ...OpenSource Connections
 

Plus de OpenSource Connections (20)

How To Structure Your Search Team for Success
How To Structure Your Search Team for SuccessHow To Structure Your Search Team for Success
How To Structure Your Search Team for Success
 
Payloads and OCR with Solr
Payloads and OCR with SolrPayloads and OCR with Solr
Payloads and OCR with Solr
 
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie HullHaystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
 
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim AllisonHaystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
 
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
 
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj BharadwajHaystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
 
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
 
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan KohlHaystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
 
Haystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon HughesHaystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon Hughes
 
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey GraingerHaystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
 
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
 
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
 
Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...
 
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
 
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
 
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
 
2019 Haystack - How The New York Times Tackles Relevance - Jeremiah Via
2019 Haystack - How The New York Times Tackles Relevance - Jeremiah Via2019 Haystack - How The New York Times Tackles Relevance - Jeremiah Via
2019 Haystack - How The New York Times Tackles Relevance - Jeremiah Via
 
Haystack 2019 - Addressing variance in AB tests: Interleaved evaluation of ra...
Haystack 2019 - Addressing variance in AB tests: Interleaved evaluation of ra...Haystack 2019 - Addressing variance in AB tests: Interleaved evaluation of ra...
Haystack 2019 - Addressing variance in AB tests: Interleaved evaluation of ra...
 
Haystack 2019 - Beyond The Search Engine: Improving Relevancy through Query E...
Haystack 2019 - Beyond The Search Engine: Improving Relevancy through Query E...Haystack 2019 - Beyond The Search Engine: Improving Relevancy through Query E...
Haystack 2019 - Beyond The Search Engine: Improving Relevancy through Query E...
 
Haystack 2019 - Evolution of Yelp search to a generalized ranking platform - ...
Haystack 2019 - Evolution of Yelp search to a generalized ranking platform - ...Haystack 2019 - Evolution of Yelp search to a generalized ranking platform - ...
Haystack 2019 - Evolution of Yelp search to a generalized ranking platform - ...
 

Dernier

Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 

Dernier (20)

Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 

Test driven relevancy