A presentation I gave at Hack Portland (Maine) on March 28, 2023.

1. GPT3 API vs. Reality
Natural language book finding on
LibraryThing.
Tim Spalding, LibraryThing
March 28, 2023

2. My Business: Book Lovers and Libraries
LibraryThing
(Goodreads cloned us)
TinyCat
(Libary catalogs for small
schools, churches, etc.)
Syndetics
Unbound
(Makes “real” library catalogs
better.)

3. Everyone is talking about AI
• Right?

5. The “Holy Shit” Moment
• I’ve long been a skeptic.
• Was I right?
• Called an all-company meeting after
GPT4 came out.

6. What Can We Do With This?
• Recommendations? No.
• Data-filling. No, ick.
• Writing stuff, summaries? Yes, ick!
• Classification
• Yes, but not that interesting
• Finding books?!?

7. Problem 1: Hallucinates ISBNs

8. Problem 1: Hallucinates Text

9. Problem 2: Hallucinates Books

10. Problem 3: Slow
“I haven’t watched this many progress bars
since the 90s.” — Benedict Evans
Problem 4: Out of date
GPT3/4 cut-off at September 2021

11. Solution: GPT3 + Reality®
• Query GPT3
• Ask for JSON
• Don’t ask for explanations, commentary, etc.
• Parse each book against LibraryThing
• Throw out the crap
• Use only our versions of the data
• Deliver only real books, no comments

15. Unexpected Problem: JSON hallucinations

16. Reaction: Good

17. Learnings
• Hallucinations are a big problem
• Everything is hallucinated, even format
• Reality can put a check on hallucinations
• Don’t use where important
• GPT is still slow
• https://tinyurl.com/LibraryThingAI

18. Thank you!
Tim Spalding, LibraryThing
March 28, 2023