Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.
Translator
Human Machine
1M words $250000 $70
Credit: Chris Manning 2016
Edited from Chris Manning 2016
Are human translations perfect?
No!
Rank Z score Human eval score System ID
1 0.237 69.0 Combo-6
0.220 68.5 Human translation from scratch
0.216 68.9 Combo-5
...
Criticism: Claim of “Human Parity”
Each time someone makes a claim like this,
there is criticism.
Here:
1. Test set includ...
• Processes the whole sentence
• Can store additional information in hidden
layers
• Language ID
• Domain
• A phrase from ...
Microsoft Confidential – NDA Only
Microsoft Confidential – NDA Only
Microsoft Confidential – NDA Only
Classroom setup
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)
Prochain SlideShare
Chargement dans…5
×

TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)

The Quantum Leap: Human Parity, Chris Wendt (Microsoft)

  • Soyez le premier à commenter

  • Soyez le premier à aimer ceci

TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, Chris Wendt (Microsoft)

  1. 1. Translator
  2. 2. Human Machine 1M words $250000 $70
  3. 3. Credit: Chris Manning 2016
  4. 4. Edited from Chris Manning 2016
  5. 5. Are human translations perfect? No!
  6. 6. Rank Z score Human eval score System ID 1 0.237 69.0 Combo-6 0.220 68.5 Human translation from scratch 0.216 68.9 Combo-5 0.211 68.6 Combo-4 0.141 67.3 Human post-edit of machine translation 2 -0.094 62.3 Sogou (winner of WMT2017 -0.115 62.1 Crowd-sourced human translation 3 -0.398 56.0 Online-A-1710 -0.468 54.1 Online-B-1710
  7. 7. Criticism: Claim of “Human Parity” Each time someone makes a claim like this, there is criticism. Here: 1. Test set includes the other direction Half of the test set were original English news sentences translated to Chinese 2. Sentences, not documents Translation as well as evaluation is per sentence, no document context given 3. Evaluators were not qualified translators Translators were, but evaluators were not qualified translators I say not valid. We are not translating for an audience of professional translators, we are translating for our audience.
  8. 8. • Processes the whole sentence • Can store additional information in hidden layers • Language ID • Domain • A phrase from the previous sentence • A representation of the document context • GPS location • Age of the speaker …
  9. 9. Microsoft Confidential – NDA Only
  10. 10. Microsoft Confidential – NDA Only
  11. 11. Microsoft Confidential – NDA Only
  12. 12. Classroom setup

×