This presentation is an introduction to the new Quality Management in Localization Certification program offered by Localization Institute in association with TAUS. This program provides a unique opportunity for everybody who is interested in quality and would like to get insight knowledge of DQF and its implementation in real world.

1. 1
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
In association with TAUS
Quality Management in Localization
Certification
Informa(onal
Webinar
July
2,
2013

2. 2
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Quality Management in Translation
and the
TAUS Dynamic Quality Framework
Self Study Component
Willem Stoeller PMP® in
cooperation with TAUS
Contact information: willem@intlconsultingllc.com

3. 3
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Instructor: Willem Stoeller PMP®
Ø 22 years experience in translation, localization and internationalization
of software products, marketing materials and web content
Ø Previous senior management experience at two well-known
Localization Services Providers and one Localization Tools Provider
Ø Certified Project Management Professional and member of the Project
Management Institute. Currently board member of the PMI® Chapter in
Portland
Ø Former visiting professor at the Monterey Institute of International
Studies where he taught software localization for two years
Ø Principal contributor to the localization project management
certification program offered by the Localization Institute

4. 4
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Objectives
Ø Upon completion of this program, you will be able to:
– Describe the issues related to managing translation quality
– Describe how the different quality management standards
can contribute to managing translation quality
– Place the Dynamic Quality Framework within the context of
quality management models
– Describe the three major components of the TAUS Labs
DQF offering
– Use the DQF facilities offered through TAUS Labs
– Determine how DQF could be used in your own
organization to evaluate translation quality

5. 5
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Target Audience
Ø Anyone interested in translation quality
– TSP project managers, quality managers and
lead translators
– Translation buyer project managers, quality
managers and lead translators
– Other translation professionals interested in
translation quality using machine or human
translation
– TAUS membership not required

6. 6
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Agenda
Quality
Management
in
Transla(on
and
the
TAUS
Dynamic
Quality
Framework
Self
Study
Introduc(on
Quality
Management
Standards
DQF
Overview
Experience
with
DQF
Classroom
Hands-­‐on
with
DQF
Cer(fica(on
Test

7. 7
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Agenda Self Study
Introduc(on
Quality
management
standards
Current
state
of
quality
management
in
transla(on
Where
does
DQF
fit
in?
DQF
overview
DQF
and
the
real
world

8. 8
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
What is Translation Quality and how can
we influence it?
Ø Quality is defined as the degree to which the
characteristics of a translation fulfill the
requirements of the agreed-upon specifications
(ASTM F2575-06 Standard Guide)
– Requirements depend on domain, content type
and communication channel (e.g. business to
consumer)
– Characteristics are often described indirectly in
the form of a weighted error typology

9. 9
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
What is Translation Quality and how can
we influence it?
Ø Often quality is defined in less precise terms
– One single approach independent of content type
or communication channel
– Translation needs to comply with terminology and
style guides
– Quality is left to the discretion of the ICR reviewer
– It has to be perfect, flawless (And that means?)
– I know quality when I see it (holistic but not
useful!)

10. 10
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
What is Translation Quality and how can
we influence it?
Transla(on
Quality
Source
Content
Quality
Transla(on
Requirements
Translator
experience,
training
and
performance
Processes
and
Tools
Used

11. 11
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Agenda Self Study
Introduc(on
Quality
management
standards
Current
state
of
quality
management
in
transla(on
Where
does
DQF
fit
in?
DQF
overview
DQF
and
the
real
world

12. 12
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Quality Management Standards
Quality
Management
Standards
General
Standards
ISO
9001:2008
PMBOK®
Guide
CMMI
Six
Sigma
Transla(on
Specific
Standards
EN15038
CAN
CGSB
131.10
ASTM
F2575-­‐06
Standard
Guide

13. 13
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Agenda Self Study
Introduc(on
Quality
management
standards
Current
state
of
quality
management
in
transla(on
Where
does
DQF
fit
in?
DQF
overview
DQF
and
the
real
world

14. 14
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Current state of Quality
Management in Localization
Ø Often weak, missing or not documented
quality planning
Ø Often review without a formal quality
evaluation such as J2450
Ø Quality assurance missing or only focused
on completing all quality processes
without asking: Are these the right
processes?

15. 15
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Agenda Self Study
Introduc(on
Quality
management
standards
Current
state
of
quality
management
in
transla(on
Where
does
DQF
fit
in?
DQF
overview
DQF
and
the
real
world

16. 16
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Where Does DQF fit in?
Quality management
in Localization
Select
resources
Train resources
Define quality objectives
Provide feedback to
resources
Select Quality
evaluation techniques
Pass/fail criteria
Evaluate source
content quality
Create functional
& linguistic test plan
Evaluate target
content quality
Evaluate technical quality
Evaluate linguistic quality
Select workflow
and tools
QA of processes used
Client LSP relationship
DQF

17. 17
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Agenda Self Study
Introduc(on
Quality
management
standards
Current
state
of
quality
management
in
transla(on
Where
does
DQF
fit
in?
DQF
overview
DQF
and
the
real
world

18. 18
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF Overview
This will be addressed by the next
presenter: Rahzeb Choudhury from
TAUS
18

19. 19
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Agenda Self Study
Introduc(on
Quality
management
standards
Current
state
of
quality
management
in
transla(on
Where
does
DQF
fit
in?
DQF
overview
DQF
and
the
real
world

20. 20
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF and the Real World
Ø Case studies from:
– Intel
– EMC
– Pactera

21. 21
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Quality Management in Translation
and the
TAUS Dynamic Quality Framework
Thank you for your attention!
If this sample makes you thirst for more,
see the Localization Institute Website

22. TAUS
Dynamic
Quality
Framework
Industry
collabora/ve
pla3orm
for
transla/on
quality
evalua/on
Rahzeb
Choudhury
TAUS

23. 23
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
23
Clients
MLV’s
In
country
offices/partners
Distributed
translators/authors
4
to
30
vendors
10
to
40
languages
100’
to
1000’s
translators/authors
Vendor
Management
Project
Management
Quality
Assurance
TranslaGon
Memory
Account
Management
Resources
Management
Quality
Assurance
Project
Management
TranslaGon
Memory
Resources
Management
Quality
Assurance
Project
Management
TranslaGon
Memory
Quality
Assurance
TranslaGon
Memory
Cascaded
Supply
Chain
This slide may not be used or copied without permission from TAUS

24. 24
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Dynamic
Quality
Framework
• Need
to
go
up
and
down
in
quality
and
the
transla(on
industry’s
use
of
quality
evaluaGon
models
and
metrics
needed
to
reflect
this,
• Need
industry
benchmarking
to
strengthen
and
improve
the
credibility
of
quality
assurance
processes,
• Need
to
lower
cost
of
quality
assurance
at
buyers
and
providers.
"
We
aim
to
achieve
this
through
an
industry
shared
knowledge
base,
guidance
on
QE
model
selecGon
and
shared
tools
for
benchmarking.
This slide may not be used or copied without permission from TAUS

25. 25
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Project
Organiza(on
• Ongoing
ini(a(ve
since
January
2011
• Bimonthly
project
management
calls,
primarily
with
TAUS
members
• TAUS
DQF
team
–
Nora
Aranberri,
Maxim
Khalilov,
Sharon
O’Brien,
Jaap
van
der
Meer,
Rahzeb
Choudhury
• Development
outsourced
This slide may not be used or copied without permission from TAUS

26. 26
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DYNAMIC
QUALITY
FRAMEWORK
THEORY
This slide may not be used or copied without permission from TAUS

27. 27
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
This slide may not be used or copied without permission from TAUS

28. 28
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
This slide may not be used or copied without permission from TAUS
DYNAMIC
QUALITY
FRAMEWORK
IN
PRACTICE

29. 29
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Content
Profiling
–
From
July
2012
This slide may not be used or copied without permission from TAUS

30. 30
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Content
Profiling
• Delinea(ng
quality
requirements
• Shared
approach
to
iden(fy
best
matching
QE
model(s)
for
content
type
and
opera(ng
model
• Greater
credibility
to
decisions
• Based
on
feedback
during
QE
Summit
Dublin
(March
2013),
working
on
version
2
• Available
for
scru(ny
QE
Summit
San
Jose,
October
9
This slide may not be used or copied without permission from TAUS

31. 31
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Knowledgebase
–
From
July
2012
This slide may not be used or copied without permission from TAUS

32. 32
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Knowledgebase
This slide may not be used or copied without permission from TAUS

33. 33
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Knowledgebase
This slide may not be used or copied without permission from TAUS

34. 34
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Knowledgebase
This slide may not be used or copied without permission from TAUS

35. 35
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Knowledgebase
This slide may not be used or copied without permission from TAUS

36. 36
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Aier
DQF
KB
• Leverage
industry
best
prac(ces
to
create/refine
quality
programs
• Central
resource
that
can
be
systema(cally
reviewed
and
improved
to
benefit
all
• Work
together
to
standardize
approaches,
defini(ons
and
metrics
• Following
QE
Summit
Dublin
held
consulta(ons
and
published
publicly
available
best
prac(ces
guidelines
This slide may not be used or copied without permission from TAUS

37. 37
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Best
Prac(ce
Guidelines
–
Since
May
2013
This slide may not be used or copied without permission from TAUS

38. 38
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Best
Prac(ce
Guidelines
This slide may not be used or copied without permission from TAUS

39. 39
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Tools
This slide may not be used or copied without permission from TAUS

40. 40
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
DQF
Tools
Undertake
human
evalua(on
of
MT
output
to:
• Rank
MT
engines
• Produc(vity
evalua(ons
• Assess
linguis(c
quality
using
adequacy,
fluency
or
error
typology
approaches
This slide may not be used or copied without permission from TAUS

41. 41
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Aier
DQF
Tools
• Apply
best
prac(ce
approaches
to
MT
evalua(ons
• Benchmarking
data
• Vendor
independent
evalua(on
• Reduced
evalua(on
costs
• Industry
evalua(on
results
provide
data
for
fundamental
research
• Now
working
on
v2
based
on
user
feedback
• Go
live
August
This slide may not be used or copied without permission from TAUS

42. 42
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Currently…
• BP
Prac(ces
for
Pricing
MT
PE
Consulta(on
now
open
• hmp://www.transla(onautoma(on.com/consulta(ons/consulta(ons
• Transla(on
Tools
Adopt
DQF
Models
• Preparing
for
TAUS
QE
Summit
9
October
2013
• hmp://www.surveymonkey.com/s/BreakoutsQESummtSanJose
This slide may not be used or copied without permission from TAUS

43. 43
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
QE
Summit
San
Jose
This slide may not be used or copied without permission from TAUS

44. Thank
you!
Rahzeb
Choudhury
rahzeb@taus.net

45. 45
This work by the Localization Institute is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.
Online study begins September 9, 2013
Registration closes September 29, 2013
Workshop October 8, 2013 in Santa Clara, CA
Key Dates:
More
informa(on
can
be
found
at
hmp://bit.ly/12BiSUM
Ques(ons?
Please
contact
kris@localiza(onins(tute.com