The User Experience of Captioning - And How Automation Improves Caption Quality While Saving Time and Money Sam Cartsos and Sarah Murphy, of Frameweld, discuss the elements of captioning that lead to highly usable captions and positive user experiences. They also discuss how those principles informed Frameweld's work on SyncWords, a caption automation platform, and how automation can drive improved caption quality. Webinar originally aired Dec. 12, 2013 at 1pm EST. www.syncwords.com www.frameweld.com

1. The User Experience of
Captions
How Automation Can Save Time, Money
and Improve the Quality of Captions
Sam Cartsos & Sarah Murphy

2. Live captions provided through:
www.recapd.com
2

3. The User Experience of
Captions
How Automation Can Save Time, Money
and Improve the Quality of Captions
Sam Cartsos & Sarah Murphy

4. Captioning
4

5. User Experience
The
Users
of
“User
Experience”
UX
of
Cap5ons
for
Online
Video
S%ll
and
Cap%on
From
Annie
Hall
5

6. No captions at all are
the WORST captions
6

7. Quality
Transcrip%on
vs.
Automated
Transcrip%on
7

8. Cap%ons
are
not
accurate
Only
shows
one
leQer
Timing
is
not
relevant
Report
on
the
State
of
Closed
Cap%oning
of
Internet
Protocol
Delivered
Video
Programming
via
Electronic
Filing,
May
16,
2013
8

9. Cap%on
segment
is
too
long
to
read
and
digest
9

10. Areas
that
Affect
Cap%on
Quality
&
UX
10

11. Transcrip%on
is
manual
Especially
quality
transcripts
•
Convey
the
informa%on
within
the
media
•
Remove
unnecessary
words
that
add
cluQer
like
“ums”
•
Conform
to
exis%ng
cap%on
style
guides

12. Accurately Timed
Captions appear as the words
are spoken
12

13. Segmentation
Chunking text into manageable bits

14. Too
much
text
14

15. Characters
per
line
Mul%ple
speakers
15

16. 16

17. 17

18. 18

19. 19

20. Propor%onality
More
difficult
to
read
with
one
long
line
of
text,
and
one
very
short
20

21. Repeated action with precision
Detail orientated
Leads to better quality
21

22. Triangle
shaped
cap%ons
are
easier
to
read
Centered
text
BoQom
of
the
screen
22

23. Key Features of Quality Captions
Centered
text
BoQom
of
the
screen
Black
drop
shadow
White
or
bright
text
Wide
font
23

24.
Automation
Do
not
automate
transcrip%on
Pre-­‐process
%ming
Word
level
alignment
of
media
to
transcript
Manage
cap%on
formaang
and
segmenta%on
Ability
to
edit
by
hand,
automa%on
processes
edits
and
%mes
on
the
fly
SyncWords
scores
cap%on
factors
and
segments
cap%ons
based
on
the
best
possible
output
24

25. 25

26. Hand
s%tching
takes
longer,
and
has
greater
frequency
of
irregulari%es
Sewing
machines
make
quick
work
of
the
same
job
26

27. What works for one user
is not always what every
user wants
SyncWords allows users
to tailor caption outputs
fitting specific needs
27

28. Automation Allows for
Customization in Styling
Text
color
Characters
per
line
and
number
of
lines
Pop-­‐on
cap%ons
Time
shid
to
show
cap%ons
just
before
words
are
spoken
28

29. Using Technology to Fine Tune Timing
Set
cap%ons
a
few
milliseconds
before
dialogue
begins
Hermione’s Time Turner from Harry Potter
29

30. 30

31.
Machine
Learning
Algorithms
Alignment & Chunking
• Deep Neural
Networks
• Natural Language
Processing (NLP)
31

32. Contact
Us
Sam
Cartsos
Senior
Partner
scartsos@frameweld.com
@scartsos
Sarah
Murphy
Director
of
Business
Development
sarah@frameweld.com
@fw_sarah
32

33. Frameweld
www.frameweld.com
718-­‐408-­‐9190
info@frameweld.com
Tweet
@frameweld
33

34. Thank
you!