The document discusses automatically creating taxonomies for personal interests and activities. It describes a process of finding text about a domain on the web, extracting characteristic vocabulary from the text, and using this to automatically create a shallow taxonomy of facets for the domain. The goal is to develop taxonomies for topics that currently lack them, such as hobbies and everyday activities, to help organize personal data and digital archives.
22. Conclusion
• Personal Data to Archive is more than just photos
• When we have a lot of data, we need facets/categories/
metadata to find it
• We need automatic annotation
• We need hundreds of taxonomies to annotate personal
data
• Current advances in natural language processing/
neural nets indicate that much of the taxonomy creation
burden can be automated
25. Conclusions
Taxonomies enrich the search experiences
For many topics, no taxonomies exist
We believe it is possible to create taxonomies, or at least first passes at such
taxonomies, completely automatically
Such taxonomies are needed for domains where insufficient money or people are
there to invest in creating good taxonomies
26. Digital archives are more than
scanned photos
• Digital Traces
• Digital Captures, Quantified Self
• Writing, Reading, Browsing
• Soon, 24/7 video, sound
27.
28. Example of Using Topic Modeling
2 ebay examples: cell phones, laptops
Faceted Search uses a topic model
31. Taxonomies do not exist for most topics
Well covered: scientific and administrative medicine,
music, movies, historical figures, football, geography,
tourism, yellow pages, book classification, commercial
products (electronics, appliances, ..)
Not well covered: every day activities, hobbies, non
professional sports, personal interests
Example: what would you find in a kitchen?
32. Taxonomies do not exist for most topics
Well covered: scientific and administrative medicine,
music, movies, historical figures, football, geography,
tourism, yellow pages, book classification, commercial
products (electronics, appliances, ..)
Not well covered: every day activities, hobbies, non
professional sports, personal interests
Example: what would you find in a kitchen?
Water, sponge, cleaning product, forks, knives, food,
refrigerator, dustpan, bowls, plates, crackers, …
33. How can we automatically find the vocabulary
for a new area, and automatically structure it?
Find Text about domain on the Web
Extract the vocabulary from this domain text
Compare the vocabulary to ‘background vocabulary’ to detect novelty
Create loose hierarchies of domain vocabulary (facets)
39. Domain
Text
2. Extract Vocabulary from Domain Text
• Marketing Via Rings Marketing Via Articles Marketing Via Yellow Pages .
• + ADD YOUR SITE ( 29 members ) .
• Machine Knit Bloggers Click Member link to see site in tv Machine Knit Bloggers + ADD YOUR SITE ( 29 members ) This community
• Requirements : 1 ) Your blog must have existed for at least 2 weeks .
• 2 ) You must post an article about machine knitting at least once a month and you must have already posted two articles discussing mac
• 3 ) Important You must know how to paste in the Community HTML code and must be display on the " main " page of your blog and so it
• If you put it in the wrong place , communitysurf will kick you out when it automatically checks for the code .
• ( The community hostess can't over ride this .
• ) I suggest putting it in the sidebar or the footer of your template .
• Do not paste it into an individual blog article .
• 4 ) You are encouraged create a category on your blog for machine knitting .
• ( So tha visitors can find the machine knitting content .
• ) 5 ) You may not host adult content .
• knutty4knitting Fibrespates A blog about knitting , hand and machine , spinning , dyeing , weaving and felting What's knittin ' at Knit In
• I knit diaper covers and some kids clothes and whatever else strikes my fancy .
• Jussi's knitting circle Trying to combine my love of knitting ( machine and hand ) with my mad family life as an expat kiwi in Sydney Nee
• Free patterns and techniques , and plenty of eye-candy !
• : ) nurtucommunityneedles simple sewing and machine knitting and examples of my marbled fabric.Original patterns for sewing and MK
• Knitting on the Rogue River life is all about color !
• Quail Hill Knits A personal blog explocommunity cut and sew techniques with both hand and machine knitting .
• Clickertyclick I'm a South Aussie knitter , fusion knitting with my recently re-discovered Bond :- ) knitting bare My knitting ( machine an
• All in one convenient package .
• Zeeppo's Knitting Blog This blog is about my adventures as one of the few unashamed male knitter in Pittsburgh .
• Knitman about my knitting dogs and life Shamrock Knits I try to machine knit , hand knit , and crochet ; but have some serious gauge is
• LOL Bright Meadow Knits Hand and machine knitting diary KnitterUK Machine Knitting From the Obsessed Crafter Here I talk about kn
•
40. Domain
Text
2. Extract Vocabulary from Domain Text
• Marketing _ Rings Marketing _ Articles Marketing _ Yellow Pages _
• + ADD _ SITE _ 29 members _ _
• Machine Knit Bloggers Click Member link _ _ site _ tv Machine Knit Bloggers + ADD _ SITE _ 29 members _ _ community _ _
• Requirements _ 1 _ _ blog _ _ existed _ _ _ 2 weeks _
• 2 _ _ _ post _ article _ machine knitting _ _ _ _ _ _ _ _ _ _ posted _ articles discussing machine knitting _
• 3 _ Important _ _ know _ _ paste _ _ Community HTML code _ _ _ display _ _ _ main _ page _ _ blog _ _ _ _ vis
• _ _ put _ _ _ wrong place _ communitysurf _ kick _ _ _ _ automatically checks _ _ code _
• _ _ community hostess _ _ ride _ _
• _ _ suggest putting _ _ _ sidebar _ _ footer _ _ template _
• _ _ paste _ _ _ individual blog article _
• 4 _ _ _ encouraged create _ category _ _ blog _ machine knitting _
• _ _ tha visitors _ find _ machine knitting content _
• _ 5 _ _ _ _ host adult content _
• knutty4knitting Fibrespates _ blog _ knitting _ hand _ machine _ spinning _ dyeing _ weaving _ felting What's knittin _ _ Knit
• _ knit diaper covers _ _ kids clothes _ _ _ strikes _ fancy _
• Jussi's knitting circle Trying _ combine _ love _ knitting _ machine _ hand _ _ _ mad family life _ _ expat kiwi _ Sydney Need
• Free patterns _ techniques _ _ plenty _ eye-candy _
• _ _ nurtucommunityneedles simple sewing _ machine knitting _ examples _ _ marbled fabric.Original patterns _ sewing _ MK _
• Knitting _ _ Rogue River life _ _ _ color _
• Quail Hill Knits _ personal blog explocommunity cut _ sew techniques _ _ hand _ machine knitting _
• Clickertyclick I'm _ South Aussie knitter _ fusion knitting _ _ recently re-discovered Bond :- _ knitting bare _ knitting _ machine _
• _ _ _ convenient package _
• Zeeppo's Knitting Blog _ blog _ _ _ adventures _ _ _ _ _ unashamed male knitter _ Pittsburgh _
• Knitman _ _ knitting dogs _ life Shamrock Knits _ try _ machine knit _ hand knit _ _ crochet _ _ _ _ serious gauge issues _
• LOL Bright Meadow Knits Hand _ machine knitting diary KnitterUK Machine Knitting _ _ Obsessed Crafter _ _ talk _ knitting projec
41. Domain
Text
2. Extract Vocabulary from Domain Text
• [logo.jpg] [logo_sepertor.gif] Marketing _ Rings Marketing _ Articles Marketing _ Yellow Pages _
• + ADD _ SITE _ 29 members _ _
• Machine Knit Bloggers Click Member link _ _ site _ tv Machine Knit Bloggers + ADD _ SITE _ 29 members _ _ community _ _
• Requirements _ 1 _ _ blog _ _ existed _ _ _ 2 weeks _
• 2 _ _ _ post _ article _ machine knitting _ _ _ _ _ _ _ _ _ _ posted _ articles discussing machine knitting _
• 3 _ Important _ _ know _ _ paste _ _ Community HTML code _ _ _ display _ _ _ main _ page _ _ blog _ _ _ _ vis
• _ _ put _ _ _ wrong place _ communitysurf _ kick _ _ _ _ automatically checks _ _ code _
• _ _ community hostess _ _ ride _ _
• _ _ suggest putting _ _ _ sidebar _ _ footer _ _ template _
• _ _ paste _ _ _ individual blog article _
• 4 _ _ _ encouraged create _ category _ _ blog _ machine knitting _
• _ _ tha visitors _ find _ machine knitting content _
• _ 5 _ _ _ _ host adult content _
• knutty4knitting Fibrespates _ blog _ knitting _ hand _ machine _ spinning _ dyeing _ weaving _ felting What's knittin _ _ Knit
• _ knit diaper covers _ _ kids clothes _ _ _ strikes _ fancy _
• Jussi's knitting circle Trying _ combine _ love _ knitting _ machine _ hand _ _ _ mad family life _ _ expat kiwi _ Sydney Need
• Free patterns _ techniques _ _ plenty _ eye-candy _
• _ _ nurtucommunityneedles simple sewing _ machine knitting _ examples _ _ marbled fabric.Original patterns _ sewing _ MK _
• Knitting _ _ Rogue River life _ _ _ color _
• Quail Hill Knits _ personal blog explocommunity cut _ sew techniques _ _ hand _ machine knitting _
• Clickertyclick I'm _ South Aussie knitter _ fusion knitting _ _ recently re-discovered Bond :- _ knitting bare _ knitting _ machine _
• _ _ _ convenient package _
• Zeeppo's Knitting Blog _ blog _ _ _ adventures _ _ _ _ _ unashamed male knitter _ Pittsburgh _
• Knitman _ _ knitting dogs _ life Shamrock Knits _ try _ machine knit _ hand knit _ _ crochet _ _ _ _ serious gauge issues _
• LOL Bright Meadow Knits Hand _ machine knitting diary KnitterUK Machine Knitting _ _ Obsessed Crafter _ _ talk _ knitting projec
913 flower
906 crochet knit
904 step
903 check
898 place
897 etsi
897 abl
888 crochet stitch
872 peopl
855 crochet hook
854 sl st
849 peopl found
847 bit
845 wait
843 part
842 decid
833 pull
827 let
827 home
826 ask
825 squar
820 page
819 inspir
807 friend
805 knit pattern
805 good
804 tell
802 side
801 new
42. Domain
Text
3. Compare the vocabulary to ‘background vocabulary’
913 flower
906 crochet knit
904 step
903 check
898 place
897 etsi
897 abl
888 crochet stitch
872 peopl
855 crochet hook
854 sl st
849 peopl found
847 bit
845 wait
843 part
842 decid
833 pull
827 let
827 home
826 ask
825 squar
820 page
819 inspir
807 friend
805 knit pattern
805 good
804 tell
802 side
801 new
43. Domain
Text
3. Compare the vocabulary to ‘background vocabulary’
913 flower
906 crochet knit
904 step
903 check
898 place
897 etsi
897 abl
888 crochet stitch
872 peopl
855 crochet hook
854 sl st
849 peopl found
847 bit
845 wait
843 part
842 decid
833 pull
827 let
827 home
826 ask
825 squar
820 page
819 inspir
807 friend
805 knit pattern
805 good
804 tell
802 side
801 new
Reference
Text
44. Domain
Text
3. Compare the vocabulary to ‘background vocabulary’
913 flower
906 crochet knit
904 step
903 check
898 place
897 etsi
897 abl
888 crochet stitch
872 peopl
855 crochet hook
854 sl st
849 peopl found
847 bit
845 wait
843 part
842 decid
833 pull
827 let
827 home
826 ask
825 squar
820 page
819 inspir
807 friend
805 knit pattern
805 good
804 tell
802 side
801 new
Reference
Text
1361 tell
1318 flower
1232 decid
1101 page
1078 good
1034 step
691 check
461 pull
363 wait
255 etsi
239 bit
194 home
190 peopl found
158 peopl
121 part
44 square
34 knit pattern
30 square
29 crochet hook
16 etsi
12 peopl found
9 crochet stitch
8 page
5 crochet hook
2 able
1 sl st
1 knit pattern
1 crochet stitch
45. Domain
Text
3. Compare the vocabulary to ‘background vocabulary’
913 flower
906 crochet knit
904 step
903 check
898 place
897 etsi
897 abl
888 crochet stitch
872 peopl
855 crochet hook
854 sl st
849 peopl found
847 bit
845 wait
843 part
842 decid
833 pull
827 let
827 home
826 ask
825 squar
820 page
819 inspir
807 friend
805 knit pattern
805 good
804 tell
802 side
801 new
Reference
Text
68294 good
68052 tell
54736 inspir
54319 let
47798 step
38593 wait
29554 pull
1361 tell
1318 flower
1232 decid
1101 page
1078 good
1034 step
691 check
461 pull
363 wait
255 etsi
239 bit
194 home
190 peopl found
121 part
44 square danc
34 knit pattern
30 square
29 crochet hook
16 etsi
9 crochet stitch
5 crochet hook
2 able
1 sl st
46. Domain
Text
3. Compare the vocabulary to ‘background vocabulary’
913 flower
906 crochet knit
904 step
903 check
898 place
897 etsi
897 abl
888 crochet stitch
872 peopl
855 crochet hook
854 sl st
849 peopl found
847 bit
845 wait
843 part
842 decid
833 pull
827 let
827 home
826 ask
825 squar
820 page
819 inspir
807 friend
805 knit pattern
805 good
804 tell
802 side
801 new
Reference
Text
68294 good
68052 tell
54736 inspir
54319 let
47798 step
38593 wait
29554 pull
1361 tell
1318 flower
1232 decid
1101 page
1078 good
1034 step
691 check
461 pull
363 wait
255 etsi
239 bit
194 home
190 peopl found
121 part
44 square danc
34 knit pattern
30 square
29 crochet hook
16 etsi
9 crochet stitch
5 crochet hook
2 able
1 sl st
28 kitchen towel
15 kitti cat
4336 knit
15 knit bag
19 knit book
18 knit fabric
175 knit hat
64 knit item
26 knit loom
94 knit machin
22 knit magazin
106 knit needl
805 knit pattern
161 knit project
25 knit scarf
48 knit scarv
36 knit sock
165 knit stitch
10 knit suppli
34 knit sweater
42 knit techniqu
14 knit yarn
176 knitter
12 knitti
19 knook
48. Domain
Text
4. Create loose hierarchies of domain vocabulary
Reference
Text
28 kitchen towel
15 kitti cat
4336 knit
15 knit bag
19 knit book
18 knit fabric
175 knit hat
64 knit item
26 knit loom
94 knit machin
22 knit magazin
106 knit needl
805 knit pattern
161 knit project
25 knit scarf
48 knit scarv
36 knit sock
165 knit stitch
10 knit suppli
34 knit sweater
42 knit techniqu
14 knit yarn
176 knitter
12 knitti
19 knook
knit>armhole
knit>avid knitter
knit>basic stitch
knit>bead knit
knit>blog post
knit>bobble
knit book>ultimate knit book
knit>bracetti knit
knit>brioch knit
knit>cable knit
knit>cable needle
knit>cable pattern
…
knit>knit group>close knit group
knit>knit group>close-knit group
knit>knit group>loose-knit group
knit>knit group>loosely-knit group
knit>knit group>loos knit group
knit>knit group>tight knit group
knit>knit group>tight-knit group
knit>knit group>tightli knit group
knit>knit group>tightly-knit group
knit>knit hat
knit>knitting industry
knit>knit item
Two terms
appear
together often
Hypernym
more common
49. Domain
Text
4. Create loose hierarchies of domain vocabulary
Reference
Text
28 kitchen towel
15 kitti cat
4336 knit
15 knit bag
19 knit book
18 knit fabric
175 knit hat
64 knit item
26 knit loom
94 knit machin
22 knit magazin
106 knit needl
805 knit pattern
161 knit project
25 knit scarf
48 knit scarv
36 knit sock
165 knit stitch
10 knit suppli
34 knit sweater
42 knit techniqu
14 knit yarn
176 knitter
12 knitti
19 knook
knit>armhole
knit>avid knitter
knit>basic stitch
knit>bead knit
knit>blog post
knit>bobble
knit book>ultimate knit book
knit>bracetti knit
knit>brioch knit
knit>cable knit
knit>cable needle
knit>cable pattern
…
knit>knit group>close knit group
knit>knit group>close-knit group
knit>knit group>loose-knit group
knit>knit group>loosely-knit group
knit>knit group>loos knit group
knit>knit group>tight knit group
knit>knit group>tight-knit group
knit>knit group>tightli knit group
knit>knit group>tightly-knit group
knit>knit hat
knit>knitting industry
knit>knit item
Two terms
appear
together often
Hypernym
more common
SKOS
taxonomy
50. Domain
Text
4. Create loose hierarchies of domain vocabulary
Reference
Text
Two terms
appear
together often
Hypernym
more common
SKOS
taxonomy Search Engine