An early result on an evaluation on teachers' tags by expert indexers. Looking good for tags!

1. Tags by teachers - what's expert indexers' opinion on it? Riina Vuorikari European Schoolnet Eminent 2008

3. searchability , having the search tools in place to use that metadata. Barritt, C. and F. Alderman (2004). Creating a Reusable Learning Objects Strategy. San Diego, Pfeiffer.

6. What is a tag?

8. Usually by a user , not a librarian or other expert indexer

9. Personal marker to help associate with the resource

10. Can be used for sorting or managing

11. Provides identifier and/or description – easy to get back!

14. Tags used 1994 times in 670 favourites

15. Tags associated with 463 distinct resources

16. 85 users 1 interactive 50 2 geschiedenis 47 3 Romeinen 43 4 latijn 43 5 Rome 41 6 koolielu 41 7 English 40 8 Romein 33 9 esl 19 10 history 16 11 culture 16 12 efl 15 13 vocabulary 14 14 quiz 13 15 subjonctif 12 16 grammar 11 17 Geografi 10 18 animation 10 19 London 9 20 fizika 9 21 angol 9 25.1% of all tags 501

17. Evaluation of tags by experts How useful are the tags created by users (e.g. teachers) as metadata descriptors to describe learning resources?

20. Answers gathered in November 2008

22. 23 thesaurus terms/ 89 tags Number of Thesaurus terms Number of Tags 5 3 4 9 3 13 3 6 2 7 2 5 1 15 1 18 1 7 1 6 23 89

24. Evaluation of tags by experts Each resource had a link and 3 questions Q2. The current indexing keywords are: xx, xx. Would you want to revise the original LOM description of the resource and, if so, which of the following terms might you adopt? Q3. Below you can find teachers' keywords. Compared to the current indexing words (xx), estimate their additional value as descriptors. Scale 1 to 5 (Does not add any useful information - Adds very useful information) Option: “I don't understand the word”

26. 401 votes from experts

27. We use percentage of votes/resource Both SD quite low, which indicates a low variance in the views of the experts (high agreement) n=401 Thesaurus Tags Average votes 44% 29% Standard dev 0.29 0.24

29. 265 votes from experts

30. We use percentage of votes/resource Most voted tags are relevant for expert indexers too! n=265 Thesaurus Tags Average 44% 65% Standard dev 0.29 0.14

32. 1 interactive 50 2 geschiedenis 47 3 Romeinen 43 4 latijn 43 5 Rome 41 6 koolielu 41 7 English 40 8 Romein 33 9 esl 19 10 history 16 11 culture 16 12 efl 15 13 vocabulary 14 14 quiz 13 15 subjonctif 12 16 grammar 11 17 Geografi 10 18 animation 10 19 London 9 20 fizika 9 21 angol 9 25.1% of all tags 501 Most used tags in MELT Discrepancy between users' needs and expert thinking..

35. Evaluation of tags by experts How useful are the tags created by users (e.g. teachers) as metadata descriptors to describe learning resources? A very provisional answer: they seem useful , but let's wait until the end of the story...

36. social bookmarks Metadata LOM tags folksonomy social tagging multi-linguality social classification thanks ! for your attention learning resources user communities discover resources and item s questions ? teachers social navigation social traces paths , trails flock