2. Criteria in DL evaluation
•in DL: no basic or
standardized criteria, no
overall agreement
2
3. In digital libraries:
•performance (effectiveness, efficiency)
on basis of given criteria
•performance could be related to
usability.
•The performance of the system
depends strongly on the formats,
structures and representations of
the content.
3
4. • Usefulness
---which concerns the “User” and
“Content” components. The usefulness
of the content and its relevance to the
user tasks and needs are the reasons
behind the selection and usage of a DL.
This relevance is translated into actual
relevance, type and level of resource
relevance and task relevance.
6. 6
• Jacob Nielsen (usability guru)
• definition:
“Usability is a quality attribute that
assesses how easy user interfaces are
to use. The word "usability" also refers
to methods for improving ease-of-use
during the design process.”
7. Six Classes of Criteria for DL
Evaluation Derived From Literature
•content
– how well are digital collections
selected, developed; objects created,
organized, represented, presented
8. • technology
• how well do hardware & software
support library functions
• Interface
– what is available for users to
interact & how much is interaction
supported or hindered
8
9. • Process/Service
– what processes & assistance are
provided; what range of services is
available; how well are they
functioning; (carrying out tasks as:
search, browse, navigate, find,
evaluate or obtain a resource)
10. • user
– what are the outcomes of DL use –
changes in human information
behavior, cognitive state, decision-
making, problem-solving; impact on
accomplishing tasks; broader
impact/benefit in research,
professional work
11. •context
– how well does a DL fit into,
respond to, follow larger
context – institutional,
economic, legal, social,
cultural; effects on context
11