At a "Quantified Self and Science" meetup, Yoni Donner talks about the issue of valid assessment.

1. Valid assessment
• We want our measurements to be reliable and relevant. How do we verify that?
• Cognitive assessments
• Quantified Mind: www.quantified-mind.com
• Over 20 cognitive tests aiming to cover multiple distinct cognitive skills, grouped into short
batteries
• Tests are short and fun, but...
• How do we know that they measure what we care about?

2. Validity of Quantified Mind
(www.quantified-mind.com)
• Reliability
o For Quantified Mind, most tests have reliability > 0.8, some even over 0.9
§ Affected by duration - not bad for 1-minute tests
• Face validity
o E.g. reaction time, mental rotation
o Works best in combination with high reliability
• Borrowed validity
• Criterion validity
• Experimental results
• Future experiments
• And much more: yonid@stanford.edu