Over the last year, the OSP community has done some interesting work on describing the portfolio requirements of an assessment scenario. It encompasses setting up learning/competency objectives, guiding students in the construction of artefacts, providing simple forms for rubrics-type feedback and evaluation and generating appropriate reports. In this presentation, we demonstrate a Sakai OAE type environment currently in development at MATI Montreal that addresses all these needs. Key to this work is the use of open source solutions for building forms, sequencing tasks, and generating reports using a unique competency gradebook.

1. Assessment Portfolios: Answering Users’needs in a Sakai OAE Type Environment Jacques Raynauld, Faculty, HEC Montréal and MATI Montréal

2. Overview Short history – link to the community Sakai OAE vs US Portfolios and OSP : the needs Short Demo of a proof of concept (activity) Building blocks CompetencyGradebook Road-map 2

3. Context of the session MATI Montréal is a research center for HEC Montréal, École polytechnique and University of Montréal Started a strategic initiative on guided- assessment portfolios in 2008 – manyschoolsinvolved 3

4. Context of the session Activelyparticipated to the Sakai portfolio community Presentation at the Sakai Denver Conference : Learning portfolios : a structured approach Choose a Sakai OAE type framework for development Complementary …knowing that OAE team is working on free form portfolios (NYU) 12th Sakai Conference – Los Angeles, California – June 14-16 4

5. Sakai OAE vs US jQueryJavascript + widgets TinyMCE free form editor Sling REST API noSQL back-end Google WebToolKitjavascriptwidgets Model-based structural editor Sling REST API Jack-Rabbit Slight interface differences Use of external open source tools (ORBEON, EMaEval) 12th Sakai Conference – Los Angeles, California – June 14-16 5

6. Portfolios and OSP Portfolios answermanyneeds: assessment and presentation (free-form) Discussion over the year: personas, sce-narios,use cases mini-specsrevolvearound Competency/learningoutcomes Artefact construction by students Reflection/Feedback Rubric/Evaluation 12th Sakai Conference – Los Angeles, California – June 14-16 6

7. Portfolios scenarios Although the needs are similar, ourexperienceso far isthat all portfolios are slightlydifferent Need a very flexible tool! 12th Sakai Conference – Los Angeles, California – June 14-16 7

8. Demo 8

9. Simple demo – proof of concept Playing the portfolio Student Tutor Reports Creatingformsusing ORBEON Creating the portfolio structure CompetencygradebookEMaEval 9

10. Demo MATI portfolio Editor OrbeonForm Server Sling EMaEval – CompetencyGradebook Front-end GWT To create and fillforms Back-end – data persistence and workflow Manage competencyframework, competencyrelatedtasks for students, tutors, 12th Sakai Conference – Los Angeles, California – June 14-16 10 Set of Web services thatlink the differenttools

12. July 2009 10th Sakai Conference - Boston, MA, U.S.A. 12 All these entries are activities to beexecutedsequentially by the actors

13. July 2009 10th Sakai Conference - Boston, MA, U.S.A. 13 Sakai OSP cell interface

14. Key building blocks – a model-based approach to portfolios 14

15. Key building blocks Resources? Types? Assembling the resources: creating activities Views (matrices) Roles? Instructor, tutor, student Workflow Export Reports and the competency gradebook

16. 1. Resources 1. Resources Text Files (Power Point, PDF, Doc, videos, etc.) URL Comments Forms 16

17. 1. Resources 17 Learning outcomes/competencies Civic knowledge & engagement (local & global) Creativethinking Criticalthinking Ethicalreasoning & action Foundations & skills for lifelonglearning Information literacy Inquiry & analysis Integrativelearning Interculturalknowledge & competence Oral communication Problemsolving Quantitative literacy Teamwork Written communication Association of American Colleges and Universities http://www.aacu.org/

18. 1. Resources 18 Rubrics (forms) Association of American Colleges and Universities http://www.aacu.org/

19. 2. Assembling the resources 19 Organizing the resources according to a model approach Structure Unit Context Resources Root Structure Unit Context Resource

20. 2. Assembling the resources - OSP 20 Root Structure Competency 1 Porfolio Unit Context Instructions Text file Year1 Resource Competency 1 Competency 2 Submit form Form to submit the artefact (student) Year 2 Competency 1 Competency 2 Evaluation Grading rubric form (tutor)

21. Competency 1 Instructions Text file Submit form Form to submit the artefact (student) Evaluation Grading rubric form (tutor) 3 - Matrice view For us, matrices are a view (differentpresentation) of the information alreadyavailableelsewhere. 21

22. 4. Role Very important - in anylearningactivity, the student an be an editor, an evaluator, writecomments, etc. 12th Sakai Conference – Los Angeles, California – June 14-16 22

23. 5 - Workflow Our workflow are codedmanuallyusingSling but playeddynamicallyplayed Nextstep: use a workflow standard like XPDL and a workflowengine (Bonita) 12th Sakai Conference – Los Angeles, California – June 14-16 23

24. 6- Export Vous have a project to export in the LEAP2A standard 12th Sakai Conference – Los Angeles, California – June 14-16 24

25. 7. Reports and competencygradebook EMaEvalis an open source environmentthatisspecialized for competencyevaluation (Pentila – Savoie - usedextensively in France) Competencyframework List of competencyrelatedactivitieswithactorsinvolved Tracks and saves the results Can generate reports and certificates (accreditation) 12th Sakai Conference – Los Angeles, California – June 14-16 25 Highly flexible model basedapproach – cantackleverydifficults scenarios

26. 6. Reports and competencygradebook We are going to writespecialed Web services to leverage all the EMaEvalpossibilities 12th Sakai Conference – Los Angeles, California – June 14-16 26

27. Road-map Proof of concept isworking fine – weunderstand the wholechain Small Pilot with the engineering school in September (faculty of education?) Numeroussmaller pilots withourmock-up engine More stable and robust application nextyear 12th Sakai Conference – Los Angeles, California – June 14-16 27

28. Road-map Weshould report on the variousexperiments Any questions? Comments? Ideas? 12th Sakai Conference – Los Angeles, California – June 14-16 28