This session will provide hands-on training to set up, administer, score and monitor the NAF SCAS End-of-Course exams and Culminating Projects. Savvy and experienced academy teachers will share tips about how to simplify the use of the SCAS online assessments. Participants will have an opportunity to practice those tips and to set up fall classes with the assistance of NAF staff. Participants will also learn how to find and use the information reported in the system. Bring your class schedules, class rosters and your SCAS questions to practice using your class information. Be ready for the new school year!
2. SCAS Hands-On: Getting Ready
for the EOCs
Kevin English
Cheryl Burns
Karlene McCormick-Lee
July 2014
3. Agenda
• Getting To Know Each Other – Kevin
• SCAS Update – Karlene
• SCAS End-Of-Course Exams – Kevin
• The Good, The Bad - Cheryl
• Opportunities, Challenges, and Solutions – Cheryl
• SCAS Online – Kevin
• SCAS @ NAF NEXT – Kevin
• Questions - Kevin, Cheryl, Karlene
Getting Ready for the EOCs
4. • What is your role?
• Are you in the same role this year as next?
• Have you used SCAS before?
• Are you comfortable with online testing?
• Do you remember your log in?
Getting Ready for the EOCs
5.
6. Student Certification Assessment System –
SCAS
• A Rigorous Certification
• A Secure Assessment Program
• A Measurement of College and Career
Readiness
• Aligned with Industry Standards
• Designed with National Curriculum and
Assessments Experts
• Developed with NAF Network Input
What SCAS is…
7. • A Learning Management System
• A District Student Information
System (SIS)
• A Student Portfolio
• A Lesson Planning Tool
• A Formative Classroom
Assessment
What SCAS is NOT…
10. Number of Unique Students Starting an
Assessment in SCAS
SCAS By The Numbers…
11. Number of Academies that had students
complete one or more CPACs, EOCs, or
Internship Assessments (IAs): 9/12 - 2/14
• AOF 40 academies
• AOHT 26 Academies
• AOIT 20 Academies
• AOE 6 Academies
SCAS By The Numbers…
12. • Online System
• Policy and Practice
• Training and Outreach
• Value Add
Where NAF Is Going With SCAS
14. Policy and Practice
• Straightforward messaging
• Transparent requirements and
expectations
• Clear, defined processes
• Frequent and early updates
Where NAF Is Going With SCAS
15. Training and Outreach – Fall 2014
• Pilot Assessments
• District Champions and Power Users
• District Coaching
• Webinars
• Resources
• Technical Assistance and Support
Where NAF Is Going With SCAS
16. System Enhancements
• Class Roster With Raw Scores
• Internship Assessment Visibility
• Click/Dropdown To Enter Students
• Report Development
• PDFs
• Online, On Demand
Where NAF Is Going With SCAS
17. Adding Value and Benefits
• Post Secondary Partnerships
• Business Partnerships
• State Partnerships
• District Partnerships
Where NAF Is Going With SCAS
19. NAF Student Certification is issued upon
graduation to a student who has:
• Completed four (4) NAF courses receive a
passing score on each of the four (4)
culminating projects and end of course
exams or end of course exams in 2 year-long
courses in the case of AOE
• Received a satisfactory rating on the
internship assessment.
• Met all local high school graduation
requirements at a level required for
admission to its state’s public postsecondary
institutions (four-year, two-year, and
community colleges).
SCAS Requirements…
20. • What was easy?
• What was hard?
• What will I never do
again?
• What do I wish I had
done the first time
around?
The Good, The Bad
22. Roles
• District SCAS Administrator
• Academy SCAS Administrator
• School Technical Support
• Teacher
Everyone Has Role
23. • Technical Support
• Perform System Checks
• Download Secure Browser
• Use Excel Spreadsheets
• Maneuver in Online Database
• Upload Files
• Excel, CSV, PPT, Word, Videos
End-of-Course Exams
24. Timing
• Before Course
• During Course
• Before Exam
• Day of the Exam
• After Exam
Timing is Everything
25. Timing
• Before Exam
• Create and Manage Classes
• Calendar Dates
• Review Materials and Resources
• Culminating Project
• System Check
• Secure Browser
Timing is Everything,
26. • All EOCs
• Assess 16 Critical Learning Objectives
• Contain 32 Multiple Choice
Questions(MCs) + 3 MCs in field test
• Include 4 Constructed Response
Questions (CRs) + 1 CR in field test
• Total 40 Questions
End-of-Course Exams
27. Scoring
• Multiple Choice Items are scored
immediately by the system
• 1 Pt. per Correct Answer = 32 pts.
• Field Test Items Not Scored
• Contracted Response Items must be
scored by the teacher
• Scoring Rubric
• 2 Pts. Possible Per Answer = 8 pts.
End-of-Course Exams
39. • To participate in SCAS or for
information about SCAS training,
contact a member of your NAF
Instructional Management Team.
• “Help” section with tips regarding
several key activities.
Where To Find SCAS Information
40. • Internet Testing Systems (ITS) support
team is available Monday through
Friday from 8 am to 5 pm EST online,
via email or by phone.
• An online request for assistance can
be submitted when logged into the
system. The ITS support email
is NAFsupport@testsys.com and
phone is 1-800-514-8494.
Where To Find SCAS Information
41. • If you have questions about
SCAS general practices or
continue to have difficulty, please
contact SCAS@naf.org.
• Join us for the SCAS Panel
Session: Unique Solutions and
Practical Ideas
• Today @ 3:00PM
Where To Find SCAS Information
Kevin
Hand out the Role and Calendar – Karlene will revise and print
Kevin
Hand out the Role and Calendar – Karlene will revise and print
Where to get help and information on this …..open lab times
The End of Course Exam for every course is constructed in exactly the same way.
16 course learning objectives are selected for assessment using the end of course exam. These 16 must be important, they must be assessable using multiple choice and short answer constructed response item types, and they must be evenly distributed over the units into which the course content has been organized.
The selected learning objectives have been vetted by industry representatives for importance relative to subject matter and course content.
The individual items have been reviewed by both industry representatives and experienced teachers for appropriateness.
The Scoring Rubric for Constructed Response Items is very simple. Each CR item requires two answers, and each answer is worth 1 point.
The sixteen learning objectives, with their locations in the curriculum, that are assessed with the EOC, are listed in the Admin Guide for Student Certification for each course.
Here is a partial listing for Principles of Information Technology.
The index number of a learning objective identifies the related
Unit and Lesson and is your key to locating course content assessed with the End of Course Exam.
Must use a secure browse to access the EOC
Do NOT type the URL…… must access via secure browser
Log in
Click Student access Help
Students will need their ID, School Code and the Proctor Password
Log in
Click Student access Help
Students will need their ID, School Code and the Proctor Password
TIP – Write the School code and Proctor Code on the Board
Next button will advance the screen from question to question
The Pause button will prompt the student to click OK or Cancel.
Clicking OK on the Pause button will:
Save the students completed responses
Save the location in the exam, and
Exit the student form the exam.
To restart the exam after pausing, students will have to go through the complete login process, including entering the Proctor Password.
Click Cancel to stay in the exam if the Pause button was accidentally pressed.
Help button will provide reminders about key features during the exam period
Help button will provide reminders about key features during the exam period
Review button allows the student to review skipped or marked exam items
Marked button allows the student check mark an item for closer review at a later time
Strikeout feature allows the student to eliminate rejected answers while reviewing an item.
Possible LABELS in the EOC Not Started, Incomplete – Means that the MC portion was not started or not complete
MC complete but CR not answered – Roll over to see MC Score
Click to Score ---- to score the RC ONLY
CANNOT see the MC questions or answers an ANY TIME.
CANNOT see the actual MC questions or answers an ANY TIME.
Click to Score ---- to score the RC ONLY
Review CR Scoring Guide to ensure consistency and accuracy when scoring the CR items
Note a practice CR item with scoring notes is contained within the Administrative Guide for the Course Assessment, located in the Help section of the SCAS.
CANNOT see the actual MC questions or answers an ANY TIME.
TOTAL Score only ….. CANNOT see the actual MC questions or answers an ANY TIME.