Advisor Training Day Spring 2012 May 18, 2012

1. ENGAGE Training
Level II Interventionists
Fall Intervention Workgroup:
Joshua Adams, Director of the Learning Center
Julie Kirkland, Assistant Dean of Student Success, CAS
Melissa McGuire, Director of Orientation & Transition Programs
Marilyn Wiley, Associate Dean, College of Business
Laura Cardona, Research Analyst

2. Session Caveat:
• Training today is for Level II interveners for the ENGAGE
project.
• You will be asked to sign up as Level II Intervener after
this training through the coordination of your Associate
Dean.
• We wanted you to be informed of the expectation and the
time commitment before agreeing to be an intervener.

3. Agenda
• Purpose of the Intervention
• Administration of ENGAGE
• Intervention Plan for Fall 2012
• Level II Intervention Plan
Please reserve all questions for the end of
the training. Thank you.

4. Purpose of Intervention
• Why Intervene?
Provide best possible experience to students
Provide support based on student’s needs
Research supports intervention

5. Why ENGAGE?
• ACT Study in 2004
400 retention studies were reviewed, 109 met criteria
9 broad categories which have been translated to the 10 categories
in the ENGAGE
• APA Study in 2012
13 years of research reviewing 7,167 articles on retention
“A large correlation was observed for performance self-efficacy,
which was the strongest correlate (of 50 measures) followed by
high school GPA, ACT, and grade goal”
• ACT study 2010
Lists “advising interventions with selected student populations” as one
of the top five most effective retention practices for four-year
public universities
• ACT Engage Research
Tracked 14,000 at 48 postsecondary institutions
Results showed that ENGAGE is a valid predictor of student
persistence

6. UNT’s Retention Model
UNT’s retention model was developed to identify
first time in college students who are likely to
benefit from an early intervention.
The model was developed using advanced
statistical techniques designed to increase model
accuracy and stability.
One retention model is conducted per academic
department.
Different predictors are likely to be significant for
each academic department

7. • The model uses varied data available to the institution
before a students’ first day of classes
-This data includes psychosocial factors (ENGAGE)
-Academic performance: HS percentile and SAT score
-Other variables: Pell eligibility, orientation attended, total
credits, HS class size
-It is possible for students who did not complete ENGAGE to
be placed in the intervention group because of varied
information entered in to the predictive model
-Students who do not complete ENGAGE and those who
have an invalid ENGAGE profile (e.g. gave the same answer
to all questions) will be automatically placed in the
intervention group as these outcomes signal issues with
following directions, motivation, and commitment

8. UNT Results
Fall 2011 Intervention ENGAGE results
Group Mean GPA Significance
Treatment 2.36 P <.0001
Control 1.84 P <.0001
Fall 2011 Intervention ENGAGE results
Group Retained Not Retained
Treatment 190 (91.79%) 17 (4.11)
Control 163 (78.74%) 44 (21.26%)

9. Administration of ENGAGE
• On-Line
Communication with Students
• Orientation
Computer Labs

10. Intervention Plan
Level 1
– First Flight/Week 1 (August 25 – August 31)
– Target: All new freshmen
– Interveners: Staff from across campus
Level 2
– Weeks 2 and 3 (September 4 – September 14)
– Target: At-risk freshman population (approximately 1,000 students)
– Interveners: Faculty and staff from across campus
Level 3
– Weeks 4 and 5 (September 17 – September 28)
– Target: At-risk freshman not reached in Level 2
– Interveners: Core group of faculty and staff from level 2
– A more “intense” attempt to contact
Ultimate goal for the ENGAGE project is to reach 100%
of our at-risk freshmen by the end of week 5.

11. Level II Intervention Plan
• Access reports
• Student Communication
• Student Appointments
• Data Entry

12. Excel Tracking Sheet
• Joshua Adams will send by September 4th
• Data entry will be explained later
Student EMPLID Phone Email Attempt 1 Date Attempt 1 Type Attempt 2 Date Attempt 2 Type Attempt 3 Date Attempt 3 Type Final Outcome
1234567
Eagle, Scrappy 8 940-xxx-xxxx scrappy.eagle@unt.edu 8/25/2012 Phone 8/27/2012 Email 8/29/2012 Phone Met in person
Attempt 1 Attempt 2 Attempt 3 Outcome
Attempt 1 Attempt 2 Attempt 3 Outcome
Attempt 1 Attempt 2 Attempt 3 Outcome
Attempt 1 Attempt 2 Attempt 3 Outcome
Attempt 1 Attempt 2 Attempt 3 Outcome
Attempt 1 Attempt 2 Attempt 3 Outcome
Attempt 1 Attempt 2 Attempt 3 Outcome
Attempt 1 Attempt 2 Attempt 3 Outcome
Attempt 1 Attempt 2 Attempt 3 Outcome
Attempt 1 Attempt 2 Attempt 3 Outcome

13. Accessing ENGAGE Reports
• All reports uploaded to SharePoint site
• An email will be sent with the website and log-in
information
• Search by name or EMPLID
• Look for EUID folder
• Interveners will only have access to student
reports
• Some students may not have an ENGAGE report

14. Student Communication
• Three Attempts
1st attempt: Phone or in-person
2nd attempt: Text, e-mail or in-person
3rd attempt: Phone, e-mail or in-person
• Scripts provided
• Begin attempts as soon as possible
• 48 hours between attempts
• Attempts need to be completed, data
entered and sent to Joshua Adams by
September 14th

15. Preparing for Student Appointments
• Trainer Disclaimer
• ENGAGE used as a resource ONLY
• Interventionist reviews the ENGAGE and crosswalk
before appointment
• Decide which open-ended question from “Capitalize on
Strengths” and “Make Plans for Improvement”
Sample Student Report
Review Crosswalk
Work in progress. If you have any
recommendations on the questions, they can be
changed.

16. Meeting with Student
• Open with a strengths question
• Segway into an improvement question
• Cover appropriate resources
• Review SAP with student
• Need to schedule a follow-up?
Meetings need to completed by September 21st

17. Data Collection
• Utilize drop-down menus to complete file
• Result of Contact:
• What you discussed
• What happened in the meeting
• Referral offices
• Additional Information:
• Any relevant information
• Note: Follow-up by another individual will NOT be
made based on the Excel file contents
• Limit your responses to 50 characters
• Email completed Excel file back to Joshua Adams
by 5:00 PM on September 14th

18. Questions?
Thank you
ENGAGE