InnoMotion - CHI Student Design Competition

1. InnoMotion
A Web-based Rehabilitation System Helping Patients
Recover and Gain Self-awareness of Their Body Away
from the Clinic
Project website: http://chi-goloko-team.wix.com/innomotion
CHI Student Design Competition 2014
Luxi Chen, Ni Yan, Miranda Kiang, Anna Muth, Kruthi Sabnis Krishna
School of Information, University of Michigan

2. InnoMotion Overview
Patient
Therapist
Do exercise
Review therapy progress
Homepage
Review patient’s progress
Provide instruction
Exercise & Progress
Patient’s Progress

3. InnoMotion Overview
1. Rich interactions through gesture, voice and touch

4. InnoMotion Overview
2. Practice Therapy Exercise
Instant Feedback
During Exercise
Click and
Change
Assignment
See Today’s Progress
Instruction Video
To See Correct
Gesture

5. InnoMotion Overview
3. Track Rehabilitation Progress
Overview
Progress
Benefits from
Progress

6. InnoMotion Overview
4. Get Exercise Instructions
Receive Feedback
From Therapist
Receive Feedback
From InnoMotion
System

7. Process
Definition
Design Problem Definition
Problem Scoping
Evaluation
Ideation
Sketches
Storyboards
User Testing (Med-Fi)
User Testing (Hi-Fi)
Research
Prototype
User Interview
Affinity Wall Building
Conceptual Mapping
Persona and Scenario
Wireframe
Med-Fi Prototype
Hi-Fi Prototype

8. Research
Interview
5 patients
1 physical therapist
1 occupational therapist student
2 professors
5 patients, 1 physical therapist, 1 occupational therapist student and 2 professors were interviewed. We
concentrated on understanding the therapy process, the challenges faced while patients practiced
therapy at home and the kind of communication that the patients have with the therapist. All the data
collected was analyzed by building an
affinity wall.

9. Affinity Wall
Video:
https://www.youtube.com/watch?v=ioqjVUBE1uc

10. Findings from Affinity Wall
1. Is not motivated by virtual prizes
Motivation
2. Wants meaningful rewards to keep him/ her motivated
3. Pretty painful procedure to stay motivated
1. Worried about doing exercise right at home
2. Needs continuous feedback from the therapists which costs a lot of
money
3. Does not want to share the exercise details with anyone other than
therapist
Progress
Tracking
Quality
of
Exercise
1. Cares about milestone progressing.
2. Tries to reach the end goal as soon as possible.
3. Needs a reality check at all times.
1. Needs a way to track patient’s progress data.
2. Doesn’t want to have overloaded documentations
3. Needs a better way to teach the exercise to the patient remotely.
Therapy
View

11. Selected Personas
Age: 32
Gender: Male
Occupation: Business Executive
Income: $200,000 a year
Family status: Single (and lovin’ it)
Technical proficiency: 4 (Very good)
Length of rehab: Long term (>1 year)
The Patient
Insurance: 30 PT visits per year
Motivation level: 2 (Below average)
Self-train at home: 2 - 3 (Unlikely - neutral)
Frequency of self-training: 2 (Unlikely)
Other caretakers involved: None
Find other patients like him: No
Share story and interact with others: No
Liam
the Business Executive Personality/description:
Liam is an ambitious young business executive who is very goal-oriented. He lives an active life and is always
“I make goals come to
doing something - whether it is a side-venture or attending a social event. He is also an avid outdoorsman, and
fruition.”
loves partaking in outdoor activities. Though he is smart, driven and hard-working, sometimes Liam expects
everything to go his way. Having been very successful in his life/career, he is not used to major setbacks. He is
currently enjoying living as a well-to-do young bachelor.
Injury scenario:
Liam loves rock-climbing and has of late picked up bouldering. While on a bouldering trip to Australia, Liam
found himself at the edge of a precipice, hanging for his life. He had tried to use his right hand to reach up and
grab a jutting ledge, but the rock on the ledge broke and instead deeply cut into his palm, rupturing his degenerative flexor tendon. Luckily, his friends were able to pull him up. However, he now has a serious tendon injury
in his right hand. After undergoing a successful surgery, Liam now faces the challenge of regaining regular
movement in his right hand and has to pretty much relearn all of his fine motor skills.
Image Credits:
http://us.123rf.com/400wm/400/400/nyul/nyul0911/nyul091101045/5983126-casual-businessman-talking-on-mobile-ph
one-isolated-on-white.jpg

12. Selected Personas
Age: 29
Gender: Female
Occupation: Occupational Therapist
Specialization: Hands and upper limbs
Technical proficiency: 4 (Very good)
Job Level: Seasoned therapist
The Therapist
Motivation to learn tech: 4 (Good)
Other teammates: Supervisor and three other
therapists on team
Number of patients: 15-20
Interact with patients online: Yes
Network with other professionals: Yes
Access to patient data online: Yes
Jenny
the Therapist
“Persevere and you will
see results.”
Personality/description:
Jenny loves helping people - which is what led her to study therapy in the first place. Growing up, her father
had lost his left hand in a logging accident. She saw how diffi- cult it was for him to do his daily tasks because
he lost his left hand. Despite this diffi- cult adjustment, her dad managed to overcome his disability and ended
up switching careers to become a successful businessman. Inspired by her father’s story, Jenny hopes to be
able to motivate and help others cope and get their lives back on track. She is very optimistic, understanding,
encouraging and empathethic.
Injury scenario:
Jenny, on average, sees about 15-20 different patients at one time. More often than not, many are returning
patients. The clinic she is working at is expanding, but has a shortage of therapists. Everyone is expected to
take on at least 5 more patients. Given this mandate, Jenny has to be as efficient as she can be, while still providing the best care. She wants to see her patients get better and adapt healthily, but often notices the inefficient
appointment system her office uses. Many times a patient would be given home exercises to practice, but
come in for the next appointment not ready to move on. This wastes their insurance therapy allotment, while
not allowing them to progress and gain independence as soon as they can. Jenny is hoping there is a system
out there that can help.
Image Credits:
http://static.facegfx.com/2013/sweet-smiling-female-doctor-image-download_247526736.jpg

13. In the initial stages, the findings from the affinity
wall were mapped to the different features the
application should have and a conceptual map
was built. Each of the team members
sketched out several different ideas
using this conceptual map.
Ideation
Conceptual Mapping

14. Ideation
Sketches
The idea of building
the real world
experience into the
application originated
during these sketching and
design brainstorm sessions.

15. Ideation
Design Brainstroming
We drew a number of
sketches around the idea of
data visualization and
patient and therapist portal.

16. Exercise
Music
1
Exercise
Senario
(Music)
3
2
4
After
brainstorming
for various
designs for
the exercises,
we decided
that all the
exercises
should be
built around a
common
topic such as
music, sports
etc.

17. Exercise
Music
We choose
music as our
exercise
design topic.
Exercise
Demo
Exercise Design Demo:
http://vimeo.com/83521662
Each exercise
is a music
game with
notes and
scores.

18. Sitemap
The collective set of scenarios and features were mapped onto a user work
flow model as shown.

19. Liam's hand surgeon and doctor refer him to a therapist for physical
therapy.
The therapist makes the decision that Liam needs to do exercises involving
grasping and wrist rotation. She asks Liam to do exercises three times a day
and estimates his two-week progress.
When Liam goes back and starts exercises at home, the system already has
an account and exercise plan set up for him.
Scenario
1

20. Wireframe
(Scenario 1: Therapist
sets up for a new
patient)
Therapist creates a new
patient profile.
Therapist assigns
particular exercises to the
patient with estimated
therapy time, frequency,
and estimated next
meeting time.
Therapist completes
profile and sends
invitation to patient’s
email.

21. Now Liam has set up the in-home/portable system and is ready to begin!
After practicing diligently, Liam has reached his first goal/checkpoint! Our
system notifies his therapist for approval to continue to the next
exercise/goal.
Liam’s therapist sees the notification, looks at his progress and approves for
him to move on.
Scenario
2

22. Wireframe
(Scenario 2: Patient
practises exercise)
Patient chooses the
exercise and practices;
the system dynamically shows the exercise data which he
can send to the
therapist for verification.

23. Now that Liam knows he is doing the exercises right, he goes ahead with
exercises. The system provides him encouraging words to keep continuing.
The therapist can set up a meeting if the patient needs new exercises or
any consultation/guidance.
Scenario
3

24. The system detects the patient has reached the first checkpoint and
displays his progress and explains what he can do to start leading a normal
life like he used to before the injury.
The system notifies patients that the system has sent a notification to the
therapist with information about a patient’s progress, and requests
permission for patient to move onto next exercises.
Wireframe
(Scenario 3: Patient
tracks progress)

25. Another month has now passed, and Liam is getting frustrated
that he hasn’t reached his next checkpoint.
He thinks he is doing well, and performing all the exercises correctly, but he is far from his next goal.
He begins to get bored and loses motivation.
Scenario
4

26. When the patient stops working out because of lack of motivation, the
system alerts the therapist.
The therapist can set an appointment to motivate the patient or send in
words of encouragement.
Wireframe
(Scenario 4: Therapist
manages patients)

27. His therapist receives notification that Liam is not exercising very
frequently. She checks Liam’s current progress and sends an
encouraging e-mail to Liam.
Liam also receives an encouraging e-mail from his caregiver who
receives notification that he didn’t complete the tasks frequently.
Liam sees these messages, and decides to continue his exercises.
He is again motivated and ready to work hard to regain full control of his hand.
Scenario
5

28. Patient receives alert and motivation email from our system, caregiver and
therapist.
InnoMotion system will try to motivate patient from different perspectives
including listing benefits of continuing exercise, other patient’s successful
case and also listing potential loss of giving up exercise...etc.
Wireframe
(Scenario 5: Patient is
motivated to do
exercises)

29. Med-Fi Prototype
Patient Portal
Interaction Demo:
http://www.youtube.com/watch?v=xj75V19zdHo

30. Med-Fi Prototype
Therapist Portal
Interaction Demo:
http://www.youtube.com/watch?v=A87GENYXS10

31. Design Evaluation
For Med-Fi Prototype
We performed usability tests using medium fi prototype with two patients and one therapist and we used the learnings
from these tests to improve our high fidelity prototype

32. Design Evaluation
For Med-Fi Prototype
Pre-test questionnaires and post-test questionnaires gave us an idea of the features that the users like/ dislike.

33. Learning from Evaluation
For Med-Fi Prototype
Patient 1 : “There is a problem understanding exercise instructions. It
will be helpful to have images involved in instruction.”
Patient 1
Patient 1: “There is no feedback on the quality of the movement
during the exercise. I wish numbers would change while I do the
exercise.”
Patient 2: “It is hard to click buttons because of the injury. So it would
be better to have less buttons and have more hand gestures and
voice command or other possible controls for Leap Motion.”
Patient 2: “Bar charts are boring. Users wanted to understand the
exercise data and wants to see more realistic targets, more than just
a doorknob.”
Therapist 1
Therapist 1: “Want some additional space for notes on the exercises to
give to patients.”
Patient 2

34. Hi-Fi Prototype
Prototype Link:
http://anniedream.com/InnoMotion/
Demonstration Video Link:
http://chi-goloko-team.wix.com/innomotion
Note: There is a difference between original interface with implemented Hi-Fi prototype

35. Design Evaluation
For Hi-Fi Prototype
In the high fidelity prototype,
1. Added a feature for the data to update
dynamically while the patient performs exercises
2. Changed the instruction format
3. Added innovative exercise designs to keep
the patients motivated
We performed the second round of user
testing with 3 patients and 2 therapists.

36. Learning from Evaluation
For Hi-Fi Prototype
P1
Patient 1: “I like that I can receive messages from my therapists; that
way I know I am doing the exercise right or wrong.”
P2
Patient 2: “Real world target visualization tells me when I can actually
start doing my work like I used to. That is very helpful, It keeps me
motivated.”
P3
Patient 3: “I want to be able to compare my performance against
others with my condition so that I can be more motivated to complete the therapy, so I like that feature a lot.”
Therapist 1: “Likes recommended exercises. Encourages patients to
work extra hard.”
T1
Therapist 2: “I think this is a great idea and can be used to help more
people do exercises easily.”
T2

37. Design
Inspiration
MiChart
S H Brown
University of Michigan Health
system’s clinic data
management portal
Remote monitoring and
quantification of upper limb
and hand function in chronic
disability conditions
Image Credits:
www.med.umich.edu
www.businessinsider.com
http://play2learn2play.com
Leap Motion
Depth Sensing
Camera
Play2Learn2Play

38. Future
Work
Influence
Health
System
Patients loved the idea of the application. Say if this was to be mass
produced, the ideal situation would be that the therapists provide
the patient with the Leap Motion device and the web application can
be easily downloaded by any patient.
Explore
Technology
Limitation
This application idea can be extended to other technologies, like Wii,
so that we can extend the impact of the application to other body
parts as well.