SlideShare une entreprise Scribd logo
1  sur  36
Télécharger pour lire hors ligne
INVERTING CRITIQUE: 

EMERGENT TECHNOLOGICALLY-MEDIATED CRITIQUE
PRACTICES OF DEVELOPING DESIGN STUDENTS
COLIN M. GRAY
Purdue University
CRAIG D. HOWARD
University of Tennessee—Knoxville
Gray, C. M., & Howard, C. D. (2015, June). “Why are
they not responding to critique?”: A student-centered
construction  of the crit. In  LearnxDesign: The 3rd
International Conference for Design Education
Researchers and PreK-16 Design Educators.
Chicago, IL: School of the Art Institute of Chicago.
PRIOR WORK
CRITIQUE
is central to design education
[Anthony, 1991; Dannels & Martin, 2008; Klebesadel &
Kornetsky, 2009; Parnell, Sara, Doidge, & Parsons,
2012; Schön, 1987; Shulman, 2005]
instructor-centric
curriculum-centric
power-laden
CRITIQUE
is central to design education
[Anthony, 1991; Dannels & Martin, 2008; Klebesadel &
Kornetsky, 2009; Parnell, Sara, Doidge, & Parsons,
2012; Schön, 1987; Shulman, 2005]
[Anthony, 1991; Blythman, Orr, & Blair,
2007; Dutton, 1991; Gray, 2013, 2014;
Gray & Howard 2014; Webster, 2007;
Willenbrock, 1991]
CRITICAL
FRAMING
what if we looked at
critique in a
[Anthony, 1991; Blythman, Orr, & Blair,
2007; Dutton, 1991; Gray, 2013, 2014;
Gray & Howard 2014; Webster, 2007;
Willenbrock, 1991]
CRITICAL
FRAMING
what if we looked at
critique in a
contextualized 

with
PEER ASSESSMENT,
DEVELOPMENT OF
DESIGN EXPERTISE &
IDENTITY, CSCL, ETC.
[Easterday et al., 2014; Freeman &
McKenzie, 2001; Lawson & Dorst, 2009;
Schön, 1990; Smith, 2015; Topping, 1998;
Xu & Bailey, 2013]
CRITIQUE & 

CRITICAL PEDAGOGY
CRITIQUE & 

CRITICAL PEDAGOGY
FROM
student as tabula rasa
TO
student as capable,

emerging proto-professional
[Boling, Gray, & Smith, 2015; 

Gray, 2014; Freire, 1970]
CONTEXT
CONTEXT
Human-Computer
Interaction Master’s
program
Introductory project-
based design course
Final project was
based on the 2014
ACM SIGCHI Student
Design Competition
CLASSROOM
=
Physical Space
[~60 student capacity; 8 screens; decentralized layout]
Virtual Space
[Facebook; Google Docs; SMS]
+CLASSROOM
MULTIMODAL
CRITIQUE
multiple critique conversations occur
concurrently around a single designed
artifact (or presentation of that artifact), in
both physical and virtual modes, with
multiple classes or groupings of interlocutors
FIRST-YEAR STUDENT
FIRST-YEAR STUDENT (PRESENTING)
INSTRUCTOR
PROJECTOR/SCREEN
WHITEBOARD
MENTOR (SECOND-YEAR STUDENT)
LIVE MENTOR CRITIQUE IN GOOGLE DOC
verbally
virtually
COMMUNICATION DURING
PRESENTATION
virtually
verbally
verbally
COMMUNICATION DURING
CRITIQUE
verbally
COMMUNICATION PATTERNS
PRESENTATION STUDENT CRITIQUE
MENTOR
CRITIQUE
INSTRUCTOR
CRITIQUE
GOOGLE DOC
CRITIQUE STRUCTURE
1. What volume of critique did this instructional design support?
2. How did the volume of critique generated via digital means
compare to the volume of critique in the physical classroom?
3. What was the nature of critique content that the advanced
students generated?
RESEARCH QUESTIONS
What volume of critique did this
instructional design support?
1
Team Collaborative Google Doc (GD) Backchannel (BC)
# 

Turns [CL*]
Average Words
per turn (SD) Total words
# 

Turns
Average Words
per turn (SD) Total words
Team A 37 [10] 46.4054 (45.6369) 1717 13 5.1538 (4.4695) 67
Team B 26 [4] 25.8462 (21.6079) 672 69 7.3043 (5.7441) 504
Team C 38 [8] 37.1579 (28.9496) 1412 135 7.1852 (6.6968) 970
Team D 9 [1] 36.8889 (21.1332) 332 9 12.6667 (10.3923) 114
Team E 28 [5] 27.2857 (19.0879) 764 4 5.0000 (2.7386) 20
Team F 27 [1] 39.9259 (35.1683) 1078 116 10.3966 (9.1622) 1206
Team G 16 [1] 47.6875 (34.7234) 763 69 7.4058 (7.1431) 511
Team H 30 [4] 28.2667 (28.5668) 848 49 8.8367 (7.3105) 433
Team I 20 [1] 50.3000 (44.6946) 1006  
Team J 19 [3] 31.6316 (20.0846) 601 60 10.6667 (8.3280) 640
Team K 16 [4] 50.4375 (49.0446) 807 61 6.8525 (5.7054) 418
TOTAL 266 [42] 37.594 10000 585 8.3470 4883
Team Collaborative Google Doc (GD) Backchannel (BC)
# 

Turns [CL*]
Average Words
per turn (SD) Total words
# 

Turns
Average Words
per turn (SD) Total words
Team A 37 [10] 46.4054 (45.6369) 1717 13 5.1538 (4.4695) 67
Team B 26 [4] 25.8462 (21.6079) 672 69 7.3043 (5.7441) 504
Team C 38 [8] 37.1579 (28.9496) 1412 135 7.1852 (6.6968) 970
Team D 9 [1] 36.8889 (21.1332) 332 9 12.6667 (10.3923) 114
Team E 28 [5] 27.2857 (19.0879) 764 4 5.0000 (2.7386) 20
Team F 27 [1] 39.9259 (35.1683) 1078 116 10.3966 (9.1622) 1206
Team G 16 [1] 47.6875 (34.7234) 763 69 7.4058 (7.1431) 511
Team H 30 [4] 28.2667 (28.5668) 848 49 8.8367 (7.3105) 433
Team I 20 [1] 50.3000 (44.6946) 1006  
Team J 19 [3] 31.6316 (20.0846) 601 60 10.6667 (8.3280) 640
Team K 16 [4] 50.4375 (49.0446) 807 61 6.8525 (5.7054) 418
TOTAL 266 [42] 37.594 10000 585 8.3470 4883
Average Team Critique
8.0 interlocutors 

(SD=3.16; min=3; max=14)
15.53 critique acts 

(SD=11.51; min=1; max=34)
HOW MANY
INTERLOCUTORS 

DO YOU NEED?
the top five commenters
accounted for 81.70% of all
unique critique acts in the
Google Docs 



(top 3 = 60.71%)
How did the volume of critique
generated via digital means
compare to the volume of critique
in the physical classroom?
2
Team
Presentation
Length Critique Length
# CL 

Critique Turns
(1Y, 2Y, Inst.)
Average CL 

Critique Turn Length
Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12
Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13
Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29
Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42
Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49
Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02
Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53
Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01
Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37
Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58
Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34
TOTAL
01:15:30
(M=00:06:52;
SD=00:01:05)
2:52:59
(M=00:15:44;
SD=00:04:22)
147
(M=13.36;
SD=3.57)
(M=00:01:14; 

SD=00:00:20)
Team
Presentation
Length Critique Length
# CL 

Critique Turns
(1Y, 2Y, Inst.)
Average CL 

Critique Turn Length
Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12
Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13
Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29
Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42
Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49
Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02
Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53
Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01
Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37
Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58
Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34
TOTAL
01:15:30
(M=00:06:52;
SD=00:01:05)
2:52:59
(M=00:15:44;
SD=00:04:22)
147
(M=13.36;
SD=3.57)
(M=00:01:14; 

SD=00:00:20)
Classroom Critique Acts
147

(M=13.36; SD=3.57)
Team
Presentation
Length Critique Length
# CL 

Critique Turns
(1Y, 2Y, Inst.)
Average CL 

Critique Turn Length
Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12
Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13
Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29
Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42
Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49
Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02
Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53
Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01
Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37
Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58
Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34
TOTAL
01:15:30
(M=00:06:52;
SD=00:01:05)
2:52:59
(M=00:15:44;
SD=00:04:22)
147
(M=13.36;
SD=3.57)
(M=00:01:14; 

SD=00:00:20)
Classroom Critique Acts
147

(M=13.36; SD=3.57)
Google Docs Critique Acts
224

(M=20.36; SD=6.62)
Team
Presentation
Length Critique Length
# CL 

Critique Turns
(1Y, 2Y, Inst.)
Average CL 

Critique Turn Length
Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12
Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13
Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29
Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42
Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49
Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02
Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53
Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01
Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37
Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58
Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34
TOTAL
01:15:30
(M=00:06:52;
SD=00:01:05)
2:52:59
(M=00:15:44;
SD=00:04:22)
147
(M=13.36;
SD=3.57)
(M=00:01:14; 

SD=00:00:20)
Classroom Critique Acts
147

(M=13.36; SD=3.57)
M = 1 minute, 14 seconds
Google Docs Critique Acts
224

(M=20.36; SD=6.62)
Team
Presentation
Length Critique Length
# CL 

Critique Turns
(1Y, 2Y, Inst.)
Average CL 

Critique Turn Length
Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12
Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13
Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29
Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42
Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49
Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02
Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53
Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01
Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37
Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58
Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34
TOTAL
01:15:30
(M=00:06:52;
SD=00:01:05)
2:52:59
(M=00:15:44;
SD=00:04:22)
147
(M=13.36;
SD=3.57)
(M=00:01:14; 

SD=00:00:20)
Classroom Critique Acts
147

(M=13.36; SD=3.57)
M = 1 minute, 14 seconds
Google Docs Critique Acts
224

(M=20.36; SD=6.62)
152.38% increase in 

critique capacity
What was the nature of
critique content that the
advanced students generated?
3
GD CRITIQUE TURNS
M=37.59 words (SD=34.65)
135 design critiques (M=12.27; SD=5.56)
98 presentation critiques (M=8.91; SD=4.12)
Team C: “I think the “presentation preview” slide at the beginning was brilliant. You
could have very easily leveraged this to better include your research early on. Make
your research the equivalent of the “turn off your cell phones” announcement.
Whatever it may be, but briefly explaining that “the tech you are about to see is
fantastical, but be assured - it is feasible.” (TM: super awesome wicked great
suggestion)”
Team I: “Your presentation style (pace, confidence, etc.) is night and day between
the last time I saw you present. Nice job. (+1 UK, +1XE +1 DK)”
Team H: “Be careful about telling your stakeholders “I guess you guys aren’t aware
of this…” You might have a boss who gets upset at their assumed ignorance (+1
TQ, you don’t want to make them feel dumb or inadequate, you need buy in!)”
PRESENTATION CRITIQUE
Team C: "ok, textures? I am so confused, how on earth is this happening? Is this 3d glasses? I
may not have heard how this happens, but is this sort of like Disney that you have “robots” and
existing props that add this texture that you are talking about? ok, you talked about the
textured screens at the end. I would have liked to hear this as you go through your story
because it completely distracted me..."
Team F: “I’m concerned that your design is a bit magical. Your scenario is kind of perfect;
stressful person puts on magical jacket and suddenly everything is better! Stress and anxiety
doesn’t always arise, but can arise often from actual things going on in people’s life. Your jacket
doesn’t make less things due, or make people have less work, or make the trip suddenly over.
Just because you can pat people on the back doesn’t mean you’re going to make them less
stressed. (BX: I think of [other professor] and her issues with turbulence. She needs more than a
fake back pat)”
Team I: “The in-store has been handled decently enough, but my concerns are with the system.
How does this fit into my ecosystem? The stores? Food Companies? You say it is out of the
scope, but it is something that needs addressing as you are adding a brand new infrastructure
into stores.”
DESIGN CRITIQUE
NEGOTIATION
THROUGH 

BACKCHANNELING
“unfortunately I don't think it was stellar because
since it was backwards, the whole time I kept thinking
NO FUCKING WAY. WTF ARE YOU GUYS DOING
ARE OYU ON CRACK?”
“The message should be about the presentation
order. and i think the issues with scalability or how it
doesnt quite fit the body data stuff.”
DISCUSSION
DISCUSSION
mentors demonstrated an ability to manage
anonymity and ownership effectively in digitally
mediated spaces
an expansion of critique allows for increased
interaction and opportunity for crosstalk, even when
the physical space does not allow for it
multimodal critique encouraged socialization around
design topics and negotiation of meaning—mirroring
the discursive quality of physically-mediated critique
mentors built skills as assessors and design
professionals, clarifying their concerns in order to 

reach consensus
colingray.me
THANK YOU

Contenu connexe

En vedette

Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"
Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"
Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"colin gray
 
Flow of Competence in UX Design Practice
Flow of Competence in UX Design PracticeFlow of Competence in UX Design Practice
Flow of Competence in UX Design Practicecolin gray
 
Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...
Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...
Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...colin gray
 
Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...
Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...
Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...colin gray
 
Normativity in Design Communication: Inscribing Design Values in Designed Art...
Normativity in Design Communication: Inscribing Design Values in Designed Art...Normativity in Design Communication: Inscribing Design Values in Designed Art...
Normativity in Design Communication: Inscribing Design Values in Designed Art...colin gray
 
What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...
What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...
What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...colin gray
 
What Happens when Creativity is Exhausted? Design Tools as an Aid for Ideation
What Happens when Creativity is Exhausted? Design Tools as an Aid for IdeationWhat Happens when Creativity is Exhausted? Design Tools as an Aid for Ideation
What Happens when Creativity is Exhausted? Design Tools as an Aid for Ideationcolin gray
 
Developing an Ethically-Aware Design Character through Problem Framing
Developing an Ethically-Aware Design Character through Problem FramingDeveloping an Ethically-Aware Design Character through Problem Framing
Developing an Ethically-Aware Design Character through Problem Framingcolin gray
 
Studio Teaching in the Low-Precedent Context of Instructional Design
Studio Teaching in the Low-Precedent Context of Instructional DesignStudio Teaching in the Low-Precedent Context of Instructional Design
Studio Teaching in the Low-Precedent Context of Instructional Designcolin gray
 
Emergent Critique in Informal Design Talk: Reflections of Surface, Pedagogic...
Emergent Critique in Informal Design Talk:  Reflections of Surface, Pedagogic...Emergent Critique in Informal Design Talk:  Reflections of Surface, Pedagogic...
Emergent Critique in Informal Design Talk: Reflections of Surface, Pedagogic...colin gray
 
The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...
The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...
The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...colin gray
 
Design in the “Real World”: Situating Academic Conceptions of ID Practice
Design in the “Real World”: Situating Academic Conceptions of ID PracticeDesign in the “Real World”: Situating Academic Conceptions of ID Practice
Design in the “Real World”: Situating Academic Conceptions of ID Practicecolin gray
 
Exploring the Lived Experience of Learners: Broadening our Understanding of A...
Exploring the Lived Experience of Learners: Broadening our Understanding of A...Exploring the Lived Experience of Learners: Broadening our Understanding of A...
Exploring the Lived Experience of Learners: Broadening our Understanding of A...colin gray
 
Stop Telling Designers What To Do: Reframing Instructional Design Education T...
Stop Telling Designers What To Do: Reframing Instructional Design Education T...Stop Telling Designers What To Do: Reframing Instructional Design Education T...
Stop Telling Designers What To Do: Reframing Instructional Design Education T...colin gray
 
Informal peer critique and the negotiation of habitus in a design studio (AEC...
Informal peer critique and the negotiation of habitus in a design studio (AEC...Informal peer critique and the negotiation of habitus in a design studio (AEC...
Informal peer critique and the negotiation of habitus in a design studio (AEC...colin gray
 

En vedette (16)

Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"
Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"
Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"
 
Flow of Competence in UX Design Practice
Flow of Competence in UX Design PracticeFlow of Competence in UX Design Practice
Flow of Competence in UX Design Practice
 
Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...
Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...
Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...
 
Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...
Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...
Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...
 
Storyboard
StoryboardStoryboard
Storyboard
 
Normativity in Design Communication: Inscribing Design Values in Designed Art...
Normativity in Design Communication: Inscribing Design Values in Designed Art...Normativity in Design Communication: Inscribing Design Values in Designed Art...
Normativity in Design Communication: Inscribing Design Values in Designed Art...
 
What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...
What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...
What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...
 
What Happens when Creativity is Exhausted? Design Tools as an Aid for Ideation
What Happens when Creativity is Exhausted? Design Tools as an Aid for IdeationWhat Happens when Creativity is Exhausted? Design Tools as an Aid for Ideation
What Happens when Creativity is Exhausted? Design Tools as an Aid for Ideation
 
Developing an Ethically-Aware Design Character through Problem Framing
Developing an Ethically-Aware Design Character through Problem FramingDeveloping an Ethically-Aware Design Character through Problem Framing
Developing an Ethically-Aware Design Character through Problem Framing
 
Studio Teaching in the Low-Precedent Context of Instructional Design
Studio Teaching in the Low-Precedent Context of Instructional DesignStudio Teaching in the Low-Precedent Context of Instructional Design
Studio Teaching in the Low-Precedent Context of Instructional Design
 
Emergent Critique in Informal Design Talk: Reflections of Surface, Pedagogic...
Emergent Critique in Informal Design Talk:  Reflections of Surface, Pedagogic...Emergent Critique in Informal Design Talk:  Reflections of Surface, Pedagogic...
Emergent Critique in Informal Design Talk: Reflections of Surface, Pedagogic...
 
The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...
The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...
The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...
 
Design in the “Real World”: Situating Academic Conceptions of ID Practice
Design in the “Real World”: Situating Academic Conceptions of ID PracticeDesign in the “Real World”: Situating Academic Conceptions of ID Practice
Design in the “Real World”: Situating Academic Conceptions of ID Practice
 
Exploring the Lived Experience of Learners: Broadening our Understanding of A...
Exploring the Lived Experience of Learners: Broadening our Understanding of A...Exploring the Lived Experience of Learners: Broadening our Understanding of A...
Exploring the Lived Experience of Learners: Broadening our Understanding of A...
 
Stop Telling Designers What To Do: Reframing Instructional Design Education T...
Stop Telling Designers What To Do: Reframing Instructional Design Education T...Stop Telling Designers What To Do: Reframing Instructional Design Education T...
Stop Telling Designers What To Do: Reframing Instructional Design Education T...
 
Informal peer critique and the negotiation of habitus in a design studio (AEC...
Informal peer critique and the negotiation of habitus in a design studio (AEC...Informal peer critique and the negotiation of habitus in a design studio (AEC...
Informal peer critique and the negotiation of habitus in a design studio (AEC...
 

Plus de colin gray

Critical pedagogy and the pluriversal design studio
Critical pedagogy and the pluriversal design studioCritical pedagogy and the pluriversal design studio
Critical pedagogy and the pluriversal design studiocolin gray
 
Critique Assemblages in Response to Emergency Hybrid Studio Pedagogy
Critique Assemblages in Response to Emergency Hybrid Studio PedagogyCritique Assemblages in Response to Emergency Hybrid Studio Pedagogy
Critique Assemblages in Response to Emergency Hybrid Studio Pedagogycolin gray
 
Cross-Cultural UX Pedagogy: A China–US Partnership
Cross-Cultural UX Pedagogy: A China–US PartnershipCross-Cultural UX Pedagogy: A China–US Partnership
Cross-Cultural UX Pedagogy: A China–US Partnershipcolin gray
 
Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...
Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...
Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...colin gray
 
A Practice-Led Account of the Conceptual Evolution of UX Knowledge
A Practice-Led Account of the Conceptual Evolution of UX KnowledgeA Practice-Led Account of the Conceptual Evolution of UX Knowledge
A Practice-Led Account of the Conceptual Evolution of UX Knowledgecolin gray
 
Analyzing Value Discovery in Design Decisions Through Ethicography
Analyzing Value Discovery in Design Decisions Through EthicographyAnalyzing Value Discovery in Design Decisions Through Ethicography
Analyzing Value Discovery in Design Decisions Through Ethicographycolin gray
 
Ethical Mediation in UX Practice
Ethical Mediation in UX PracticeEthical Mediation in UX Practice
Ethical Mediation in UX Practicecolin gray
 
“What do you recommend a complete beginner like me to practice?”: Professiona...
“What do you recommend a complete beginner like me to practice?”: Professiona...“What do you recommend a complete beginner like me to practice?”: Professiona...
“What do you recommend a complete beginner like me to practice?”: Professiona...colin gray
 
Supporting Distributed Critique through Interpretation and Sense-Making in an...
Supporting Distributed Critique through Interpretation and Sense-Making in an...Supporting Distributed Critique through Interpretation and Sense-Making in an...
Supporting Distributed Critique through Interpretation and Sense-Making in an...colin gray
 
Distinctions between the Communication of Experiential and Academic Design Kn...
Distinctions between the Communication of Experiential and Academic Design Kn...Distinctions between the Communication of Experiential and Academic Design Kn...
Distinctions between the Communication of Experiential and Academic Design Kn...colin gray
 
Generating Mobile Application Onboarding Insights Through Minimalist Instruction
Generating Mobile Application Onboarding Insights Through Minimalist InstructionGenerating Mobile Application Onboarding Insights Through Minimalist Instruction
Generating Mobile Application Onboarding Insights Through Minimalist Instructioncolin gray
 
The Dark (Patterns) Side of UX Design
The Dark (Patterns) Side of UX DesignThe Dark (Patterns) Side of UX Design
The Dark (Patterns) Side of UX Designcolin gray
 
Forming A Design Identity in Computing Education Through Reflection and Peer ...
Forming A Design Identity in Computing Education Through Reflection and Peer ...Forming A Design Identity in Computing Education Through Reflection and Peer ...
Forming A Design Identity in Computing Education Through Reflection and Peer ...colin gray
 
Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...
Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...
Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...colin gray
 
Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...
Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...
Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...colin gray
 

Plus de colin gray (15)

Critical pedagogy and the pluriversal design studio
Critical pedagogy and the pluriversal design studioCritical pedagogy and the pluriversal design studio
Critical pedagogy and the pluriversal design studio
 
Critique Assemblages in Response to Emergency Hybrid Studio Pedagogy
Critique Assemblages in Response to Emergency Hybrid Studio PedagogyCritique Assemblages in Response to Emergency Hybrid Studio Pedagogy
Critique Assemblages in Response to Emergency Hybrid Studio Pedagogy
 
Cross-Cultural UX Pedagogy: A China–US Partnership
Cross-Cultural UX Pedagogy: A China–US PartnershipCross-Cultural UX Pedagogy: A China–US Partnership
Cross-Cultural UX Pedagogy: A China–US Partnership
 
Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...
Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...
Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...
 
A Practice-Led Account of the Conceptual Evolution of UX Knowledge
A Practice-Led Account of the Conceptual Evolution of UX KnowledgeA Practice-Led Account of the Conceptual Evolution of UX Knowledge
A Practice-Led Account of the Conceptual Evolution of UX Knowledge
 
Analyzing Value Discovery in Design Decisions Through Ethicography
Analyzing Value Discovery in Design Decisions Through EthicographyAnalyzing Value Discovery in Design Decisions Through Ethicography
Analyzing Value Discovery in Design Decisions Through Ethicography
 
Ethical Mediation in UX Practice
Ethical Mediation in UX PracticeEthical Mediation in UX Practice
Ethical Mediation in UX Practice
 
“What do you recommend a complete beginner like me to practice?”: Professiona...
“What do you recommend a complete beginner like me to practice?”: Professiona...“What do you recommend a complete beginner like me to practice?”: Professiona...
“What do you recommend a complete beginner like me to practice?”: Professiona...
 
Supporting Distributed Critique through Interpretation and Sense-Making in an...
Supporting Distributed Critique through Interpretation and Sense-Making in an...Supporting Distributed Critique through Interpretation and Sense-Making in an...
Supporting Distributed Critique through Interpretation and Sense-Making in an...
 
Distinctions between the Communication of Experiential and Academic Design Kn...
Distinctions between the Communication of Experiential and Academic Design Kn...Distinctions between the Communication of Experiential and Academic Design Kn...
Distinctions between the Communication of Experiential and Academic Design Kn...
 
Generating Mobile Application Onboarding Insights Through Minimalist Instruction
Generating Mobile Application Onboarding Insights Through Minimalist InstructionGenerating Mobile Application Onboarding Insights Through Minimalist Instruction
Generating Mobile Application Onboarding Insights Through Minimalist Instruction
 
The Dark (Patterns) Side of UX Design
The Dark (Patterns) Side of UX DesignThe Dark (Patterns) Side of UX Design
The Dark (Patterns) Side of UX Design
 
Forming A Design Identity in Computing Education Through Reflection and Peer ...
Forming A Design Identity in Computing Education Through Reflection and Peer ...Forming A Design Identity in Computing Education Through Reflection and Peer ...
Forming A Design Identity in Computing Education Through Reflection and Peer ...
 
Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...
Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...
Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...
 
Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...
Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...
Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...
 

Dernier

2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...Marlene Maheu
 
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...AKSHAYMAGAR17
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudDr. Bruce A. Johnson
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...Nguyen Thanh Tu Collection
 
Auchitya Theory by Kshemendra Indian Poetics
Auchitya Theory by Kshemendra Indian PoeticsAuchitya Theory by Kshemendra Indian Poetics
Auchitya Theory by Kshemendra Indian PoeticsDhatriParmar
 
UNIT I Design Thinking and Explore.pptx
UNIT I  Design Thinking and Explore.pptxUNIT I  Design Thinking and Explore.pptx
UNIT I Design Thinking and Explore.pptxGOWSIKRAJA PALANISAMY
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudDr. Bruce A. Johnson
 
Research Methodology and Tips on Better Research
Research Methodology and Tips on Better ResearchResearch Methodology and Tips on Better Research
Research Methodology and Tips on Better ResearchRushdi Shams
 
Material Remains as Source of Ancient Indian History & Culture.ppt
Material Remains as Source of Ancient Indian History & Culture.pptMaterial Remains as Source of Ancient Indian History & Culture.ppt
Material Remains as Source of Ancient Indian History & Culture.pptBanaras Hindu University
 
3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptxmary850239
 
LEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollLEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollDr. Bruce A. Johnson
 
Riti theory by Vamana Indian poetics.pptx
Riti theory by Vamana Indian poetics.pptxRiti theory by Vamana Indian poetics.pptx
Riti theory by Vamana Indian poetics.pptxDhatriParmar
 
VIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdfVIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdfArthyR3
 
3.14.24 The Selma March and the Voting Rights Act.pptx
3.14.24 The Selma March and the Voting Rights Act.pptx3.14.24 The Selma March and the Voting Rights Act.pptx
3.14.24 The Selma March and the Voting Rights Act.pptxmary850239
 
Metabolism , Metabolic Fate& disorders of cholesterol.pptx
Metabolism , Metabolic Fate& disorders of cholesterol.pptxMetabolism , Metabolic Fate& disorders of cholesterol.pptx
Metabolism , Metabolic Fate& disorders of cholesterol.pptxDr. Santhosh Kumar. N
 
EDD8524 The Future of Educational Leader
EDD8524 The Future of Educational LeaderEDD8524 The Future of Educational Leader
EDD8524 The Future of Educational LeaderDr. Bruce A. Johnson
 
Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024bsellato
 

Dernier (20)

2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
 
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
 
Least Significance Difference:Biostatics and Research Methodology
Least Significance Difference:Biostatics and Research MethodologyLeast Significance Difference:Biostatics and Research Methodology
Least Significance Difference:Biostatics and Research Methodology
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced Stud
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
 
Auchitya Theory by Kshemendra Indian Poetics
Auchitya Theory by Kshemendra Indian PoeticsAuchitya Theory by Kshemendra Indian Poetics
Auchitya Theory by Kshemendra Indian Poetics
 
ANOVA Parametric test: Biostatics and Research Methodology
ANOVA Parametric test: Biostatics and Research MethodologyANOVA Parametric test: Biostatics and Research Methodology
ANOVA Parametric test: Biostatics and Research Methodology
 
UNIT I Design Thinking and Explore.pptx
UNIT I  Design Thinking and Explore.pptxUNIT I  Design Thinking and Explore.pptx
UNIT I Design Thinking and Explore.pptx
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced Stud
 
Research Methodology and Tips on Better Research
Research Methodology and Tips on Better ResearchResearch Methodology and Tips on Better Research
Research Methodology and Tips on Better Research
 
Material Remains as Source of Ancient Indian History & Culture.ppt
Material Remains as Source of Ancient Indian History & Culture.pptMaterial Remains as Source of Ancient Indian History & Culture.ppt
Material Remains as Source of Ancient Indian History & Culture.ppt
 
3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx
 
LEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollLEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community Coll
 
Riti theory by Vamana Indian poetics.pptx
Riti theory by Vamana Indian poetics.pptxRiti theory by Vamana Indian poetics.pptx
Riti theory by Vamana Indian poetics.pptx
 
VIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdfVIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdf
 
3.14.24 The Selma March and the Voting Rights Act.pptx
3.14.24 The Selma March and the Voting Rights Act.pptx3.14.24 The Selma March and the Voting Rights Act.pptx
3.14.24 The Selma March and the Voting Rights Act.pptx
 
t-test Parametric test Biostatics and Research Methodology
t-test Parametric test Biostatics and Research Methodologyt-test Parametric test Biostatics and Research Methodology
t-test Parametric test Biostatics and Research Methodology
 
Metabolism , Metabolic Fate& disorders of cholesterol.pptx
Metabolism , Metabolic Fate& disorders of cholesterol.pptxMetabolism , Metabolic Fate& disorders of cholesterol.pptx
Metabolism , Metabolic Fate& disorders of cholesterol.pptx
 
EDD8524 The Future of Educational Leader
EDD8524 The Future of Educational LeaderEDD8524 The Future of Educational Leader
EDD8524 The Future of Educational Leader
 
Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024
 

Inverting Critique: Emergent Technologically-Mediated Critique Practices of Developing Design Students

  • 1. INVERTING CRITIQUE: 
 EMERGENT TECHNOLOGICALLY-MEDIATED CRITIQUE PRACTICES OF DEVELOPING DESIGN STUDENTS COLIN M. GRAY Purdue University CRAIG D. HOWARD University of Tennessee—Knoxville
  • 2. Gray, C. M., & Howard, C. D. (2015, June). “Why are they not responding to critique?”: A student-centered construction  of the crit. In  LearnxDesign: The 3rd International Conference for Design Education Researchers and PreK-16 Design Educators. Chicago, IL: School of the Art Institute of Chicago. PRIOR WORK
  • 3. CRITIQUE is central to design education [Anthony, 1991; Dannels & Martin, 2008; Klebesadel & Kornetsky, 2009; Parnell, Sara, Doidge, & Parsons, 2012; Schön, 1987; Shulman, 2005]
  • 4. instructor-centric curriculum-centric power-laden CRITIQUE is central to design education [Anthony, 1991; Dannels & Martin, 2008; Klebesadel & Kornetsky, 2009; Parnell, Sara, Doidge, & Parsons, 2012; Schön, 1987; Shulman, 2005]
  • 5. [Anthony, 1991; Blythman, Orr, & Blair, 2007; Dutton, 1991; Gray, 2013, 2014; Gray & Howard 2014; Webster, 2007; Willenbrock, 1991] CRITICAL FRAMING what if we looked at critique in a
  • 6. [Anthony, 1991; Blythman, Orr, & Blair, 2007; Dutton, 1991; Gray, 2013, 2014; Gray & Howard 2014; Webster, 2007; Willenbrock, 1991] CRITICAL FRAMING what if we looked at critique in a contextualized 
 with PEER ASSESSMENT, DEVELOPMENT OF DESIGN EXPERTISE & IDENTITY, CSCL, ETC. [Easterday et al., 2014; Freeman & McKenzie, 2001; Lawson & Dorst, 2009; Schön, 1990; Smith, 2015; Topping, 1998; Xu & Bailey, 2013]
  • 8. CRITIQUE & 
 CRITICAL PEDAGOGY FROM student as tabula rasa TO student as capable,
 emerging proto-professional [Boling, Gray, & Smith, 2015; 
 Gray, 2014; Freire, 1970]
  • 10. CONTEXT Human-Computer Interaction Master’s program Introductory project- based design course Final project was based on the 2014 ACM SIGCHI Student Design Competition
  • 12. = Physical Space [~60 student capacity; 8 screens; decentralized layout] Virtual Space [Facebook; Google Docs; SMS] +CLASSROOM
  • 13. MULTIMODAL CRITIQUE multiple critique conversations occur concurrently around a single designed artifact (or presentation of that artifact), in both physical and virtual modes, with multiple classes or groupings of interlocutors
  • 14. FIRST-YEAR STUDENT FIRST-YEAR STUDENT (PRESENTING) INSTRUCTOR PROJECTOR/SCREEN WHITEBOARD MENTOR (SECOND-YEAR STUDENT)
  • 15. LIVE MENTOR CRITIQUE IN GOOGLE DOC
  • 18. 1. What volume of critique did this instructional design support? 2. How did the volume of critique generated via digital means compare to the volume of critique in the physical classroom? 3. What was the nature of critique content that the advanced students generated? RESEARCH QUESTIONS
  • 19. What volume of critique did this instructional design support? 1
  • 20. Team Collaborative Google Doc (GD) Backchannel (BC) # 
 Turns [CL*] Average Words per turn (SD) Total words # 
 Turns Average Words per turn (SD) Total words Team A 37 [10] 46.4054 (45.6369) 1717 13 5.1538 (4.4695) 67 Team B 26 [4] 25.8462 (21.6079) 672 69 7.3043 (5.7441) 504 Team C 38 [8] 37.1579 (28.9496) 1412 135 7.1852 (6.6968) 970 Team D 9 [1] 36.8889 (21.1332) 332 9 12.6667 (10.3923) 114 Team E 28 [5] 27.2857 (19.0879) 764 4 5.0000 (2.7386) 20 Team F 27 [1] 39.9259 (35.1683) 1078 116 10.3966 (9.1622) 1206 Team G 16 [1] 47.6875 (34.7234) 763 69 7.4058 (7.1431) 511 Team H 30 [4] 28.2667 (28.5668) 848 49 8.8367 (7.3105) 433 Team I 20 [1] 50.3000 (44.6946) 1006   Team J 19 [3] 31.6316 (20.0846) 601 60 10.6667 (8.3280) 640 Team K 16 [4] 50.4375 (49.0446) 807 61 6.8525 (5.7054) 418 TOTAL 266 [42] 37.594 10000 585 8.3470 4883
  • 21. Team Collaborative Google Doc (GD) Backchannel (BC) # 
 Turns [CL*] Average Words per turn (SD) Total words # 
 Turns Average Words per turn (SD) Total words Team A 37 [10] 46.4054 (45.6369) 1717 13 5.1538 (4.4695) 67 Team B 26 [4] 25.8462 (21.6079) 672 69 7.3043 (5.7441) 504 Team C 38 [8] 37.1579 (28.9496) 1412 135 7.1852 (6.6968) 970 Team D 9 [1] 36.8889 (21.1332) 332 9 12.6667 (10.3923) 114 Team E 28 [5] 27.2857 (19.0879) 764 4 5.0000 (2.7386) 20 Team F 27 [1] 39.9259 (35.1683) 1078 116 10.3966 (9.1622) 1206 Team G 16 [1] 47.6875 (34.7234) 763 69 7.4058 (7.1431) 511 Team H 30 [4] 28.2667 (28.5668) 848 49 8.8367 (7.3105) 433 Team I 20 [1] 50.3000 (44.6946) 1006   Team J 19 [3] 31.6316 (20.0846) 601 60 10.6667 (8.3280) 640 Team K 16 [4] 50.4375 (49.0446) 807 61 6.8525 (5.7054) 418 TOTAL 266 [42] 37.594 10000 585 8.3470 4883 Average Team Critique 8.0 interlocutors 
 (SD=3.16; min=3; max=14) 15.53 critique acts 
 (SD=11.51; min=1; max=34)
  • 22. HOW MANY INTERLOCUTORS 
 DO YOU NEED? the top five commenters accounted for 81.70% of all unique critique acts in the Google Docs 
 
 (top 3 = 60.71%)
  • 23. How did the volume of critique generated via digital means compare to the volume of critique in the physical classroom? 2
  • 24. Team Presentation Length Critique Length # CL 
 Critique Turns (1Y, 2Y, Inst.) Average CL 
 Critique Turn Length Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12 Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13 Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29 Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42 Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49 Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02 Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53 Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01 Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37 Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58 Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34 TOTAL 01:15:30 (M=00:06:52; SD=00:01:05) 2:52:59 (M=00:15:44; SD=00:04:22) 147 (M=13.36; SD=3.57) (M=00:01:14; 
 SD=00:00:20)
  • 25. Team Presentation Length Critique Length # CL 
 Critique Turns (1Y, 2Y, Inst.) Average CL 
 Critique Turn Length Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12 Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13 Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29 Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42 Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49 Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02 Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53 Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01 Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37 Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58 Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34 TOTAL 01:15:30 (M=00:06:52; SD=00:01:05) 2:52:59 (M=00:15:44; SD=00:04:22) 147 (M=13.36; SD=3.57) (M=00:01:14; 
 SD=00:00:20) Classroom Critique Acts 147
 (M=13.36; SD=3.57)
  • 26. Team Presentation Length Critique Length # CL 
 Critique Turns (1Y, 2Y, Inst.) Average CL 
 Critique Turn Length Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12 Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13 Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29 Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42 Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49 Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02 Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53 Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01 Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37 Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58 Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34 TOTAL 01:15:30 (M=00:06:52; SD=00:01:05) 2:52:59 (M=00:15:44; SD=00:04:22) 147 (M=13.36; SD=3.57) (M=00:01:14; 
 SD=00:00:20) Classroom Critique Acts 147
 (M=13.36; SD=3.57) Google Docs Critique Acts 224
 (M=20.36; SD=6.62)
  • 27. Team Presentation Length Critique Length # CL 
 Critique Turns (1Y, 2Y, Inst.) Average CL 
 Critique Turn Length Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12 Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13 Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29 Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42 Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49 Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02 Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53 Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01 Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37 Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58 Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34 TOTAL 01:15:30 (M=00:06:52; SD=00:01:05) 2:52:59 (M=00:15:44; SD=00:04:22) 147 (M=13.36; SD=3.57) (M=00:01:14; 
 SD=00:00:20) Classroom Critique Acts 147
 (M=13.36; SD=3.57) M = 1 minute, 14 seconds Google Docs Critique Acts 224
 (M=20.36; SD=6.62)
  • 28. Team Presentation Length Critique Length # CL 
 Critique Turns (1Y, 2Y, Inst.) Average CL 
 Critique Turn Length Team A 00:05:35 0:23:54 20 (18/1/1)* 00:01:12 Team B 00:08:44 0:12:06 10 (8/1/1) 00:01:13 Team C 00:07:20 0:20:42 14 (12/1/1) 00:01:29 Team D 00:05:59 0:09:41 14 (8/3/3) 00:00:42 Team E 00:07:26 0:19:57 11 (6/2/3) 00:01:49 Team F 00:06:03 0:17:38 17 (15/1/1) 00:01:02 Team G 00:08:06 0:15:01 17 (11/3/3) 00:00:53 Team H 00:07:56 0:15:18 15 (10/2/3) 00:01:01 Team I 00:06:18 0:12:52 8 (6/1/1) 00:01:37 Team J 00:05:46 0:11:41 12 (9/2/1) 00:00:58 Team K 00:06:17 0:14:09 9 (7/1/1) 00:01:34 TOTAL 01:15:30 (M=00:06:52; SD=00:01:05) 2:52:59 (M=00:15:44; SD=00:04:22) 147 (M=13.36; SD=3.57) (M=00:01:14; 
 SD=00:00:20) Classroom Critique Acts 147
 (M=13.36; SD=3.57) M = 1 minute, 14 seconds Google Docs Critique Acts 224
 (M=20.36; SD=6.62) 152.38% increase in 
 critique capacity
  • 29. What was the nature of critique content that the advanced students generated? 3
  • 30. GD CRITIQUE TURNS M=37.59 words (SD=34.65) 135 design critiques (M=12.27; SD=5.56) 98 presentation critiques (M=8.91; SD=4.12)
  • 31. Team C: “I think the “presentation preview” slide at the beginning was brilliant. You could have very easily leveraged this to better include your research early on. Make your research the equivalent of the “turn off your cell phones” announcement. Whatever it may be, but briefly explaining that “the tech you are about to see is fantastical, but be assured - it is feasible.” (TM: super awesome wicked great suggestion)” Team I: “Your presentation style (pace, confidence, etc.) is night and day between the last time I saw you present. Nice job. (+1 UK, +1XE +1 DK)” Team H: “Be careful about telling your stakeholders “I guess you guys aren’t aware of this…” You might have a boss who gets upset at their assumed ignorance (+1 TQ, you don’t want to make them feel dumb or inadequate, you need buy in!)” PRESENTATION CRITIQUE
  • 32. Team C: "ok, textures? I am so confused, how on earth is this happening? Is this 3d glasses? I may not have heard how this happens, but is this sort of like Disney that you have “robots” and existing props that add this texture that you are talking about? ok, you talked about the textured screens at the end. I would have liked to hear this as you go through your story because it completely distracted me..." Team F: “I’m concerned that your design is a bit magical. Your scenario is kind of perfect; stressful person puts on magical jacket and suddenly everything is better! Stress and anxiety doesn’t always arise, but can arise often from actual things going on in people’s life. Your jacket doesn’t make less things due, or make people have less work, or make the trip suddenly over. Just because you can pat people on the back doesn’t mean you’re going to make them less stressed. (BX: I think of [other professor] and her issues with turbulence. She needs more than a fake back pat)” Team I: “The in-store has been handled decently enough, but my concerns are with the system. How does this fit into my ecosystem? The stores? Food Companies? You say it is out of the scope, but it is something that needs addressing as you are adding a brand new infrastructure into stores.” DESIGN CRITIQUE
  • 33. NEGOTIATION THROUGH 
 BACKCHANNELING “unfortunately I don't think it was stellar because since it was backwards, the whole time I kept thinking NO FUCKING WAY. WTF ARE YOU GUYS DOING ARE OYU ON CRACK?” “The message should be about the presentation order. and i think the issues with scalability or how it doesnt quite fit the body data stuff.”
  • 35. DISCUSSION mentors demonstrated an ability to manage anonymity and ownership effectively in digitally mediated spaces an expansion of critique allows for increased interaction and opportunity for crosstalk, even when the physical space does not allow for it multimodal critique encouraged socialization around design topics and negotiation of meaning—mirroring the discursive quality of physically-mediated critique mentors built skills as assessors and design professionals, clarifying their concerns in order to 
 reach consensus