SlideShare une entreprise Scribd logo
1  sur  5
Télécharger pour lire hors ligne
Nurse Education Today 30 (2010) 603–607



                                                               Contents lists available at ScienceDirect


                                                              Nurse Education Today
                                                      journal homepage: www.elsevier.com/nedt




Evidence for teaching practice: The impact of clickers in a large
classroom environment
Barbara Patterson *, Judith Kilpatrick, Eric Woebkenberg
Widener University, School of Nursing, One University Place Chester, PA 19013, United States




a r t i c l e        i n f o                           s u m m a r y

Article history:                                       As the number of nursing students increases, the ability to actively engage all students in a large class-
Accepted 3 December 2009                               room is challenging and increasingly difficult. Clickers, or student response systems (SRS), are a relatively
                                                       new technology in nursing education that use wireless technology and enable students to select individ-
                                                       ual responses to questions posed to them during class.
Keywords:                                                The study design was a quasi-experimental comparison with one section of an adult medical–surgical
Active learning                                        course using the SRS and one receiving standard teaching. No significant differences between groups on
Evidence-based teaching practice
                                                       any measure of performance were found. Focus groups were conducted to describe student perceptions
Classroom technology
Baccalaureate nursing students
                                                       of SRS. Three themes emerged: Being able to respond anonymously, validating an answer while providing
                                                       immediate feedback, and providing an interactive and engaging environment. Although the clickers did
                                                       not improve learning outcomes as measured by objective testing, perceptions shared by students indi-
                                                       cated an increased degree of classroom engagement. Future research needs to examine other potential
                                                       outcome variables.
                                                                                                                         Ó 2009 Elsevier Ltd. All rights reserved.




Introduction                                                                               responses back to the faculty’s computer that instantly tabulates
                                                                                           the data. The class then reviews the displayed data. Multiple appli-
   Enrollments in schools of nursing in the United States have in-                         cations for SRS exist, such as, recording of attendance, question and
creased substantially in the last few years (American Association of                       answer sessions, opinion polls, voting, quizzes, tests, and group
Colleges in Nursing, 2008), from class sizes of 20–30 to incoming                          decision making activities (Duncan, 2005;Fies and Marshall, 2006).
classes of 150–200 students. As the number of nursing students in-                            Educators have recognized the use of technology and its addi-
creases, the ability to actively engage all students in large lecture                      tional value to the classroom experience in elementary and higher
style classrooms is challenging and increasingly more difficult. Ac-                        education for many years (Banks, 2006). The National Research
tive strategies and discussion are often limited by the physical                           Council (Donovan et al., 1999) states that classroom response sys-
structure of the room, inability to hear student responses, and                            tems and the related pedagogy have great potential to transform
the dominance of responses from a small percentage of students                             classrooms to be more learner-knowledge and assessment-ori-
(Herreid, 2006). Examination of the efficacy of alternative interac-                        ented. The current literature in higher education on the topic is pri-
tive teaching and learning strategies is necessary for the establish-                      marily found in the professional schools of medicine, dentistry,
ment and support of best teaching practices.                                               physical and occupational health as well as in schools of business
   One approach to engaging students in classrooms maybe the                               and sciences such as physics (Bruff, 2006; Draper and Brown,
use of a student response system (SRS) (audience response systems                          2004; Schackow et al., 2004; Trapskin et al., 2005). With the in-
(ARS) or ‘clickers’). It is a relatively new technology in nursing edu-                    creased sizes of nursing classes, the use of SRS may be an impor-
cation that uses wireless technology and enables students to select                        tant tool to increase student interaction and engagement while
individual responses to questions posed to them by a faculty mem-                          also improving objective student outcomes. Further empirical
ber during the class (Fies and Marshall, 2006; Skiba, 2006). The                           investigation seemed warranted.
wireless response systems may elicit feedback from a small or
large group. These small, computerized devices transmit individual
                                                                                           Literature review

                                                                                              Student response systems (SRS) have been in existence for over
 * Corresponding author. Tel.: +1 610 499 4222; fax: +1 610 499 4216.
   E-mail addresses: bjpatterson@mail.widener.edu (B. Patterson), jakilpatrick@
                                                                                           three decades (Sawada, 2002). These systems have been used in a
mail.widener.edu (J. Kilpatrick), eewoebkenberg@mail.widener.edu (E. Woebken-              variety of different contexts, professional continuing education to
berg).                                                                                     undergraduate classes. In a review of the educational literature

0260-6917/$ - see front matter Ó 2009 Elsevier Ltd. All rights reserved.
doi:10.1016/j.nedt.2009.12.008
604                                           B. Patterson et al. / Nurse Education Today 30 (2010) 603–607


on student response systems, Fies and Marshall (2006) have noted               and one section of the same course receiving standard teaching. A
that much of the existing literature is anecdotal and there is a need          quasi-experimental design was appropriate for this study since the
for rigorous exploration of this technology across diverse popula-             students independently registered for class sections and were not
tions and pedagogies. These authors noted that there seems to be               randomly assigned to a section. The use of a comparison group,
a general agreement that SRSs ‘‘promote learning when coupled                  which received no intervention, increased ‘‘the ability of researcher
with appropriate pedagogical methodologies” (Fies and Marshall,                to detect differences between groups in the real world” (Burns and
2006, p. 106). Findings from several studies involving SRS have re-            Grove, 2009, p. 253). The independent variable was the teaching
ported positive student perceptions about learning (Guthrie and                strategy of the SRS or clicker use during class. The dependent vari-
Carlin, 2004), increased student participation (Latessa and Mouw,              ables were the three unit exams and the final exam. A qualitative
2005), greater positive emotion (Stowell and Nelson, 2007), and                descriptive component using focus group methodology described
facilitation of student achievement (Uhari et al., 2003). Despite              student perceptions of the use of clickers in the classroom.
generally positive reviews, several authors reported limitations of
SRSs: reliability of the system, cost, technical knowledge, and
interruption in flow of class (Knight and Wood, 2005; Zhu, 2007).               Setting and sample
    The findings with respect to objective test scores and percep-
tions of SRSs have been mixed. One study in the nursing literature                The setting for this study was a school of nursing at a private
(Stein et al., 2006) examined the use of a student response system             university located in the mid-Atlantic region of the United States.
for pre-test reviews in an anatomy and physiology class. While no              The course was taught in a fixed seat amphitheater style class-
significant improvement in examination scores was found, stu-                   room. The design of this classroom does not facilitate the creation
dents demonstrated positive attitudes and a perceived benefit with              of small groups for the use of interactive teaching strategies. The
the use of the technology. Morling et al. (2008) used clickers with            sampling for this study was of convenience. All students in two
four sections of an introductory psychology course (N = 1290). The             sections of a junior level adult medical–surgical nursing course
results supported a small positive effect on exam scores. Students             were invited to participate in the fall 2007. There were no exclu-
in their study did not report feeling significantly more engaged in             sion criteria. All of the students enrolled in the study (N = 70). Stu-
class. Similarly, in another large sample (N = 1221) experimental              dents in the morning section comprised the experimental group
study, Hall et al. (2005) reported a significant improvement in test            (n = 38) and the afternoon section of students was the control
scores from previous years in undergraduate chemistry lecture                  group (n = 32). All students in the experimental group were invited
courses. Their students perceived the classes with SRSs to be ‘‘more           to participate in one of three focus groups.
engaging, motivational, and increased learning” (Hall et al. 2005, p.
1). Yourstone et al. (2008) found a positive impact on learning on
test scores with undergraduate operations management students                  Procedure
(N = 190). They compared entrance examination scores with a final
examination. The authors cautioned that the clickers may not have                  Prior to initiating the study, Institutional Review Board approval
been the reason for improvement in test scores and further re-                 was obtained. On the first day of class, the investigators answered
search is necessary.                                                           all questions about the study prior to students signing the in-
    Participant knowledge scores did not improve significantly when             formed consent. All students completed a demographic data form.
a SRS was used in a continuing medical education program for phy-              Participation in the study was voluntary and students were offered
sicians and health care professionals (Miller et al., 2003). However,          the alternative to not participate. Students were informed that
participants rated the speaker and presentation quality more favor-            their decision to participate had no effect on their class standing
ably when the SRSs were used. Learning outcomes and student atti-              or grades. No compensation or course credit for participation was
tudes were outcome variables in a study by Fies (2005). She video-             provided. The faculty member teaching the course de-identified
recorded classroom discussions for evidence of participation and               all test score data prior to entry into the database by the primary
use of SRSs. There was no improvement from pre-test to post-test               investigator. No students withdrew from the study during the
scores; however, students indicated an increase to understand as op-           course of the semester.
posed to lecture style delivery of content.                                        The same faculty member facilitated the course in both the
    With a dearth of research examining learning outcomes and SRSs             morning and afternoon. She taught the same content weekly to
with nursing students, the primary purpose of this study was to eval-          each section and all students completed the same pre-test, unit
uate the effectiveness of a teaching intervention using a SRS in the           tests, and final exam. At the end of each class, both sections an-
classroom setting with junior baccalaureate nursing students. A sec-           swered the same multiple-choice review questions on content dis-
ond purpose of this study was to describe students’ perceptions of             cussed during class. A variety of questions were presented, from
using a SRS in the classroom. The research questions follow:                   knowledge-based to analysis level. The control group students an-
                                                                               swered the questions with a ‘hand raise’ response while students
1. What is the difference in test scores for students who use a stu-           in the experimental group used the clickers on class days, for six
   dent response system during class when compared with test                   class days. For this group, the questions were integrated into the
   scores of students participating in standard teaching strategies?           PowerPointÒ presentation using TurningPointÒ technology and
2. What is the perception of students who use a student response               students responded individually to the questions using the click-
   system in class?                                                            ers. A histogram was displayed of the responses and further discus-
                                                                               sion and misunderstanding of content clarified at that point in
   The terms clickers and student response systems are used inter-             time.
changeably in the following sections.                                              For the qualitative component of the study, after the third unit
                                                                               exam students in the experimental section were invited to partic-
                                                                               ipate in a focus group. Three groups with 30 students participated.
Method                                                                         The primary investigator conducted the focus groups in a confer-
                                                                               ence room on campus. They lasted approximately 45–60 min.
   The design was a quasi-experimental 2-group comparison                      The groups were audiotape recorded and transcribed. Examples
(Burns and Grove, 2009) with one section of a course using Clickers            of focus group questions included:
B. Patterson et al. / Nurse Education Today 30 (2010) 603–607                                             605


1. What were the strengths of the using clickers in the classroom?                     Table 2
2. What were the limitations of using clickers in the classroom?                       Comparison of unit exams and final exam for experimental (clicker) and control
                                                                                       groups (N = 70).
3. How did the clickers influence your learning of the course
   content?                                                                               Measure (possible    Experimental      Control group    t         p
                                                                                          points)              group (n = 38)    (n = 32)
                                                                                                               Mean (SD)         Mean (SD)
                                                                                          Unit 1 exam (50)     43.76   (2.78)    44.16   (2.85)   À0.583    0.562
                                                                                          Unit 2 exam (50)     40.42   (3.09)    41.19   (3.48)   À0.976    0.332
Data analyses and results                                                                 Unit 3 exam (50)     39.18   (3.47)    37.53   (3.74)    1.915    0.060
                                                                                          Final exam (80)      65.84   (4.95)    64.59   (5.92)    0.962    0.340
Quantitative data

   A total of 70 students participated in the study. Thirty-eight
                                                                                       checks were conducted with participants following the interpreta-
were members of the experimental group while 32 served as con-
                                                                                       tion of data.
trols. Sixty-five students provided demographic data: 35 from the
                                                                                           Students generally perceived the clickers as a positive addition
experimental group and 30 from the control group. A pre-test
                                                                                       to the class. Multiple comments centered on the ‘‘fun” nature of the
did not demonstrate any significant difference between sections.
                                                                                       clickers, as one student noted ‘‘It [using the clickers] was fun. I’d
The groups appeared to be similar in all demographic and attribute
                                                                                       look forward to it.” The primary negative feature of the clickers
variables. Table 1 provides demographic data for both groups. Chi
                                                                                       that emerged was malfunction of the technology. This will be dis-
square analysis indicated no significant differences in the groups
                                                                                       cussed under educational implications. Three themes emerged
on nominal attribute variables. Likewise, t-tests indicated that
                                                                                       from the focus group data. The themes were: being able to respond
there were no significant differences between the groups on hours
                                                                                       anonymously, validating an answer while providing immediate
of employment or years working in health care. Using student’s t-
                                                                                       feedback, and providing an interactive and engaging environment.
test for exploratory analysis with alpha set at .05 (Munro, 2005), no
                                                                                           Virtually all of the participants addressed the anonymity of
significant differences between the groups on any measure of out-
                                                                                       using the clickers. The perceived benefit was ‘Being able to respond
come performance were found. Table 2 provides a comparison of
                                                                                       anonymously’. Raising one’s hand in class and answering incor-
the experimental and control group data. Therefore, no further
                                                                                       rectly in front of an entire class had the potential to be embarrass-
analysis was done.
                                                                                       ing. With the clickers ‘‘no one has to be embarrassed.” Students
                                                                                       shared that some of them conferred with the student sitting next
                                                                                       to them but ultimately selected the response they believed to be
Qualitative data                                                                       accurate independently. They liked that ‘‘no one knows you picked
                                                                                       the wrong answer.” This was certainly true when only a couple of
   For the qualitative data, the computer program, NVivoÒ, was                         students selected an incorrect answer.
used to assist with data management and analysis. Group re-                                Students perceived the second theme of ‘Validating an answer
sponses were analyzed for common themes and patterns. An audit                         while providing immediate feedback’ as a great way to confirm
trail was established to ensure credibility of the findings. Member                     and clarify their understanding of a particular concept. Addition-
                                                                                       ally, they noted that ‘‘if half of the class got it wrong, then you don’t
Table 1
                                                                                       feel so bad.” Having the faculty provide rationale for the correct re-
Demographics of sample.                                                                sponse immediately after the polling also facilitated understanding
                                                                                       of difficult concepts. Several students noted that this helped them
  Sample attribute          Total group       Clicker group    Control group
                            (N = 65)          (n = 35)         (n = 30)
                                                                                       with examinations because they could remember the discussions.
                                                                                       Another aspect of this validation focused on providing students
                            N     Valid (%)   N    Valid (%)   N     Valid (%)
                                                                                       with an idea of how they were doing with respect to the class as
  Gender                                                                               a whole and ‘‘if you’re on pace with the rest of the class”.
  Female                    62    95.4        33   94.3        29    96.7
  Male                      3      4.6        2     5.7        1      3.3
                                                                                           ‘Providing an interactive and engaging environment’ was the
                                                                                       last theme. The students perceived that they ‘‘actually started
  Marital status
  Single                    56    86.2        31   88.6        25    83.3
                                                                                       interacting more with each other in class” and ‘‘it brought the class
  Married                   5      7.7        2     5.7        3     10.0              closer.” They spoke of talking to the students next to them about
  Living with significant
                                                                                       the answers they selected and compared responses. PowerPointÒ
  Other                     3      4.6        1     2.9        2      6.7              presentations were the primary method of content delivery for this
  Divorced/separated        1      1.5        1     2.9        0      0                class and one student shared that ‘‘it gave me something to do, so I
  Race                                                                                 woke up”.
  White American/Indian     43    66.2        22   62.9        21    70
  Alaskan native            1      1.5        1     2.9        0       0
                                                                                       Discussion
  Asian                     6      9.2        4    11.4        2       6.7
  Black                     5      7.7        2     5.7        3     10.0
  African–American          8     12.3        4    11.4        4     13.3                 Student response systems are a creative, alternative strategy for
  Hispanic/Latino           1      1.5        1     2.9        0       0               reinforcing concepts, evaluating the understanding of concepts, or
  No response               1     1.5         1    2.9         -     -
                                                                                       testing. Even though in this study, the clickers did not improve
  Previous educational degree                                                          learning outcomes as measured by objective testing, perceptions
  None                       51   78.5        28   80.0        23    76.6
                                                                                       shared by the students indicated an increased degree of classroom
  Associate degree           11   16.9        6    17.1        5     16.7
  Bachelor’s degree          2    3.1         0    0           2     6.7               engagement.
  Graduate degree            1    1.5         1    2.9         0     0
  Current grade point average                                                          Exam performance
  A (3.7–4.0)               3     4.6         3    8.6         0     0
  B (2.7–3.6)               59    90.8        31   88.6        28    93.3
                                                                                         Objective testing scores were not significantly different for the
  C (2.0–2.6)               3     4.6         1    2.9         2     6.7
                                                                                       two groups. It is possible that due to the technological problems
606                                            B. Patterson et al. / Nurse Education Today 30 (2010) 603–607


and the limited intervention time that the experimental group did               the end of 6 classes. Increasing the frequency of use and/or number
not have sufficient time with the clickers to demonstrate a signif-              of class times, as well as exploring different options for use during
icant increase on test scores. The literature reveals mixed results             the class may have an impact on objective outcomes. Second, prob-
with respect to change in exam performance, from no change (Fies,               lems with technology, such as a ‘cleaner’ software program that
2005; Stein et al., 2006) to positive effects (Hall et al., 2005;               erased the TurningPointÒ software each night, and the need to
Morling et al., 2008). Further research is needed in this area if SRSs          use the same USB port each session contributed to frustration for
are adopted as a best practice in nursing education.                            both the faculty and students. Students expressed disappointment
                                                                                when the technology did not function. The majority of the techno-
                                                                                logical problems were resolved before the end of the semester as
Classroom engagement
                                                                                faculty mastered the system. A third limitation was the non-ran-
                                                                                dom assignment of sample. Students selected the morning or after-
    The data from this study suggest that the outcome variable may
                                                                                noon section they wanted on personal preference.
not be test scores. The qualitative data support increased engage-
ment and interaction in the classroom. Neither degree of engage-
ment or attendance was measured in this study. Several authors                  Implications for nursing education
have referred to clickers as electronic ‘entertainment toys’ (Cono-
ley et al., 2006). Even with the entertainment aspect, if students at-              Implications for teaching and learning include (1) encouraging
tend class, want to participate, and experience enhanced attention;             active learning by facilitating interaction and engagement of stu-
use of the clickers may be worth the effort. Engagement has been                dents in large class settings; (2) encouraging participation among
assessed in several previous studies (Bullock et al., 2002; Morling             students by allowing students reluctant to interact in large groups
et al., 2008; Fies, 2005). Morling et al. (2008) assessed engagement            to actively participate; (3) providing prompt feedback so a student
with items that focused on attendance, reading prior to class, en-              can identify misunderstanding of concepts during a class, thus
joyed coming to class, and paying attention in class. However,                  allowing the student to validate his/her understanding and seek
these items may not sufficiently capture engagement and facilitate               assistance prior to testing; and (4) allowing faculty to ascertain
learning. Faculty needs to examine their own practices in the class-            student areas of difficulty prior to evaluation and give meaningful
room with respect to the activities that they believe are engaging.             feedback during a specific lesson (Skiba, 2006). In addition, the
Additionally, it seems that examining what students believe en-                 data may be used to facilitate course and teaching strategy
gage them in the classroom would also be beneficial.                             revisions.
    Rhem (2007) notes that faculty need to get a ‘‘sense of what                    This was the first use of this particular technology for these
constitutes the best practices or pedagogies for evoking student                researchers and despite the fact that there was a lack of significant
engagement in a specific course compared with students’ assess-                  objective data, the use of SRS seems to offer promise in increasing
ment of how often they are participating” (10). He suggests that                student engagement. Smart classrooms are becoming a standard
assessing both faculty (FSSE: faculty survey on student engage-                 feature at most institutions of higher education, with SRS being
ment) and student (CLASSE: classroom survey of student engage-                  only one of the new advances in the educational setting. These de-
ment) perceptions of engagement in a specific course may                         vices are effective for a multitude of uses, relatively easy to use,
provide more effective and compelling information for faculty to                and suitable for higher education. However, faculty needs to be
formulate pedagogical choices. Likewise, administration of these                clear about the rationale for any alternative teaching strategy rel-
tools, pre and post semester may offer better insight into what                 ative to the investment of time and money. Specifically with click-
the best practice for engagement is in a particular classroom                   ers, faculty needs to make pedagogical decisions regarding their
setting.                                                                        use. How will they be used in class? Considerations might include
    Given the size of the class and structure of the classroom in this          whether the use is for formative or summative assessment, indi-
study, one goal was to increase interaction among the students                  vidual versus group assessment.
during class. Interestingly, the focus group data supported the per-                As student profiles change, faculty must adapt to the varied
ception of increased interaction; however, it was the anonymity                 learning needs of the students to accomplish the mission of nurs-
the clickers provided that the students seemed to prefer and focus              ing education. Additionally, technology is rapidly evolving offering
upon. Other researchers have also reported this finding (Fies and                new and innovative teaching/learning approaches that faculty
Marshall, 2006). Additionally, the literature seems to indicate                 must investigate as to their pedagogical value. Replication of this
mixed results as to whether clicker technology can really trans-                study with a larger sample, combined with other alternative strat-
form the learning environment (Fies and Marshall, 2006). While                  egies seems indicated as nursing education seeks to expand its evi-
students may enjoy the technology and ‘wake up’ in class, costs                 dence on alternative classroom strategies. This study has
of acquiring and maintaining the system, faculty time investment,               contributed to the body of nursing education literature on evi-
as well as dedicated technology support services, demands further               dence-based teaching approaches and the incorporation of wire-
examination of the impact of these devices on actual learning. If               less technology in professional nursing education.
this method does not involve active dialogue among faculty and
students about the questions and their distracters, a push of a but-
                                                                                Conclusions
ton may have replaced opportunities for thinking aloud and prac-
ticing verbal communication skills in the class setting. Likewise,
                                                                                    Despite no significant differences between the two sections in
moving the focus away from the passive environment of a large
                                                                                objective testing, the nursing students in the experimental section
lecture classroom to an engaged interactive classroom may neces-
                                                                                of this study generally perceived the clickers as a positive addition
sitate consideration of a variety of alternative strategies.
                                                                                to the classroom environment. The use of clickers seemed to in-
                                                                                crease interaction and engagement in the classroom. The students
Limitations                                                                     also identified the benefits of anonymity of responses and immedi-
                                                                                ate feedback as facilitators to understanding complex concepts.
   A number of limitations existed that may have influenced the                  Clearly, further research is warranted examining active learning
outcomes for this study. First, the use of the clickers during class            strategies, such as clickers, with student engagement and knowl-
time was limited to a brief time period, approximately 15 min, at               edge acquisition.
B. Patterson et al. / Nurse Education Today 30 (2010) 603–607                                                    607


Acknowledgements                                                                             Herreid, C., 2006. ‘‘Clicker” cases: introducing case study teaching into large
                                                                                                 classrooms. Journal of College Science Teaching 36 (2), 43–47.
                                                                                             Knight, J., Wood, W.B., 2005. Teaching more by teaching less. Cell Biology Education
    The authors acknowledge Dr. Elizabeth Bayley, statistical con-                               4, 298–310.
sultant, and Evelyn Christy, nursing student, for their contributions                        Latessa, R., Mouw, D., 2005. Use of an audience response system to augment
                                                                                                 interactive learning. Innovations in Family Medicine Education 37 (1), 12–14.
to this research study. Funding acknowledgement: PHENSA Penn-
                                                                                             Miller, R., Ashar, B., Getz, K., 2003. Evaluation of an audience response system for
sylvania Higher Education Nursing Schools Association.                                           the continuing education of health professionals. The Journal of Continuing
                                                                                                 Education in the Health Professions 23, 109–115.
                                                                                             Morling, B., McAuliffe, M., Cohen, L., DiLorenzo, T., 2008. Efficacy of personal
References
                                                                                                 response systems (‘‘clickers”) in large, introductory psychology classes.
                                                                                                 Teaching of Psychology 35 (1), 45–50.
American Association of Colleges in Nursing (AACN), 2008. Nursing Shortage Fact              Munro, B., 2005. Statistical Methods for Health Care Research, fifth ed. Lippincott
    Sheet. http://www.aacn.nche.edu/Media/FactSheets/NursingShortage.htm.                        Wilkins and Williams, Philadelphia, Pennsylvania.
Banks, D., 2006. Audience Response Systems in Higher Education. Information                  Rhem, J., 2007. CLASSE: the missing link. The National Teaching and Learning
    Science Publishing, Hershey, Pennsylvania.                                                   Forum, vol. 16 (4). http://www.ntlf.com/html/ti/classe.htm.
Bruff, D., 2006. Research on the Effectiveness of Classroom Response Systems.                Sawada, D., 2002. Learning from past and present: electronic response systems in
    http://www.vanderbilt.edu/cft/resources/teaching_resources/technology/                       college lecture halls. The Free Library. http://www.thefreelibrary.com./
    crs.htm.                                                                                     Learning from past and present: electronic response systems in. . .-
Bullock, D., LaBella, V., Clingan, T., Ding, Z., Stewart, G., Thibado, P., 2002. Enhancing       a091487242).
    student–instructor interaction frequency. The Physics Teacher 40, 30–36.                 Schackow, T., Chavez, M., Loya, L., Friedman, M., 2004. Audience response system:
Burns, N., Grove, S., 2009. The Practice of Nursing Research: Conduct, Critique, and             effect on learning in family medicine residents. Family medicine 36, 496–504.
    Utilization, sixth ed. Elsevier Saunders, St Louis, Missouri.                            Skiba, D., 2006. Got large lecture hall classes? Use clickers. Nursing Education
Conoley, J., Moore, G., Croom, B., Flowers, J., 2006. A toy or a teaching tool? The use          Perspectives 27, 278–280.
    of audience–response systems in the classroom. Techniques: Connecting                    Stein, P., Challman, S., Brueckner, J., 2006. Using audience response technology for
    Education and Careers 81 (7), 46–48.                                                         pretest reviews in an undergraduate nursing course. Journal of Nursing
Donovan, M., Bransford, J., Pellegrino, J. (Eds.), 1999. How People Learn: Bridging              Education 45, 469–473.
    Research and Practice. National Academy Press, Washington, DC.                           Stowell, J., Nelson, J., 2007. Benefits of electronic audience response systems on
Draper, S., Brown, M., 2004. Increasing interactivity in lectures using an electronic            student participation, learning, and emotion. Teaching of Psychology 34, 253–
    voting system. Journal of Computer Assisted Learning 20 (2), 81–94.                          258.
Duncan, D., 2005. Clickers in the Classroom: How to Enhance Science Teaching                 Trapskin, P., Smith, K., Armstead, J., Davis, G., 2005. Use of an audience response
    Using Classroom Response Systems. Addison-Wesley, New York.                                  system to introduce an anticoagulation guide to physicians, pharmacists, and
Fies, C., 2005. Classroom Response Systems: What do They Add to an Active                        pharmacy students. American Journal of Pharmaceutical Education 69, 190–
    Learning Environment? Doctoral Dissertation, Dissertation Abstracts                          197.
    International, vol. 66. University of Texas at Austin, p. 3195271.                       Uhari, M., Renko, M., Soini, H., 2003. Experiences of using an interactive audience
Fies, C., Marshall, J., 2006. Classroom response systems: a review of the literature.            response system in lectures. BMC Medical Education, vol. 3 (12). http://
    Journal of Science Education and Technology 15 (1), 101–109.                                 www.biomedcentral.com/1472-6920/3/12.
Guthrie, R., Carlin, A., 2004. Waking the dead: using interactive technology to              Yourstone, S.A., Kraye, H.S., Albaum, G., 2008. Classroom questioning with
    engage passive listeners in the classroom. In: Proceedings of the Tenth Americas             immediate electronic response: do clickers improve learning? Decision
    Conference on Information Systems, New York, NY. http://www.mhhe.com/cps/                    Sciences Journal of Innovative Education 6 (1), 75–88.
    docs/CPSWP_WakindDead082003.pdf.                                                         Zhu, E., 2007. How are faculty using clickers in the classroom? Center for Research
Hall, R., Collier, H., Thomas, M., Hilgers, M., 2005. A student response system for              on Teaching and Learning Occasional, Paper No. 22. http://www.crlt.umich.edu/
    increasing engagement, motivation, and learning in higher enrollment lectures.               publinks/CRLT_no22.pdf.
    In: Proceedings of the Eleventh Americas Conference on Information Systems,
    Omaha, NE, USA. http://lite.mst.edu/documents/hall_et_al_srs_amcis_pro
    ceedings.pdf.

Contenu connexe

Tendances

MSUD UG Rsrch Day Apr 2016 - Rsch prnstn UPDATED 4-21-16 v4
MSUD UG Rsrch Day Apr 2016 - Rsch prnstn UPDATED 4-21-16 v4MSUD UG Rsrch Day Apr 2016 - Rsch prnstn UPDATED 4-21-16 v4
MSUD UG Rsrch Day Apr 2016 - Rsch prnstn UPDATED 4-21-16 v4Johnny Sandoval
 
Pilot Study Publication (in press)
Pilot Study Publication (in press)Pilot Study Publication (in press)
Pilot Study Publication (in press)naomi tutticci
 
Pnas 2014-freeman-1319030111
Pnas 2014-freeman-1319030111Pnas 2014-freeman-1319030111
Pnas 2014-freeman-1319030111telcalit2
 
11.the effectiveness of teaching physics through project method on academic a...
11.the effectiveness of teaching physics through project method on academic a...11.the effectiveness of teaching physics through project method on academic a...
11.the effectiveness of teaching physics through project method on academic a...Alexander Decker
 
Vebrianto 2011 procedia---social-and-behavioral-sciences (The effect of multi...
Vebrianto 2011 procedia---social-and-behavioral-sciences (The effect of multi...Vebrianto 2011 procedia---social-and-behavioral-sciences (The effect of multi...
Vebrianto 2011 procedia---social-and-behavioral-sciences (The effect of multi...Rian vebrianto
 
International Journal of Humanities and Social Science Invention (IJHSSI)
International Journal of Humanities and Social Science Invention (IJHSSI)International Journal of Humanities and Social Science Invention (IJHSSI)
International Journal of Humanities and Social Science Invention (IJHSSI)inventionjournals
 
Ijaprr vol1-2-15-74-79rajeshshiv
Ijaprr vol1-2-15-74-79rajeshshivIjaprr vol1-2-15-74-79rajeshshiv
Ijaprr vol1-2-15-74-79rajeshshivijaprr_editor
 
Some factors affecting the performance of secondary school students in chemi...
 Some factors affecting the performance of secondary school students in chemi... Some factors affecting the performance of secondary school students in chemi...
Some factors affecting the performance of secondary school students in chemi...Alexander Decker
 
A study of the effects of electronic
A study of the effects of electronicA study of the effects of electronic
A study of the effects of electronicijcsit
 
Effective STEM Education Strategies for Diverse and Underserved Learners
Effective STEM Education Strategies for Diverse and Underserved Learners Effective STEM Education Strategies for Diverse and Underserved Learners
Effective STEM Education Strategies for Diverse and Underserved Learners Elaine Machado
 
HPSN 2012: Large Class Simulation
HPSN 2012: Large Class SimulationHPSN 2012: Large Class Simulation
HPSN 2012: Large Class SimulationLori Lioce
 
Metacognitive Teaching Strategies on Secondary School Students Academic Perfo...
Metacognitive Teaching Strategies on Secondary School Students Academic Perfo...Metacognitive Teaching Strategies on Secondary School Students Academic Perfo...
Metacognitive Teaching Strategies on Secondary School Students Academic Perfo...ijceronline
 
Mathematics abilities of physics students implication for the application and...
Mathematics abilities of physics students implication for the application and...Mathematics abilities of physics students implication for the application and...
Mathematics abilities of physics students implication for the application and...Alexander Decker
 
Higher order cognitive skills
Higher order cognitive skillsHigher order cognitive skills
Higher order cognitive skillsShaar Mini
 
Assessing assessment literacy of science teachers in public secondary schools...
Assessing assessment literacy of science teachers in public secondary schools...Assessing assessment literacy of science teachers in public secondary schools...
Assessing assessment literacy of science teachers in public secondary schools...Alexander Decker
 
Effect of Multimodal Instructional Approaches on Students Learning of Chemist...
Effect of Multimodal Instructional Approaches on Students Learning of Chemist...Effect of Multimodal Instructional Approaches on Students Learning of Chemist...
Effect of Multimodal Instructional Approaches on Students Learning of Chemist...Premier Publishers
 
A Comparison of Student Achievement & Retention in an Introductory Math Course
A Comparison of Student Achievement & Retention in an Introductory Math CourseA Comparison of Student Achievement & Retention in an Introductory Math Course
A Comparison of Student Achievement & Retention in an Introductory Math Coursetcc07
 

Tendances (20)

MSUD UG Rsrch Day Apr 2016 - Rsch prnstn UPDATED 4-21-16 v4
MSUD UG Rsrch Day Apr 2016 - Rsch prnstn UPDATED 4-21-16 v4MSUD UG Rsrch Day Apr 2016 - Rsch prnstn UPDATED 4-21-16 v4
MSUD UG Rsrch Day Apr 2016 - Rsch prnstn UPDATED 4-21-16 v4
 
Pilot Study Publication (in press)
Pilot Study Publication (in press)Pilot Study Publication (in press)
Pilot Study Publication (in press)
 
Pnas 2014-freeman-1319030111
Pnas 2014-freeman-1319030111Pnas 2014-freeman-1319030111
Pnas 2014-freeman-1319030111
 
11.the effectiveness of teaching physics through project method on academic a...
11.the effectiveness of teaching physics through project method on academic a...11.the effectiveness of teaching physics through project method on academic a...
11.the effectiveness of teaching physics through project method on academic a...
 
Vebrianto 2011 procedia---social-and-behavioral-sciences (The effect of multi...
Vebrianto 2011 procedia---social-and-behavioral-sciences (The effect of multi...Vebrianto 2011 procedia---social-and-behavioral-sciences (The effect of multi...
Vebrianto 2011 procedia---social-and-behavioral-sciences (The effect of multi...
 
International Journal of Humanities and Social Science Invention (IJHSSI)
International Journal of Humanities and Social Science Invention (IJHSSI)International Journal of Humanities and Social Science Invention (IJHSSI)
International Journal of Humanities and Social Science Invention (IJHSSI)
 
Ijaprr vol1-2-15-74-79rajeshshiv
Ijaprr vol1-2-15-74-79rajeshshivIjaprr vol1-2-15-74-79rajeshshiv
Ijaprr vol1-2-15-74-79rajeshshiv
 
Some factors affecting the performance of secondary school students in chemi...
 Some factors affecting the performance of secondary school students in chemi... Some factors affecting the performance of secondary school students in chemi...
Some factors affecting the performance of secondary school students in chemi...
 
A study of the effects of electronic
A study of the effects of electronicA study of the effects of electronic
A study of the effects of electronic
 
Effective STEM Education Strategies for Diverse and Underserved Learners
Effective STEM Education Strategies for Diverse and Underserved Learners Effective STEM Education Strategies for Diverse and Underserved Learners
Effective STEM Education Strategies for Diverse and Underserved Learners
 
HPSN 2012: Large Class Simulation
HPSN 2012: Large Class SimulationHPSN 2012: Large Class Simulation
HPSN 2012: Large Class Simulation
 
Metacognitive Teaching Strategies on Secondary School Students Academic Perfo...
Metacognitive Teaching Strategies on Secondary School Students Academic Perfo...Metacognitive Teaching Strategies on Secondary School Students Academic Perfo...
Metacognitive Teaching Strategies on Secondary School Students Academic Perfo...
 
The Influences Virtual Physics Laboratory (VPL) For Assessment the Millennial...
The Influences Virtual Physics Laboratory (VPL) For Assessment the Millennial...The Influences Virtual Physics Laboratory (VPL) For Assessment the Millennial...
The Influences Virtual Physics Laboratory (VPL) For Assessment the Millennial...
 
Mathematics abilities of physics students implication for the application and...
Mathematics abilities of physics students implication for the application and...Mathematics abilities of physics students implication for the application and...
Mathematics abilities of physics students implication for the application and...
 
ICESD Conference Paper 26
ICESD Conference Paper 26ICESD Conference Paper 26
ICESD Conference Paper 26
 
Higher order cognitive skills
Higher order cognitive skillsHigher order cognitive skills
Higher order cognitive skills
 
Proposal
ProposalProposal
Proposal
 
Assessing assessment literacy of science teachers in public secondary schools...
Assessing assessment literacy of science teachers in public secondary schools...Assessing assessment literacy of science teachers in public secondary schools...
Assessing assessment literacy of science teachers in public secondary schools...
 
Effect of Multimodal Instructional Approaches on Students Learning of Chemist...
Effect of Multimodal Instructional Approaches on Students Learning of Chemist...Effect of Multimodal Instructional Approaches on Students Learning of Chemist...
Effect of Multimodal Instructional Approaches on Students Learning of Chemist...
 
A Comparison of Student Achievement & Retention in an Introductory Math Course
A Comparison of Student Achievement & Retention in an Introductory Math CourseA Comparison of Student Achievement & Retention in an Introductory Math Course
A Comparison of Student Achievement & Retention in an Introductory Math Course
 

En vedette

1 s2.0-s026069170900238 x-main pdf paula
1 s2.0-s026069170900238 x-main pdf paula1 s2.0-s026069170900238 x-main pdf paula
1 s2.0-s026069170900238 x-main pdf paulapaulacasanrodriguez
 
Atanu Acharya Resume 2015
Atanu Acharya Resume 2015Atanu Acharya Resume 2015
Atanu Acharya Resume 2015atanu acharya
 
A socially Geo-localized Web
A socially Geo-localized WebA socially Geo-localized Web
A socially Geo-localized WebNuno Khan
 
Biashara ya mtandao na flp
Biashara ya mtandao na flpBiashara ya mtandao na flp
Biashara ya mtandao na flpLouis Hosea
 
Tutorial2003
Tutorial2003Tutorial2003
Tutorial2003chibi12
 
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. humPemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. humKusuma Nurin Husna
 
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. humPemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. humKusuma Nurin Husna
 
Project report on gdp and inflation
Project report on gdp and inflationProject report on gdp and inflation
Project report on gdp and inflationharryz18
 
Fee collection system
Fee collection systemFee collection system
Fee collection systemharryz18
 

En vedette (18)

1 s2.0-s026069170900238 x-main pdf paula
1 s2.0-s026069170900238 x-main pdf paula1 s2.0-s026069170900238 x-main pdf paula
1 s2.0-s026069170900238 x-main pdf paula
 
Unsmk2002 b.inggris
Unsmk2002 b.inggrisUnsmk2002 b.inggris
Unsmk2002 b.inggris
 
Daytop NJ Academy
Daytop NJ AcademyDaytop NJ Academy
Daytop NJ Academy
 
Atanu Acharya Resume 2015
Atanu Acharya Resume 2015Atanu Acharya Resume 2015
Atanu Acharya Resume 2015
 
Waypointe presentation - introduction
Waypointe presentation - introductionWaypointe presentation - introduction
Waypointe presentation - introduction
 
A socially Geo-localized Web
A socially Geo-localized WebA socially Geo-localized Web
A socially Geo-localized Web
 
Biashara ya mtandao na flp
Biashara ya mtandao na flpBiashara ya mtandao na flp
Biashara ya mtandao na flp
 
Tutorial2003
Tutorial2003Tutorial2003
Tutorial2003
 
Ponencia de Paz
Ponencia de PazPonencia de Paz
Ponencia de Paz
 
Digital Portfolio
Digital PortfolioDigital Portfolio
Digital Portfolio
 
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. humPemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
 
2005 smp inggris_p1
2005 smp inggris_p12005 smp inggris_p1
2005 smp inggris_p1
 
Pemahaman dasar filsafat ilmu
Pemahaman dasar filsafat ilmuPemahaman dasar filsafat ilmu
Pemahaman dasar filsafat ilmu
 
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. humPemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
Pemahaman dasar filsafat ilmu oleh drs. mhd. saeri, m. hum
 
kanker ovarium
kanker ovariumkanker ovarium
kanker ovarium
 
12
1212
12
 
Project report on gdp and inflation
Project report on gdp and inflationProject report on gdp and inflation
Project report on gdp and inflation
 
Fee collection system
Fee collection systemFee collection system
Fee collection system
 

Similaire à Evidence for teaching practice: The impact of clickers in a large classroom

Faculty Adoption of Technologies in Team-Based Learning Classrooms
Faculty Adoption of Technologies in Team-Based Learning ClassroomsFaculty Adoption of Technologies in Team-Based Learning Classrooms
Faculty Adoption of Technologies in Team-Based Learning ClassroomsBradford Wheeler
 
Article Writing Assignments With A Metacognitive Component Enhance Learning I...
Article Writing Assignments With A Metacognitive Component Enhance Learning I...Article Writing Assignments With A Metacognitive Component Enhance Learning I...
Article Writing Assignments With A Metacognitive Component Enhance Learning I...Fiona Phillips
 
11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...Alexander Decker
 
11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...Alexander Decker
 
11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...Alexander Decker
 
kabir a m external.pptx
kabir a m external.pptxkabir a m external.pptx
kabir a m external.pptxMusaargungu
 
11.the efficacy of homogeneous groups in enhancing individual learning
11.the efficacy of homogeneous groups in enhancing individual learning11.the efficacy of homogeneous groups in enhancing individual learning
11.the efficacy of homogeneous groups in enhancing individual learningAlexander Decker
 
The efficacy of homogeneous groups in enhancing individual learning
The efficacy of homogeneous groups in enhancing individual learningThe efficacy of homogeneous groups in enhancing individual learning
The efficacy of homogeneous groups in enhancing individual learningAlexander Decker
 
Effects of computer based mastery learning on secondary school students’ moti...
Effects of computer based mastery learning on secondary school students’ moti...Effects of computer based mastery learning on secondary school students’ moti...
Effects of computer based mastery learning on secondary school students’ moti...Alexander Decker
 
The Effect of STEM Project Based Learning on Self-Efficacy among High-School ...
The Effect of STEM Project Based Learning on Self-Efficacy among High-School ...The Effect of STEM Project Based Learning on Self-Efficacy among High-School ...
The Effect of STEM Project Based Learning on Self-Efficacy among High-School ...Nader Ale Ebrahim
 
Using e instruction’s® cps™ to support effective instruction
Using e instruction’s® cps™ to support effective instructionUsing e instruction’s® cps™ to support effective instruction
Using e instruction’s® cps™ to support effective instructionCCS Presentation Systems Inc.
 
Effect of blended learning approach on student nurses’ attitudes and academic...
Effect of blended learning approach on student nurses’ attitudes and academic...Effect of blended learning approach on student nurses’ attitudes and academic...
Effect of blended learning approach on student nurses’ attitudes and academic...Alexander Decker
 
Dissertation Proposal
Dissertation ProposalDissertation Proposal
Dissertation ProposalMuhammad Riaz
 
A Summary Of Nine Key Studies Multi-Tier Intervention And Response To Interv...
A Summary Of Nine Key Studies  Multi-Tier Intervention And Response To Interv...A Summary Of Nine Key Studies  Multi-Tier Intervention And Response To Interv...
A Summary Of Nine Key Studies Multi-Tier Intervention And Response To Interv...Lori Moore
 
An inquiry based cellulase laboratory
An inquiry based cellulase laboratoryAn inquiry based cellulase laboratory
An inquiry based cellulase laboratorykamegasilvia
 
7.effectiveteachingmethodsforlargerclasses
7.effectiveteachingmethodsforlargerclasses7.effectiveteachingmethodsforlargerclasses
7.effectiveteachingmethodsforlargerclassesrealhope
 
for publication.pdf
for publication.pdffor publication.pdf
for publication.pdfsdfghj21
 

Similaire à Evidence for teaching practice: The impact of clickers in a large classroom (20)

Faculty Adoption of Technologies in Team-Based Learning Classrooms
Faculty Adoption of Technologies in Team-Based Learning ClassroomsFaculty Adoption of Technologies in Team-Based Learning Classrooms
Faculty Adoption of Technologies in Team-Based Learning Classrooms
 
Article Writing Assignments With A Metacognitive Component Enhance Learning I...
Article Writing Assignments With A Metacognitive Component Enhance Learning I...Article Writing Assignments With A Metacognitive Component Enhance Learning I...
Article Writing Assignments With A Metacognitive Component Enhance Learning I...
 
abstract published
abstract publishedabstract published
abstract published
 
11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...
 
11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...
 
11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...11.learning styles among medical students, a case study of ladoke akintola un...
11.learning styles among medical students, a case study of ladoke akintola un...
 
kabir a m external.pptx
kabir a m external.pptxkabir a m external.pptx
kabir a m external.pptx
 
Jenest poster
Jenest posterJenest poster
Jenest poster
 
11.the efficacy of homogeneous groups in enhancing individual learning
11.the efficacy of homogeneous groups in enhancing individual learning11.the efficacy of homogeneous groups in enhancing individual learning
11.the efficacy of homogeneous groups in enhancing individual learning
 
The efficacy of homogeneous groups in enhancing individual learning
The efficacy of homogeneous groups in enhancing individual learningThe efficacy of homogeneous groups in enhancing individual learning
The efficacy of homogeneous groups in enhancing individual learning
 
Effects of computer based mastery learning on secondary school students’ moti...
Effects of computer based mastery learning on secondary school students’ moti...Effects of computer based mastery learning on secondary school students’ moti...
Effects of computer based mastery learning on secondary school students’ moti...
 
The Effect of STEM Project Based Learning on Self-Efficacy among High-School ...
The Effect of STEM Project Based Learning on Self-Efficacy among High-School ...The Effect of STEM Project Based Learning on Self-Efficacy among High-School ...
The Effect of STEM Project Based Learning on Self-Efficacy among High-School ...
 
Using e instruction’s® cps™ to support effective instruction
Using e instruction’s® cps™ to support effective instructionUsing e instruction’s® cps™ to support effective instruction
Using e instruction’s® cps™ to support effective instruction
 
Effect of blended learning approach on student nurses’ attitudes and academic...
Effect of blended learning approach on student nurses’ attitudes and academic...Effect of blended learning approach on student nurses’ attitudes and academic...
Effect of blended learning approach on student nurses’ attitudes and academic...
 
Dissertation Proposal
Dissertation ProposalDissertation Proposal
Dissertation Proposal
 
A Summary Of Nine Key Studies Multi-Tier Intervention And Response To Interv...
A Summary Of Nine Key Studies  Multi-Tier Intervention And Response To Interv...A Summary Of Nine Key Studies  Multi-Tier Intervention And Response To Interv...
A Summary Of Nine Key Studies Multi-Tier Intervention And Response To Interv...
 
An inquiry based cellulase laboratory
An inquiry based cellulase laboratoryAn inquiry based cellulase laboratory
An inquiry based cellulase laboratory
 
7.effectiveteachingmethodsforlargerclasses
7.effectiveteachingmethodsforlargerclasses7.effectiveteachingmethodsforlargerclasses
7.effectiveteachingmethodsforlargerclasses
 
Ej1100181
Ej1100181Ej1100181
Ej1100181
 
for publication.pdf
for publication.pdffor publication.pdf
for publication.pdf
 

Evidence for teaching practice: The impact of clickers in a large classroom

  • 1. Nurse Education Today 30 (2010) 603–607 Contents lists available at ScienceDirect Nurse Education Today journal homepage: www.elsevier.com/nedt Evidence for teaching practice: The impact of clickers in a large classroom environment Barbara Patterson *, Judith Kilpatrick, Eric Woebkenberg Widener University, School of Nursing, One University Place Chester, PA 19013, United States a r t i c l e i n f o s u m m a r y Article history: As the number of nursing students increases, the ability to actively engage all students in a large class- Accepted 3 December 2009 room is challenging and increasingly difficult. Clickers, or student response systems (SRS), are a relatively new technology in nursing education that use wireless technology and enable students to select individ- ual responses to questions posed to them during class. Keywords: The study design was a quasi-experimental comparison with one section of an adult medical–surgical Active learning course using the SRS and one receiving standard teaching. No significant differences between groups on Evidence-based teaching practice any measure of performance were found. Focus groups were conducted to describe student perceptions Classroom technology Baccalaureate nursing students of SRS. Three themes emerged: Being able to respond anonymously, validating an answer while providing immediate feedback, and providing an interactive and engaging environment. Although the clickers did not improve learning outcomes as measured by objective testing, perceptions shared by students indi- cated an increased degree of classroom engagement. Future research needs to examine other potential outcome variables. Ó 2009 Elsevier Ltd. All rights reserved. Introduction responses back to the faculty’s computer that instantly tabulates the data. The class then reviews the displayed data. Multiple appli- Enrollments in schools of nursing in the United States have in- cations for SRS exist, such as, recording of attendance, question and creased substantially in the last few years (American Association of answer sessions, opinion polls, voting, quizzes, tests, and group Colleges in Nursing, 2008), from class sizes of 20–30 to incoming decision making activities (Duncan, 2005;Fies and Marshall, 2006). classes of 150–200 students. As the number of nursing students in- Educators have recognized the use of technology and its addi- creases, the ability to actively engage all students in large lecture tional value to the classroom experience in elementary and higher style classrooms is challenging and increasingly more difficult. Ac- education for many years (Banks, 2006). The National Research tive strategies and discussion are often limited by the physical Council (Donovan et al., 1999) states that classroom response sys- structure of the room, inability to hear student responses, and tems and the related pedagogy have great potential to transform the dominance of responses from a small percentage of students classrooms to be more learner-knowledge and assessment-ori- (Herreid, 2006). Examination of the efficacy of alternative interac- ented. The current literature in higher education on the topic is pri- tive teaching and learning strategies is necessary for the establish- marily found in the professional schools of medicine, dentistry, ment and support of best teaching practices. physical and occupational health as well as in schools of business One approach to engaging students in classrooms maybe the and sciences such as physics (Bruff, 2006; Draper and Brown, use of a student response system (SRS) (audience response systems 2004; Schackow et al., 2004; Trapskin et al., 2005). With the in- (ARS) or ‘clickers’). It is a relatively new technology in nursing edu- creased sizes of nursing classes, the use of SRS may be an impor- cation that uses wireless technology and enables students to select tant tool to increase student interaction and engagement while individual responses to questions posed to them by a faculty mem- also improving objective student outcomes. Further empirical ber during the class (Fies and Marshall, 2006; Skiba, 2006). The investigation seemed warranted. wireless response systems may elicit feedback from a small or large group. These small, computerized devices transmit individual Literature review Student response systems (SRS) have been in existence for over * Corresponding author. Tel.: +1 610 499 4222; fax: +1 610 499 4216. E-mail addresses: bjpatterson@mail.widener.edu (B. Patterson), jakilpatrick@ three decades (Sawada, 2002). These systems have been used in a mail.widener.edu (J. Kilpatrick), eewoebkenberg@mail.widener.edu (E. Woebken- variety of different contexts, professional continuing education to berg). undergraduate classes. In a review of the educational literature 0260-6917/$ - see front matter Ó 2009 Elsevier Ltd. All rights reserved. doi:10.1016/j.nedt.2009.12.008
  • 2. 604 B. Patterson et al. / Nurse Education Today 30 (2010) 603–607 on student response systems, Fies and Marshall (2006) have noted and one section of the same course receiving standard teaching. A that much of the existing literature is anecdotal and there is a need quasi-experimental design was appropriate for this study since the for rigorous exploration of this technology across diverse popula- students independently registered for class sections and were not tions and pedagogies. These authors noted that there seems to be randomly assigned to a section. The use of a comparison group, a general agreement that SRSs ‘‘promote learning when coupled which received no intervention, increased ‘‘the ability of researcher with appropriate pedagogical methodologies” (Fies and Marshall, to detect differences between groups in the real world” (Burns and 2006, p. 106). Findings from several studies involving SRS have re- Grove, 2009, p. 253). The independent variable was the teaching ported positive student perceptions about learning (Guthrie and strategy of the SRS or clicker use during class. The dependent vari- Carlin, 2004), increased student participation (Latessa and Mouw, ables were the three unit exams and the final exam. A qualitative 2005), greater positive emotion (Stowell and Nelson, 2007), and descriptive component using focus group methodology described facilitation of student achievement (Uhari et al., 2003). Despite student perceptions of the use of clickers in the classroom. generally positive reviews, several authors reported limitations of SRSs: reliability of the system, cost, technical knowledge, and interruption in flow of class (Knight and Wood, 2005; Zhu, 2007). Setting and sample The findings with respect to objective test scores and percep- tions of SRSs have been mixed. One study in the nursing literature The setting for this study was a school of nursing at a private (Stein et al., 2006) examined the use of a student response system university located in the mid-Atlantic region of the United States. for pre-test reviews in an anatomy and physiology class. While no The course was taught in a fixed seat amphitheater style class- significant improvement in examination scores was found, stu- room. The design of this classroom does not facilitate the creation dents demonstrated positive attitudes and a perceived benefit with of small groups for the use of interactive teaching strategies. The the use of the technology. Morling et al. (2008) used clickers with sampling for this study was of convenience. All students in two four sections of an introductory psychology course (N = 1290). The sections of a junior level adult medical–surgical nursing course results supported a small positive effect on exam scores. Students were invited to participate in the fall 2007. There were no exclu- in their study did not report feeling significantly more engaged in sion criteria. All of the students enrolled in the study (N = 70). Stu- class. Similarly, in another large sample (N = 1221) experimental dents in the morning section comprised the experimental group study, Hall et al. (2005) reported a significant improvement in test (n = 38) and the afternoon section of students was the control scores from previous years in undergraduate chemistry lecture group (n = 32). All students in the experimental group were invited courses. Their students perceived the classes with SRSs to be ‘‘more to participate in one of three focus groups. engaging, motivational, and increased learning” (Hall et al. 2005, p. 1). Yourstone et al. (2008) found a positive impact on learning on test scores with undergraduate operations management students Procedure (N = 190). They compared entrance examination scores with a final examination. The authors cautioned that the clickers may not have Prior to initiating the study, Institutional Review Board approval been the reason for improvement in test scores and further re- was obtained. On the first day of class, the investigators answered search is necessary. all questions about the study prior to students signing the in- Participant knowledge scores did not improve significantly when formed consent. All students completed a demographic data form. a SRS was used in a continuing medical education program for phy- Participation in the study was voluntary and students were offered sicians and health care professionals (Miller et al., 2003). However, the alternative to not participate. Students were informed that participants rated the speaker and presentation quality more favor- their decision to participate had no effect on their class standing ably when the SRSs were used. Learning outcomes and student atti- or grades. No compensation or course credit for participation was tudes were outcome variables in a study by Fies (2005). She video- provided. The faculty member teaching the course de-identified recorded classroom discussions for evidence of participation and all test score data prior to entry into the database by the primary use of SRSs. There was no improvement from pre-test to post-test investigator. No students withdrew from the study during the scores; however, students indicated an increase to understand as op- course of the semester. posed to lecture style delivery of content. The same faculty member facilitated the course in both the With a dearth of research examining learning outcomes and SRSs morning and afternoon. She taught the same content weekly to with nursing students, the primary purpose of this study was to eval- each section and all students completed the same pre-test, unit uate the effectiveness of a teaching intervention using a SRS in the tests, and final exam. At the end of each class, both sections an- classroom setting with junior baccalaureate nursing students. A sec- swered the same multiple-choice review questions on content dis- ond purpose of this study was to describe students’ perceptions of cussed during class. A variety of questions were presented, from using a SRS in the classroom. The research questions follow: knowledge-based to analysis level. The control group students an- swered the questions with a ‘hand raise’ response while students 1. What is the difference in test scores for students who use a stu- in the experimental group used the clickers on class days, for six dent response system during class when compared with test class days. For this group, the questions were integrated into the scores of students participating in standard teaching strategies? PowerPointÒ presentation using TurningPointÒ technology and 2. What is the perception of students who use a student response students responded individually to the questions using the click- system in class? ers. A histogram was displayed of the responses and further discus- sion and misunderstanding of content clarified at that point in The terms clickers and student response systems are used inter- time. changeably in the following sections. For the qualitative component of the study, after the third unit exam students in the experimental section were invited to partic- ipate in a focus group. Three groups with 30 students participated. Method The primary investigator conducted the focus groups in a confer- ence room on campus. They lasted approximately 45–60 min. The design was a quasi-experimental 2-group comparison The groups were audiotape recorded and transcribed. Examples (Burns and Grove, 2009) with one section of a course using Clickers of focus group questions included:
  • 3. B. Patterson et al. / Nurse Education Today 30 (2010) 603–607 605 1. What were the strengths of the using clickers in the classroom? Table 2 2. What were the limitations of using clickers in the classroom? Comparison of unit exams and final exam for experimental (clicker) and control groups (N = 70). 3. How did the clickers influence your learning of the course content? Measure (possible Experimental Control group t p points) group (n = 38) (n = 32) Mean (SD) Mean (SD) Unit 1 exam (50) 43.76 (2.78) 44.16 (2.85) À0.583 0.562 Unit 2 exam (50) 40.42 (3.09) 41.19 (3.48) À0.976 0.332 Data analyses and results Unit 3 exam (50) 39.18 (3.47) 37.53 (3.74) 1.915 0.060 Final exam (80) 65.84 (4.95) 64.59 (5.92) 0.962 0.340 Quantitative data A total of 70 students participated in the study. Thirty-eight checks were conducted with participants following the interpreta- were members of the experimental group while 32 served as con- tion of data. trols. Sixty-five students provided demographic data: 35 from the Students generally perceived the clickers as a positive addition experimental group and 30 from the control group. A pre-test to the class. Multiple comments centered on the ‘‘fun” nature of the did not demonstrate any significant difference between sections. clickers, as one student noted ‘‘It [using the clickers] was fun. I’d The groups appeared to be similar in all demographic and attribute look forward to it.” The primary negative feature of the clickers variables. Table 1 provides demographic data for both groups. Chi that emerged was malfunction of the technology. This will be dis- square analysis indicated no significant differences in the groups cussed under educational implications. Three themes emerged on nominal attribute variables. Likewise, t-tests indicated that from the focus group data. The themes were: being able to respond there were no significant differences between the groups on hours anonymously, validating an answer while providing immediate of employment or years working in health care. Using student’s t- feedback, and providing an interactive and engaging environment. test for exploratory analysis with alpha set at .05 (Munro, 2005), no Virtually all of the participants addressed the anonymity of significant differences between the groups on any measure of out- using the clickers. The perceived benefit was ‘Being able to respond come performance were found. Table 2 provides a comparison of anonymously’. Raising one’s hand in class and answering incor- the experimental and control group data. Therefore, no further rectly in front of an entire class had the potential to be embarrass- analysis was done. ing. With the clickers ‘‘no one has to be embarrassed.” Students shared that some of them conferred with the student sitting next to them but ultimately selected the response they believed to be Qualitative data accurate independently. They liked that ‘‘no one knows you picked the wrong answer.” This was certainly true when only a couple of For the qualitative data, the computer program, NVivoÒ, was students selected an incorrect answer. used to assist with data management and analysis. Group re- Students perceived the second theme of ‘Validating an answer sponses were analyzed for common themes and patterns. An audit while providing immediate feedback’ as a great way to confirm trail was established to ensure credibility of the findings. Member and clarify their understanding of a particular concept. Addition- ally, they noted that ‘‘if half of the class got it wrong, then you don’t Table 1 feel so bad.” Having the faculty provide rationale for the correct re- Demographics of sample. sponse immediately after the polling also facilitated understanding of difficult concepts. Several students noted that this helped them Sample attribute Total group Clicker group Control group (N = 65) (n = 35) (n = 30) with examinations because they could remember the discussions. Another aspect of this validation focused on providing students N Valid (%) N Valid (%) N Valid (%) with an idea of how they were doing with respect to the class as Gender a whole and ‘‘if you’re on pace with the rest of the class”. Female 62 95.4 33 94.3 29 96.7 Male 3 4.6 2 5.7 1 3.3 ‘Providing an interactive and engaging environment’ was the last theme. The students perceived that they ‘‘actually started Marital status Single 56 86.2 31 88.6 25 83.3 interacting more with each other in class” and ‘‘it brought the class Married 5 7.7 2 5.7 3 10.0 closer.” They spoke of talking to the students next to them about Living with significant the answers they selected and compared responses. PowerPointÒ Other 3 4.6 1 2.9 2 6.7 presentations were the primary method of content delivery for this Divorced/separated 1 1.5 1 2.9 0 0 class and one student shared that ‘‘it gave me something to do, so I Race woke up”. White American/Indian 43 66.2 22 62.9 21 70 Alaskan native 1 1.5 1 2.9 0 0 Discussion Asian 6 9.2 4 11.4 2 6.7 Black 5 7.7 2 5.7 3 10.0 African–American 8 12.3 4 11.4 4 13.3 Student response systems are a creative, alternative strategy for Hispanic/Latino 1 1.5 1 2.9 0 0 reinforcing concepts, evaluating the understanding of concepts, or No response 1 1.5 1 2.9 - - testing. Even though in this study, the clickers did not improve Previous educational degree learning outcomes as measured by objective testing, perceptions None 51 78.5 28 80.0 23 76.6 shared by the students indicated an increased degree of classroom Associate degree 11 16.9 6 17.1 5 16.7 Bachelor’s degree 2 3.1 0 0 2 6.7 engagement. Graduate degree 1 1.5 1 2.9 0 0 Current grade point average Exam performance A (3.7–4.0) 3 4.6 3 8.6 0 0 B (2.7–3.6) 59 90.8 31 88.6 28 93.3 Objective testing scores were not significantly different for the C (2.0–2.6) 3 4.6 1 2.9 2 6.7 two groups. It is possible that due to the technological problems
  • 4. 606 B. Patterson et al. / Nurse Education Today 30 (2010) 603–607 and the limited intervention time that the experimental group did the end of 6 classes. Increasing the frequency of use and/or number not have sufficient time with the clickers to demonstrate a signif- of class times, as well as exploring different options for use during icant increase on test scores. The literature reveals mixed results the class may have an impact on objective outcomes. Second, prob- with respect to change in exam performance, from no change (Fies, lems with technology, such as a ‘cleaner’ software program that 2005; Stein et al., 2006) to positive effects (Hall et al., 2005; erased the TurningPointÒ software each night, and the need to Morling et al., 2008). Further research is needed in this area if SRSs use the same USB port each session contributed to frustration for are adopted as a best practice in nursing education. both the faculty and students. Students expressed disappointment when the technology did not function. The majority of the techno- logical problems were resolved before the end of the semester as Classroom engagement faculty mastered the system. A third limitation was the non-ran- dom assignment of sample. Students selected the morning or after- The data from this study suggest that the outcome variable may noon section they wanted on personal preference. not be test scores. The qualitative data support increased engage- ment and interaction in the classroom. Neither degree of engage- ment or attendance was measured in this study. Several authors Implications for nursing education have referred to clickers as electronic ‘entertainment toys’ (Cono- ley et al., 2006). Even with the entertainment aspect, if students at- Implications for teaching and learning include (1) encouraging tend class, want to participate, and experience enhanced attention; active learning by facilitating interaction and engagement of stu- use of the clickers may be worth the effort. Engagement has been dents in large class settings; (2) encouraging participation among assessed in several previous studies (Bullock et al., 2002; Morling students by allowing students reluctant to interact in large groups et al., 2008; Fies, 2005). Morling et al. (2008) assessed engagement to actively participate; (3) providing prompt feedback so a student with items that focused on attendance, reading prior to class, en- can identify misunderstanding of concepts during a class, thus joyed coming to class, and paying attention in class. However, allowing the student to validate his/her understanding and seek these items may not sufficiently capture engagement and facilitate assistance prior to testing; and (4) allowing faculty to ascertain learning. Faculty needs to examine their own practices in the class- student areas of difficulty prior to evaluation and give meaningful room with respect to the activities that they believe are engaging. feedback during a specific lesson (Skiba, 2006). In addition, the Additionally, it seems that examining what students believe en- data may be used to facilitate course and teaching strategy gage them in the classroom would also be beneficial. revisions. Rhem (2007) notes that faculty need to get a ‘‘sense of what This was the first use of this particular technology for these constitutes the best practices or pedagogies for evoking student researchers and despite the fact that there was a lack of significant engagement in a specific course compared with students’ assess- objective data, the use of SRS seems to offer promise in increasing ment of how often they are participating” (10). He suggests that student engagement. Smart classrooms are becoming a standard assessing both faculty (FSSE: faculty survey on student engage- feature at most institutions of higher education, with SRS being ment) and student (CLASSE: classroom survey of student engage- only one of the new advances in the educational setting. These de- ment) perceptions of engagement in a specific course may vices are effective for a multitude of uses, relatively easy to use, provide more effective and compelling information for faculty to and suitable for higher education. However, faculty needs to be formulate pedagogical choices. Likewise, administration of these clear about the rationale for any alternative teaching strategy rel- tools, pre and post semester may offer better insight into what ative to the investment of time and money. Specifically with click- the best practice for engagement is in a particular classroom ers, faculty needs to make pedagogical decisions regarding their setting. use. How will they be used in class? Considerations might include Given the size of the class and structure of the classroom in this whether the use is for formative or summative assessment, indi- study, one goal was to increase interaction among the students vidual versus group assessment. during class. Interestingly, the focus group data supported the per- As student profiles change, faculty must adapt to the varied ception of increased interaction; however, it was the anonymity learning needs of the students to accomplish the mission of nurs- the clickers provided that the students seemed to prefer and focus ing education. Additionally, technology is rapidly evolving offering upon. Other researchers have also reported this finding (Fies and new and innovative teaching/learning approaches that faculty Marshall, 2006). Additionally, the literature seems to indicate must investigate as to their pedagogical value. Replication of this mixed results as to whether clicker technology can really trans- study with a larger sample, combined with other alternative strat- form the learning environment (Fies and Marshall, 2006). While egies seems indicated as nursing education seeks to expand its evi- students may enjoy the technology and ‘wake up’ in class, costs dence on alternative classroom strategies. This study has of acquiring and maintaining the system, faculty time investment, contributed to the body of nursing education literature on evi- as well as dedicated technology support services, demands further dence-based teaching approaches and the incorporation of wire- examination of the impact of these devices on actual learning. If less technology in professional nursing education. this method does not involve active dialogue among faculty and students about the questions and their distracters, a push of a but- Conclusions ton may have replaced opportunities for thinking aloud and prac- ticing verbal communication skills in the class setting. Likewise, Despite no significant differences between the two sections in moving the focus away from the passive environment of a large objective testing, the nursing students in the experimental section lecture classroom to an engaged interactive classroom may neces- of this study generally perceived the clickers as a positive addition sitate consideration of a variety of alternative strategies. to the classroom environment. The use of clickers seemed to in- crease interaction and engagement in the classroom. The students Limitations also identified the benefits of anonymity of responses and immedi- ate feedback as facilitators to understanding complex concepts. A number of limitations existed that may have influenced the Clearly, further research is warranted examining active learning outcomes for this study. First, the use of the clickers during class strategies, such as clickers, with student engagement and knowl- time was limited to a brief time period, approximately 15 min, at edge acquisition.
  • 5. B. Patterson et al. / Nurse Education Today 30 (2010) 603–607 607 Acknowledgements Herreid, C., 2006. ‘‘Clicker” cases: introducing case study teaching into large classrooms. Journal of College Science Teaching 36 (2), 43–47. Knight, J., Wood, W.B., 2005. Teaching more by teaching less. Cell Biology Education The authors acknowledge Dr. Elizabeth Bayley, statistical con- 4, 298–310. sultant, and Evelyn Christy, nursing student, for their contributions Latessa, R., Mouw, D., 2005. Use of an audience response system to augment interactive learning. Innovations in Family Medicine Education 37 (1), 12–14. to this research study. Funding acknowledgement: PHENSA Penn- Miller, R., Ashar, B., Getz, K., 2003. Evaluation of an audience response system for sylvania Higher Education Nursing Schools Association. the continuing education of health professionals. The Journal of Continuing Education in the Health Professions 23, 109–115. Morling, B., McAuliffe, M., Cohen, L., DiLorenzo, T., 2008. Efficacy of personal References response systems (‘‘clickers”) in large, introductory psychology classes. Teaching of Psychology 35 (1), 45–50. American Association of Colleges in Nursing (AACN), 2008. Nursing Shortage Fact Munro, B., 2005. Statistical Methods for Health Care Research, fifth ed. Lippincott Sheet. http://www.aacn.nche.edu/Media/FactSheets/NursingShortage.htm. Wilkins and Williams, Philadelphia, Pennsylvania. Banks, D., 2006. Audience Response Systems in Higher Education. Information Rhem, J., 2007. CLASSE: the missing link. The National Teaching and Learning Science Publishing, Hershey, Pennsylvania. Forum, vol. 16 (4). http://www.ntlf.com/html/ti/classe.htm. Bruff, D., 2006. Research on the Effectiveness of Classroom Response Systems. Sawada, D., 2002. Learning from past and present: electronic response systems in http://www.vanderbilt.edu/cft/resources/teaching_resources/technology/ college lecture halls. The Free Library. http://www.thefreelibrary.com./ crs.htm. Learning from past and present: electronic response systems in. . .- Bullock, D., LaBella, V., Clingan, T., Ding, Z., Stewart, G., Thibado, P., 2002. Enhancing a091487242). student–instructor interaction frequency. The Physics Teacher 40, 30–36. Schackow, T., Chavez, M., Loya, L., Friedman, M., 2004. Audience response system: Burns, N., Grove, S., 2009. The Practice of Nursing Research: Conduct, Critique, and effect on learning in family medicine residents. Family medicine 36, 496–504. Utilization, sixth ed. Elsevier Saunders, St Louis, Missouri. Skiba, D., 2006. Got large lecture hall classes? Use clickers. Nursing Education Conoley, J., Moore, G., Croom, B., Flowers, J., 2006. A toy or a teaching tool? The use Perspectives 27, 278–280. of audience–response systems in the classroom. Techniques: Connecting Stein, P., Challman, S., Brueckner, J., 2006. Using audience response technology for Education and Careers 81 (7), 46–48. pretest reviews in an undergraduate nursing course. Journal of Nursing Donovan, M., Bransford, J., Pellegrino, J. (Eds.), 1999. How People Learn: Bridging Education 45, 469–473. Research and Practice. National Academy Press, Washington, DC. Stowell, J., Nelson, J., 2007. Benefits of electronic audience response systems on Draper, S., Brown, M., 2004. Increasing interactivity in lectures using an electronic student participation, learning, and emotion. Teaching of Psychology 34, 253– voting system. Journal of Computer Assisted Learning 20 (2), 81–94. 258. Duncan, D., 2005. Clickers in the Classroom: How to Enhance Science Teaching Trapskin, P., Smith, K., Armstead, J., Davis, G., 2005. Use of an audience response Using Classroom Response Systems. Addison-Wesley, New York. system to introduce an anticoagulation guide to physicians, pharmacists, and Fies, C., 2005. Classroom Response Systems: What do They Add to an Active pharmacy students. American Journal of Pharmaceutical Education 69, 190– Learning Environment? Doctoral Dissertation, Dissertation Abstracts 197. International, vol. 66. University of Texas at Austin, p. 3195271. Uhari, M., Renko, M., Soini, H., 2003. Experiences of using an interactive audience Fies, C., Marshall, J., 2006. Classroom response systems: a review of the literature. response system in lectures. BMC Medical Education, vol. 3 (12). http:// Journal of Science Education and Technology 15 (1), 101–109. www.biomedcentral.com/1472-6920/3/12. Guthrie, R., Carlin, A., 2004. Waking the dead: using interactive technology to Yourstone, S.A., Kraye, H.S., Albaum, G., 2008. Classroom questioning with engage passive listeners in the classroom. In: Proceedings of the Tenth Americas immediate electronic response: do clickers improve learning? Decision Conference on Information Systems, New York, NY. http://www.mhhe.com/cps/ Sciences Journal of Innovative Education 6 (1), 75–88. docs/CPSWP_WakindDead082003.pdf. Zhu, E., 2007. How are faculty using clickers in the classroom? Center for Research Hall, R., Collier, H., Thomas, M., Hilgers, M., 2005. A student response system for on Teaching and Learning Occasional, Paper No. 22. http://www.crlt.umich.edu/ increasing engagement, motivation, and learning in higher enrollment lectures. publinks/CRLT_no22.pdf. In: Proceedings of the Eleventh Americas Conference on Information Systems, Omaha, NE, USA. http://lite.mst.edu/documents/hall_et_al_srs_amcis_pro ceedings.pdf.