SlideShare a Scribd company logo
1 of 12
Download to read offline
3/03 RT #31 Dickinson   2/12/03   1:44 PM     Page 554          (Black plate) CV plate)
                                                                (PANTONE 300




           David K. Dickinson
           Allyssa McCabe
           Kim Sprague


                               Teacher Rating of Oral
            This rating system measures skills Language and
              critical to the New Standards for
             Speaking and Listening. TROLL Literacy (TROLL):

            progress in language and literacy Individualizing
               can be used to track children’s


                    curriculum, and to stimulate early literacy
                         development, to inform

            focused communication between
                           parents and teachers.
                                                 instruction with a
                                                 standards-based
                                                 rating tool
                        K
                                   eisha is a quiet little girl with tawny      group of no more than three other children
                                   skin, long black hair, and large brown       where he was able to ask questions as a way to
                                   eyes. Her teacher has observed that          clarify the meaning of a story. She suggested to
                        she is shy with other children, reluctant to par-       his mother that his older brothers be encouraged
                        ticipate in groups, and often the last to join in ac-   to read to him at home. She also noted that his
                        tivities, but the teacher never has had to              scores on the language and reading subtotals of
                        reprimand Keisha. Only when the teacher sat             the TROLL were high—higher than his writing
                        down to fill out reports on the language devel-         subtotal—and she was knowledgeable about his
                        opment of each of her students did she realize          exact writing skills and limitations.
                        Keisha has a problem.
                             CJ is an energetic almost 5-year-old African       Reading, writing, and oral
                        American boy who attends childcare from 7:00            language: Roots of literacy
                        a.m. to 4:00 p.m. five days a week. His teacher             Early reading and writing abilities are by
                        observed that “CJ has demonstrated strong use           now well-known dimensions of early literacy.
                        of his oral language skills since entering my pro-      Through their preschool years, children progres-
                        gram. CJ speaks clearly and is easily understood        sively construct understandings of writing (e.g.,
                        by adults.” The teacher was enrolled in a col-          Bissex, 1980) and reading (e.g., Sulzby & Teale,
                        lege course that focused on enriching children’s        1991). Similarly, the contribution of children’s
                        language and literacy skills. She noticed after         phonological awareness has often been explored
                        completing the TROLL assessment of CJ that he           and is also widely recognized (Bryant,
                        did not always choose to attend to stories in           MacLean, & Bradley, 1990; Cronin & Carver,
                        large group and appeared most interested in sto-        1998; Speece, Roth, Cooper, & de la Paz, 1999;
                        ries when reading one-on-one or in a small              Stanovich, 1992; Vellutino & Scanlon, 2001;

           554    The Reading Teacher      Vol. 56, No. 6   March 2003                          ©2003 International Reading Association (pp. 554–564)
3/03 RT #31 Dickinson       2/12/03         1:44 PM        Page 555             (Black plate) CV plate)
                                                                                (PANTONE 300




         Wagner, Torgesen, Laughon, Simmons, &                                  acquisition of literacy or their emergent reading
         Rashotte, 1993; Wagner et al., 1997).                                  and writing skills. In response to this need, we
              However, there are other lesser known oral                        present an accessible means of evaluating each
         language skills relevant to literacy that include the                  child in a classroom for literacy-related abili-
         development of narrative ability (Dickinson &                          ties. One way to help teachers track children’s
         Tabors, 2001; see McCabe & Rollins, 1991, for                          development is by periodic reflection on demon-
         review), use of talk while pretending (Dickinson,                      strations of early literacy. Even though teachers
         2001; see Pelligrini & Galda, 1993, for review),                       may lack prior formal training regarding assess-
         and varied vocabulary usage (Tabors, Beals, &                          ment of language and literacy development, we
         Weizman, 2001). To be able to read and write ef-                       have found that they can recognize critical as-
         fectively, children must develop strong oral lan-                      pects of this development. Using the Teacher
         guage skills (Dickinson & McCabe, 1991;                                Rating of Oral Language and Literacy (TROLL)
         Dickinson & Tabors, 2001; Snow, 1983; Snow,                            to evaluate children can help teachers assess the
         Burns, & Griffin, 1998). Oral language skills                          effectiveness of an educational program.
         blossom during the preschool years, but they are
         also very vulnerable and in need of stimulation                        New Standards: Speaking and
         during this time, as a number of major organiza-                       listening for preschool through
         tions involved in the education of young children
         have recognized.                                                       third grade
                                                                                     Because speaking and listening are so criti-
         A call for developmentally                                             cal for literacy development in early childhood,
                                                                                the New Standards project, a program of the
         appropriate assessment                                                 National Center on Education and the Economy
              The International Reading Association                             (Tucker & Codding, 1998), has developed
         (IRA) and the National Association for the                             research-based standards for speaking and lis-
         Education of Young Children (NAEYC) jointly                            tening in preschool through third grade (New
         formulated a position statement regarding early                        Standards Speaking and Listening Committee,
         literacy development (1998). The statement ac-                         2001). These standards complement those al-
         knowledges the difficulty that teachers face, for                      ready developed for reading and writing. The
         example, in kindergarten classrooms where a                            speaking and listening standards include specif-
         five-year range in children’s literacy skills is not                   ic recommendations for teachers regarding ben-
         uncommon (Riley, 1996). Estimating where                               eficial habits of conversation, useful kinds of
         each child is in terms of the acquisition of speak-                    talk such as narratives and explanations, and lan-
         ing, listening, reading, and writing skills is criti-                  guage conventions relevant to early childhood.
         cal to providing developmentally appropriate                           Many programs are concerned with ensuring
         instruction to all children in this wide range. The                    that their students meet such national standards.
         position statement is quite clear that
             throughout these critical years accurate assessment of chil-       Development of TROLL
             dren’s knowledge, skills, and dispositions in reading and writ-         To guide teachers’ observations of children’s
             ing will help teachers better match instruction with how and       individual language and literacy skills and in-
             what children are learning. However, early reading and writ-
                                                                                terests, we created an instrument that focuses on
             ing cannot simply be measured as a set of narrowly defined
             skills on standardized tests. These measures often are not re-
                                                                                key abilities. In constructing this tool, we drew
             liable or valid indicators of what children can do in typical      on the same body of theory and research that was
             practice, nor are they sensitive to language variation, culture,   the foundation for the speaking and listening
             or the experiences of young children. (International Reading       standards. Indeed, we contributed to both efforts.
             Association & National Association for the Education of            TROLL is a tool developed by the first author
             Young Children, 1998, p. 38; emphasis added)                       to provide teachers with a way to track the lan-
                                                                                guage and literacy skills and interests of children
             As if these difficulties were not enough,                          in their classrooms and is represented in its en-
         preschool teachers face time constraints and typ-                      tirety in Table 1. Although it was developed for
         ically have not been trained to evaluate chil-                         research purposes separate from the New
         dren’s language development as it relates to the                       Standards initiative, TROLL addresses all the

                                                                          Teacher Rating of Oral Language and Literacy (TROLL)        555
3/03 RT #31 Dickinson   2/12/03   1:44 PM     Page 556          (Black plate) CV plate)
                                                                (PANTONE 300




                        central speaking and listening skills in the New          course, if a teacher can rate a child’s competence
                        Standards, as well as many of the early reading           in a language other than English, it would be of
                        and writing skills covered by the companion               great interest to rate the child’s skill in both
                        reading and writing standards. Of special interest        English and his or her first language. Whenever
                        is the fact that it allows teachers to track chil-        possible, educators need to involve the parents of
                        dren’s interests in various language and literacy         ESL students. In fact, maternal reports of
                        activities—something that no direct assessment            preschoolers’ literacy (when children were 3 or 4
                        tool can capture.                                         years old) significantly predicted much of the
                                                                                  variation in kindergarten tests, grade 1 teacher
                        Using TROLL to inform instruction                         assessments, and direct assessments of decod-
                             No formal training is required to use the            ing given near the end of first grade (Dickinson
                        TROLL instrument; however, it is most effective           & DeTemple, 1998). Thus, if TROLL were used
                        if teachers know about language and literacy de-          collaboratively with parents, it could provide a
                        velopment. In other words, TROLL can make                 powerful way to organize a multifaceted conver-
                        knowledgeable teachers better. This tool is de-           sation about a child’s full range of language and
                        signed for classroom teachers to easily track the         literacy development.
                        language and literacy development of all their stu-
                        dents. The TROLL requires only 5 to 10 minutes            TROLL has been used extensively
                        for each child and need not disrupt classroom ac-              Over the last several years, TROLL has been
                        tivities (it can be completed during naptime).            used with 973 children in the context of research
                             Teachers can use the information to inform           examining early literacy development. Over 100
                        their teaching by identifying (a) children who are        teachers have been involved in this process.
                        displaying evidence of serious delay and who may               One measure of a good test is that all items
                        need formal assessment by audiologists or speech-         on the test tap related abilities. We analyzed re-
                        language pathologists and (b) children who are            sponses for 534 of these preschool children and
                        showing high levels of literacy development and           found strong indications that TROLL meets
                        therefore need special additional challenges in this      standards expected of research tools in this re-
                        area. Furthermore, by completing TROLL several            gard. Specifically, Cronbach’s alpha estimates of
                        times over the course of a year, teachers can track       internal consistency ranged from .77 to .92 for
                        the progress of all their students.                       separate subscales, indicating strong internal
                             Second, teachers could combine results for           consistency. For the total TROLL scores, alphas
                        all the children in their class to determine which        exceeded .89 for each age.
                        areas need more systematic instruction. For ex-                Another way of determining the value of a
                        ample, if all children in a class score relatively        tool is the extent to which a child’s performance
                        low on rhymes, their teacher might want to begin          on that tool compares to performance on other
                        providing numerous opportunities to listen to             measures. After all, TROLL relies on a teacher’s
                        and produce rhyming chants, songs, and poems.             professional judgement or perception of a child’s
                             Teachers should consider using TROLL rat-            development rather than formal testing of actual
                        ings of children as a basis for discussions with          development. It is therefore reassuring to find
                        parents. In fact, as we saw in the case of CJ at the      that, for this sample, the ratings teachers provid-
                        outset of this article, teachers are likely to initiate   ed using TROLL compared favorably to formal
                        such discussions without anyone urging them to            assessments by researchers. These measures in-
                        do so. (Recall that the teacher recommended that          cluded the well-established Peabody Picture
                        CJ’s mother get his older brothers to read with           Vocabulary Test (PPVT-III), which is a measure
                        him one-on-one because that was an effective              of receptive vocabulary, as well as measures of
                        setting for the child.)                                   emergent literacy and early phonological aware-
                             Parents can also serve as a source for rat-          ness. Teacher ratings of children’s language and
                        ings using the TROLL. In particular, teachers of          literacy development on the TROLL show mod-
                        bilingual children often have a difficult time rat-       erate associations with children’s scores on all
                        ing the language competence of children who               three of those direct assessments despite the fact
                        speak English as a second language (ESL). Of              that teachers never saw those test results. So in

           556    The Reading Teacher      Vol. 56, No. 6   March 2003
3/03 RT #31 Dickinson      2/12/03    1:44 PM     Page 557         (Black plate) CV plate)
                                                                   (PANTONE 300




          about five minutes, and with no special training         This difference partly reflects the fact that
          on the TROLL, teachers themselves can index              TROLL assesses other factors that teachers take
          what specially trained researchers would spend           into consideration as they rate individual
          25–30 minutes per child assessing.                       children—factors that are not captured in the
              Of course, the TROLL teacher ratings do              direct, formal assessments. TROLL captures the
          not agree completely with the researchers’ tests.        kind of information the position statement by

                                                            Table 1
                                     Teacher Rating of Oral Language and Literacy (TROLL)

          Language use
          1. How would you describe this child’s willingness to start a conversation with adults and peers and
             continue trying to communicate when he or she is not understood on the first attempt? Select the statement
             that best describes how hard the child works to be understood by others.


           Child almost never           Child sometimes be-          Child begins conver-             Child begins conver-
           begins a conversa-           gins conversation with       sations with both peers          sations with both
           tion with peers or the       either peers or the          and teachers on occa-            peers and teachers.
           teacher and never            teacher. If initial ef-      sion. If initial efforts fail,   If initial efforts fail, he
           keeps trying if un-          forts fail he or she of-     he or she will some-             or she will work hard
           successful at first.         ten gives up quickly.        times keep trying.               to be understood.

                    1                             2                               3                                4


          2. How well does the child communicate personal experiences in a clear and logical way? Assign the
             score that best describes this child when he or she is attempting to tell an adult about events that hap-
             pened at home or some other place where you were not present.

           Child is very tenta-         Child offers some in-        Child offers informa-            Child freely offers in-
           tive, only offers a few      formation, but infor-        tion and sometimes               formation and tells
           words, requires you          mation needed to             includes the neces-              experiences in a way
           to ask questions, has        really understand the        sary information to              that is nearly always
           difficulty responding        event is missing (e.g.,      understand the event             complete, well se-
           to questions you ask.        where or when it hap-        fully.                           quenced, and com-
                                        pened, who was pres-                                          prehensible.
                                        ent, the sequence of
                                        what happened).
                    1                             2                               3                                4


          3. How would you describe this child’s pattern of asking questions about topics that interest him or her
             (e.g., why things happen, why people act the way they do)? Assign the score that best describes the
             child’s approach to displaying curiosity by asking adults questions.

           To your knowledge,           On a few occasions           On several occasions             Child often asks
           the child has never          the child has asked          the child has asked              adults questions re-
           asked an adult a             adults some ques-            interesting questions.           flecting curiosity.
           question reflecting          tions. The discussion        On occasion these                These often lead to
           curiosity about why          that resulted was            have lead to an inter-           interesting, extend-
           things happen or             brief and limited in         esting conversation.             ed conversations.
           why people do                depth.
           things.

                    1                             2                               3                                4

                                                                                                                    (continued)


                                                               Teacher Rating of Oral Language and Literacy (TROLL)                 557
3/03 RT #31 Dickinson   2/12/03    1:44 PM        Page 558       (Black plate) CV plate)
                                                                 (PANTONE 300




                                                                      Table 1 (continued)
                                                     Teacher Rating of Oral Language and Literacy (TROLL)

                        4. How would you describe this child’s use of talk while pretending in the house area or when playing with
                           blocks? Consider the child’s use of talk with peers to start pretending and to carry it out. Assign the score
                           that best applies.

                          Child rarely or never          On occasion the           Child engages in pre-        Child often talks in
                          engages in pretend             child engages in pre-     tending often and            elaborate ways while
                          play or else never             tending that includes     conversations are            pretending.
                          talks while pretend-           some talk. Talk is        sometimes important          Conversations that
                          ing.                           brief, may only be        to the play. On occa-        are carried out “in
                                                         used when starting        sion child engages in        role” are common and
                                                         the play, and is of       some back-and-forth          are an important part
                                                         limited importance to     pretend dialogue with        of the play. Child
                                                         the ongoing play ac-      another child.               sometimes steps out
                                                         tivity.                                                of pretend play to give
                                                                                                                directions to another.

                                   1                               2                         3                            4

                        5. How would you describe the child’s ability to recognize and produce rhymes?

                         Child cannot ever               Child occasionally        Child spontaneously          Child spontaneously
                         say if two words                produces or identi-       produces rhymes and          rhymes words of
                         rhyme and cannot                fies rhymes when          can sometimes tell           more than one sylla-
                         produce a rhyme                 given help.               when word pairs              ble and always iden-
                         when given exam-                                          rhyme.                       tifies whether words
                         ples (e.g., rat, cat).                                                                 rhyme.

                                   1                               2                         3                            4

                        6. How often does child use a varied vocabulary or try out new words (e.g., heard in stories or from teacher)?

                                  Never                          Rarely                 Sometimes                       Often
                                   1                               2                       3                              4

                        7. When child speaks to adults other than you or the teaching assistant, is he or she understandable?

                                  Never                          Rarely                 Sometimes                       Often
                                   1                               2                       3                              4

                        8. How often does child express curiosity about how and why things happen?

                                  Never                         Rarely                  Sometimes                       Often
                                   1                              2                        3                              4

                                                                                                  Language subtotal ___________
                        Reading
                        9. How often does child like to hear books read in the full group?

                                  Never                         Rarely                  Sometimes                       Often
                                   1                              2                        3                              4

                                                                                                                           (continued)



           558    The Reading Teacher       Vol. 56, No. 6   March 2003
3/03 RT #31 Dickinson           2/12/03         1:44 PM         Page 559             (Black plate)




                                                              Table 1 (continued)
                                             Teacher Rating of Oral Language and Literacy (TROLL)

          10. How often does child attend to stories read in the full group or small groups and react in a way that
              indicates comprehension?

                      Never                                 Rarely                               Sometimes              Often
                       1                                      2                                     3                     4

          11. Is child able to read storybooks on his or her own?

             Does not pretend to                     Pretends to read                    Pretends to read and      Reads the written
                read books                                                                reads some words             words
                    1                                           2                                 3                        4

          12. How often does child remember the story line or characters in books that he or she heard before either
              at home or in class?

                      Never                                 Rarely                               Sometimes              Often
                       1                                      2                                     3                     4

          13. How often does child look at or read books alone or with friends?

                      Never                                 Rarely                               Sometimes              Often
                       1                                      2                                     3                     4

          14. Can child recognize letters? (choose one answer)
                  None of the letters of the alphabet ....................................1
                  Some of them (up to 10)....................................................2
                  Most of them (up to 20) ....................................................3
                  All of them..........................................................................4

          15. Does child recognize his or her own first name in print?

                                                    No                                    Yes
                                                    1                                      2

          16. Does child recognize other names?

                        No                               One or two                               A few                 Several
                                                                                            (up to four or five)     (six or more)
                        1                                       2                                   3                       4

          17. Can child read any other words?

                        No                               One or two                               A few                 Several
                                                                                            (up to four or five)     (six or more)
                        1                                       2                                   3                       4

          18. Does child have a beginning understanding of the relationship between sounds and letters (e.g., the
              letter B makes a “buh” sound)?

                        No                               One or two                               A few                 Several
                                                                                            (up to four or five)     (six or more)
                        1                                      2                                    3                       4

                                                                                                                            (continued)


                                                                                Teacher Rating of Oral Language and Literacy (TROLL)      559
3/03 RT #31 Dickinson   2/12/03    1:44 PM    Page 560           (Black plate)




                                                                     Table 1 (continued)
                                                    Teacher Rating of Oral Language and Literacy (TROLL)

                        19. Can child sound out words that he or she has not read before?

                                   No                       Once or twice             One syllable words             Many words
                                                                                            often
                                   1                               2                          3                            4

                                                                                                      Reading subtotal ___________
                        Writing
                        20. What does child’s writing look like?

                             Only draws or                  Some letter-like          Many conventional          Conventional letters
                              scribbles                        marks                       letters                  and words
                                  1                               2                          3                            4

                        21. How often does child like to write or pretend to write?

                                  Never                         Rarely                   Sometimes                      Often
                                   1                              2                         3                             4

                        22. Can child write his or her first name, even if some of the letters are backward?

                                  Never                         Rarely                   Sometimes                      Often
                                   1                              2                         3                             4

                        23. Does child write other names or real words?

                                  No                          One or two           A few (up to four or five)    Several (six or more)
                                  1                               2                          3                             4

                        24. How often does child write signs or labels?

                                  Never                         Rarely                   Sometimes                      Often
                                   1                              2                         3                             4

                        25. Does child write stories, songs, poems, or lists?

                                  Never                         Rarely                   Sometimes                      Often
                                   1                              2                         3                             4

                                               Writing subtotal                __________ (out of 24 possible)
                                               Oral language subtotal          __________ (out of 32 possible)
                                               Reading subtotal                __________ (out of 42 possible)
                                               Total TROLL score               __________ (out of 98 possible)
                        Note. Copyright ©1997 Education Development Center. Reproduced with permission.




           560    The Reading Teacher      Vol. 56, No. 6   March 2003
3/03 RT #31 Dickinson    2/12/03     1:44 PM    Page 561         (Black plate) CV plate)
                                                                 (PANTONE 300




         IRA and NAEYC recommended be captured in                failure by virtue of overlooking children expect-
         assessment. Formal tests measure how well a             ed to fail.
         child does at only one point in time; children               This lack of revision of judgments about lit-
         may be tired or sick on the day of the PPVT-III         eracy skills and interests points to the value of
         assessment and receive a dismal score for their         teachers carrying out periodic informal assess-
         receptive vocabulary, whereas their teacher             ments of children to provide concrete evidence
         knows that on most days they are quick to pick
                                                                 of children’s growth. For example, teachers can
         up on the vocabulary of classroom units and ar-
         ticulate when sharing stories of personal experi-       ask children to write their own or others’ names
         ence. The TROLL score is not as vulnerable to           or to identify letters in them.
         fluctuations in a child’s performance as are the             In general, then, rather than contribute to
         formal tests.                                           self-fulfilling prophecies of children’s success or
              Furthermore, as noted earlier, the TROLL           failure, we hope that TROLL will predict possi-
         includes information about the child’s engage-          ble failure to learn to read in order to prevent
         ment in literacy activities and patterns of use of      such failure. That is, we hope that teachers will
         oral language. Formal assessments do not tap            use this instrument to give struggling children
         such interests and inclinations to use language         the help they need to succeed so that they never
         and print in any way. And yet, a child’s initia-        have to experience failure at a later point.
         tive in this area could be an important determi-        Specifically, we (Dickinson, 2001) recommend
         nant of the child’s future success.
                                                                 that teachers make sure that one or more adults
              Overall, children’s scores improve from fall
         to spring. However, the correlations between            read with small groups of children every day and
         TROLL scores and direct assessment measures             ensure that all children have this experience once
         of literacy are generally less reliable in the spring   a week. Teachers can also set aside time when
         than in the fall, which is just the opposite of what    children tell stories. Finally, teachers need to in-
         one would predict. After all, teachers have had         troduce varied and challenging vocabulary as a
         far more interaction with children—and should           routine part of the curriculum.
         therefore be more sensitive to their reading and
         writing skills—in the spring than in the fall. In       What TROLL scores mean
         fact, however, there is no firm correlation be-              Table 2 displays what different scores on
         tween teacher TROLL scores in the spring and            TROLL indicate about a child’s overall develop-
         formal assessments of children’s emergent liter-
                                                                 mental level. For example, a score of 66 in the
         acy conducted at that time, although correlations
         with vocabulary (PPVT) and phonological                 spring indicates that the child is making progress
         awareness (EPAP) remain moderately strong.              that is average for 4-year-olds in this sample.
         Unfortunately, this may reflect the fact that           The sample consisted only of low-income chil-
         teachers do not revisit their assessment of chil-       dren, so these scores should be regarded as pro-
         dren’s literacy skills as much as they should. In       visional. However, we argue that the well-known
         the fall, teachers may arrive at judgments about        academic disadvantages of low-socioeconomic
         a child’s accomplishments that they fail to up-         status (SES) preschool children (e.g., Stipek &
         date. Children’s progress in language and liter-        Ryan, 1997) make this sample important in its
         acy may go undetected by their teachers. This           own right. If a child from a low-SES family
         finding is sobering.                                    scores at the 10th percentile, for example, this re-
              One danger of any judgment is that it can be-      sult cannot be dismissed as a result of economic
         come a self-fulfilling prophecy (Rosenthal &
                                                                 disadvantage; such a child is scoring very poorly
         Jacobsen, 1968). Teachers’ opinions of children at
         the very outset of their education can predict chil-    relative to his or her economic peers. Scores at
         dren’s success just by virtue of the teacher giving     the 75th and, especially, the 90th percentile,
         extra attention, motivation, or instruction to those    however, should prompt a teacher to provide op-
         children they expect to become the most accom-          portunities for children to read more advanced
         plished. Conversely, teacher expectations—              books, engage in writing frequently, and talk at
         never revisited—can predict other children’s            length about challenging and interesting topics.

                                                            Teacher Rating of Oral Language and Literacy (TROLL)        561
3/03 RT #31 Dickinson      2/12/03     1:44 PM      Page 562             (Black plate)




                                                                           Table 2
                                                                    What TROLL scores mean


                 3-year-olds’            4-year-olds’              5-year-olds’        Relative standing              Recommendations/
                TROLL scores            TROLL scores              TROLL scores          on the TROLL                      meaning

                Fall      Spring        Fall      Spring           Fall     Spring
              n = 115     n = 55      n = 336     n = 234         n = 83    n=229

                 40          44          43          46             51          55       10th percentile        Assessment by child of audi-
                                                                                                                ologist, speech-language
                                                                                                                pathologist. Discuss concerns
                                                                                                                with parents.
                 44          49          52          55             59          65       25th percentile        Assessment of child by
                                                                                                                speech-language pathologist,
                                                                                                                extra involvement in extended
                                                                                                                conversations, and other
                                                                                                                literacy activities.
                 51          56          61          66             68          76       50th percentile        Child is performing at an
                                                                                                                average level.
                 61          62          71          74             75          85       75th percentile        Child is performing above
                                                                                                                average.
                 68          69          80          84             85          91       90th percentile        Child should be encouraged
                                                                                                                to read and write at advanced
                                                                                                                levels in school and at home.

            Note. Our data come from a low-income sample. In national studies children from such homes tend to receive less support for early lan-
            guage and literacy development than children from economically advantaged homes. Children from more advantaged backgrounds
            would be expected to receive somewhat higher ratings than those reported above (roughly 5–6 points higher on average).




                            Program evaluation potential:                                 to spring on average in comparison to a control
                                                                                          group.
                            TROLL measures appropriate                                         Furthermore, the classrooms that supported
                            language and literacy instruction                             such advances had improved classroom language
                                As we mentioned, children’s scores on                     and literacy practices. Teachers who participated
                            TROLL might well serve as an impetus to plan                  in LEEP made greater efforts to engage children
                            systematic language and literacy instruction for a            in conversations and to provide opportunities for
                            class. In fact, such instruction has been imple-              children to write and to use books. The change
                            mented by a number of Head Start programs in                  that appeared to reflect the most major shift was
                            the Boston, Massachusetts, area, where TROLL                  the extent to which teachers planned activities
                            detected changes that occurred as a result of pro-            with the intention of having children practice
                            gram improvement efforts. Head Start teachers                 literacy-related skills. Enriching the literacy en-
                            and their supervisors volunteered to participate              vironment had one additional effect that might
                            in a professional development program called                  come as a surprise. Children whose teachers par-
                            LEEP (Literacy Environment Enrichment                         ticipated in LEEP displayed significantly more
                            Program). They received academic credit for                   growth in social skills than their peers, as as-
                            participating in two intensive three-day blocks               sessed by the Social Skills Rating System
                            separated by three months. TROLL scores for                   (Gresham & Elliott, 1990). Children who are
                            children whose teachers participated in LEEP                  busy talking, reading, and writing—activities
                            were significantly higher than for children                   registered by TROLL—were more likely to be
                            whose teachers did not. Specifically, children in             viewed by their teachers as developing stronger
                            LEEP classrooms gained more overall from fall                 skills in collaborating with others.

           562        The Reading Teacher        Vol. 56, No. 6    March 2003
3/03 RT #31 Dickinson    2/12/03   1:44 PM     Page 563        (Black plate) CV plate)
                                                               (PANTONE 300




         Case studies                                          for productive conversations with colleagues and
              We conclude by returning to Keisha and CJ.       parents.
         Keisha scored the lowest on the TROLL of any-
         one in her class of 4-year olds—a total of 44
         points. Her teacher realized that she spent far       Dickinson teaches at the Lynch School of Education (Boston
         more time talking to Keisha’s high-scoring class-     College, Chestnut Hill, MA 02467-3813, USA). McCabe
         mates than she did to Keisha. Children who al-        teaches at the University of Massachusetts Lowell, and
         ready were the most advanced talkers were the         Sprague works at the Education Development Center in
         ones who asked questions, participated in group       Newton, Massachusetts.
         discussions, and took many opportunities to ex-
         plain activities to other children or tell stories
         about themselves. The teacher found that in her       References
         classroom, as in the classrooms of other              Bissex, G.L. (1980). GNYS at wrk: A child learns to write and
         preschool teachers (see Dickinson & Tabors,              read. Cambridge, MA: Harvard.
                                                               Bryant, P., MacLean, M., & Bradley, L. (1990). Rhyme, lan-
         2001), the old adage of “the rich get richer” ap-        guage, and children’s reading. Applied Psycholinguistics,
         plied to language and literacy development. The          11(3), 237–252.
         teacher also realized that several of the children    Clay, M.M. (1979). Stones—The concepts about print test.
         who misbehaved also received low scores, and             Exeter, NH: Heinemann.
                                                               Cronin, V., & Carver, P. (1998). Phonological sensitivity, rapid
         she made an effort to involve them in more con-          naming, and beginning reading. Applied Psycholinguistics,
         versations. Two such boys, in particular, seemed         19(3), 447–462.
         to thrive on this extra attention for desirable be-   Dickinson, D.K. (2001). Large-group and free-play times:
                                                                  Conversational settings supporting language and literacy de-
         havior and were noticeably better behaved by the         velopment. In D.K. Dickinson & P.O. Tabors (Eds.),
         end of the year.                                         Beginning literacy with language, pp. 223–256. Baltimore,
              In the coming weeks, Keisha’s teacher made          MD: Brookes.
         a concentrated effort to involve her in conversa-     Dickinson, D.K., & DeTemple, J. (1998). Putting parents in the
                                                                  picture: Maternal reports of preschoolers’ literacy as a pre-
         tion every day. The teacher also shared her              dictor of early reading. Early Childhood Research Quarterly,
         TROLL assessment of Keisha with the child’s              13(2), 241–263.
         mother, who acknowledged that she had been            Dickinson, D.K., & McCabe, A. (1991). The acquisition and de-
                                                                  velopment of language: A social interactionist account of lan-
         struggling with a number of issues and had not           guage and literacy development. In J.F. Kavanagh (Ed.), The
         had much time to talk with Keisha, let alone read        language continuum from infancy to literacy (pp. 1–40).
         with her. The teacher recommended regular trips          Parkton, MD: York.
         to the library and setting aside time at meals just   Dickinson, D.K., & Tabors, P.O. (2001). Beginning literacy with
                                                                  language: Young children learning at home and school.
         to talk about the day. By the end of the year,           Baltimore, MD: Brookes.
         Keisha was far more talkative and began to ini-       Gresham, F.M., & Elliott, S.N. (1990). Social skills rating sys-
         tiate looking at books on her own. She did not           tem: Ages 3–5. Circle Pines, MN: American Guidance
                                                                  Service.
         have to fail at reading in order to get the help      International Reading Association & National Association for the
         she needed to succeed. Keisha benefited from             Education of Young Children. (1998). Learning to read and
         the kind of early intervention strongly recom-           write: Developmentally appropriate practices for young chil-
                                                                  dren. Young Children, 53(4), 30–46.
         mended by Snow et al. (1998, pp. 318–319).            McCabe, A., & Dickinson, D.K. (2001, Summer). Good talk,
              CJ’s teacher responded to his advanced              close listening: Laying solid foundations for literacy. Children
         skills (he scored 71, which placed him above the         and Families, pp. 21–22.
         90th percentile) by making sure that his broth-       McCabe, A., & Rollins, P.R. (1991). Assessment of preschool
                                                                  narrative skills: Prerequisite for literacy. Miniseminar pre-
         ers read to him frequently and by involving him          sented at the Annual Convention of the American Speech-
         a couple of times a week in small-group book             Language-Hearing Association, Atlanta, GA.
         reading, when she encouraged his conversations        New Standards for Speaking and Listening Committee. (2001)
                                                                  New standards for speaking and listening for preschool
         and explained a number of terms in books that            through third grade. Philadelphia: National Center on
         were unfamiliar to him.                                  Education and the University of Pennsylvania.
              Tracking children’s language and literacy        Pellegrini, A.D., & Galda, L. (1993). Ten years after: A reexam-
         development is a critical yet challenging task.          ination of symbolic play and literacy research. Reading
                                                                  Research Quarterly, 28, 162–175.
         The TROLL provides one means for teachers to          Riley, J. (1996). The teaching of reading. London: Paul
         accomplish this and can provide a starting point         Chapman.


                                                          Teacher Rating of Oral Language and Literacy (TROLL)                       563
3/03 RT #31 Dickinson   2/12/03      1:44 PM       Page 564            (Black plate) CV plate)
                                                                       (PANTONE 300




                        Rosenthal, R., & Jacobsen, L. (1968). Pygmalion in the class-         Tabors, P.O., Beals, D.E., & Weizman, Z.O. (2001). “You know
                           room: Teacher expectation and pupils’ intellectual develop-          what oxygen is?” Learning new words at home. In D.K.
                           ment. New York: Holt, Rinehart and Winston.                          Dickinson & P.O. Tabors (Eds.), Beginning literacy with lan-
                        Snow, C.E. (1983). Literacy and language: Relationships during          guage: Young children learning at home and school (pp.
                           the preschool years. Harvard Educational Review, 53,                 93–110). Baltimore, MD: Brookes.
                           165–189.                                                           Tucker, M.S., & Codding, J.B. (1998). Standards for our
                        Snow, C.E., Burns, M.S., & Griffin, P. (Eds.). (1998). Preventing       schools: How to set them, measure them, and reach them. San
                           reading difficulties in young children. Washington, DC:              Francisco, CA: Jossey-Bass.
                           National Research Council, National Academy Press.                 Vellutino, F.R., & Scanlon, D.M. (2001). Emergent literacy
                        Speece, D.L., Roth, F.P., Cooper, D.H., & de la Paz, S. (1999).         skills, early instruction, and individual differences as deter-
                           The relevance of oral language skills to early literacy: A mul-      minants of difficulties in learning to read: The case for early
                           tivariate analysis. Applied Psycholinguistics, 20(2), 167–190.       intervention. In S. Neuman & D. Dickinson (Eds.), Handbook
                        Stanovich, K.E. (1992). Speculations on the causes and conse-           of early literacy research (pp. 295–321). New York: Guilford.
                           quences of individual differences in early reading acquisi-        Wagner, R.K., Torgesen, J.K., Laughon, P., Simmons, K., &
                           tion. In P.B. Gough, L.C. Ehri, & R. Treiman (Eds.), Reading         Rashotte, C.A. (1993). Development of young readers’ phono-
                           acquisition (pp. 307–342). Hillsdale, NJ: Erlbaum.                   logical processing abilities. Journal of Educational
                        Stipek, D.J., & Ryan, R.H. (1997). Economically disadvantaged           Psychology, 85, 83–103.
                           preschoolers: Ready to learn but further to go. Developmental      Wagner, R.K., Torgesen, J.K., Rashotte, C.A., Hecht, S.A.,
                           Psychology, 33(4), 711–723.                                          Barker, T.A., Burgess, S.R., et al. (1997). Changing relations
                        Sulzby, E., & Teale, W. (1991). Emergent literacy. In R. Barr, M.       between phonological processing abilities and word-level
                           Kamil, P. Mosenthal, & P.D. Pearson (Eds.), Handbook of              reading as children develop from beginning to skilled read-
                           reading research (Vol. II, pp. 727–758). New York:                   ers: A 5-year longitudinal study. Developmental Psychology,
                           Longman.                                                             33, 468–479.




                  Place your ad in
                THE READING TEACHER                                                          Do you have a
                       and/or                                                                position opening in
               JOURNAL OF ADOLESCENT                                                         the reading field?
                  & ADULT LITERACY                                                             We can help you find the
                  and reach top reading educators
                                                                                             highly qualified person you
                  with news about your products,                                             are looking for. Contact IRA
                    services, position openings,                                             Advertising Manager, Linda
                     conferences/seminars, etc.                                              Hunter, at 302-731-1600, ext.
                     at a very reasonable cost.
                                                                                             261 or lhunter@reading.org.
                           CALL NOW:                                                         We offer special discounted
                 Linda Hunter, Advertising Manager                                           rates for position opening ads.
                     (302) 731-1600, ext. 261
                        FAX 302-369-8476
                                                                                                                                           01-128 A&M 11/01
                                                                98-27 A&M 6/00




           564    The Reading Teacher          Vol. 56, No. 6    March 2003
Teacher rating of oral language & literacy troll

More Related Content

Similar to Teacher rating of oral language & literacy troll

Trehearne oral language_in_pre_k
Trehearne oral language_in_pre_kTrehearne oral language_in_pre_k
Trehearne oral language_in_pre_kThe Art of Learning
 
Using visual phonics as a strategic intervention to increase literacy
Using visual phonics as a strategic intervention to increase literacyUsing visual phonics as a strategic intervention to increase literacy
Using visual phonics as a strategic intervention to increase literacymanal312
 
research-base-early-childhood-literacy-development.pdf
research-base-early-childhood-literacy-development.pdfresearch-base-early-childhood-literacy-development.pdf
research-base-early-childhood-literacy-development.pdfAifaAfeeqa
 
Phonemic awareness
Phonemic awarenessPhonemic awareness
Phonemic awarenessCrizdee
 
Ela coordinators final
Ela coordinators finalEla coordinators final
Ela coordinators finalPennyDanielson
 
Reprinted from Young Children • January 2011 91® 2, 3.docx
Reprinted from Young Children • January 2011 91® 2, 3.docxReprinted from Young Children • January 2011 91® 2, 3.docx
Reprinted from Young Children • January 2011 91® 2, 3.docxsodhi3
 
Oral Language and Literacy Powerpoint
Oral Language and Literacy PowerpointOral Language and Literacy Powerpoint
Oral Language and Literacy PowerpointPaige Larkin
 
Lr %20reporting%20form%20-%20 elementary-eng%20(1)
Lr %20reporting%20form%20-%20 elementary-eng%20(1)Lr %20reporting%20form%20-%20 elementary-eng%20(1)
Lr %20reporting%20form%20-%20 elementary-eng%20(1)hkarableyeh
 
Strickland Ncfl Conference
Strickland Ncfl ConferenceStrickland Ncfl Conference
Strickland Ncfl ConferenceNCFLLiteracyNow
 
Strickland Ncfl Conference
Strickland Ncfl ConferenceStrickland Ncfl Conference
Strickland Ncfl ConferenceNCFLLiteracyNow
 
Family Literacy & The Achievement Gap
Family Literacy & The Achievement GapFamily Literacy & The Achievement Gap
Family Literacy & The Achievement GapNCFLLiteracyNow
 
Word Hikes with Little Tikes
Word Hikes with Little TikesWord Hikes with Little Tikes
Word Hikes with Little TikesKeith Pruitt
 
dissertation protocol presentation
dissertation protocol presentationdissertation protocol presentation
dissertation protocol presentationDevant Brahm Shah
 
ELD 506: Second Language Acquisition
ELD 506: Second Language AcquisitionELD 506: Second Language Acquisition
ELD 506: Second Language AcquisitionNissa Hales
 
Language and education
Language and educationLanguage and education
Language and educationEdgar Eslit
 
Where Communication and Reading Difficulties Meet
Where Communication and Reading Difficulties MeetWhere Communication and Reading Difficulties Meet
Where Communication and Reading Difficulties MeetBilinguistics
 
Selecting A topicJob PositionFor the first part of the project,.docx
Selecting A topicJob PositionFor the first part of the project,.docxSelecting A topicJob PositionFor the first part of the project,.docx
Selecting A topicJob PositionFor the first part of the project,.docxbagotjesusa
 

Similar to Teacher rating of oral language & literacy troll (20)

Trehearne oral language_in_pre_k
Trehearne oral language_in_pre_kTrehearne oral language_in_pre_k
Trehearne oral language_in_pre_k
 
Using visual phonics as a strategic intervention to increase literacy
Using visual phonics as a strategic intervention to increase literacyUsing visual phonics as a strategic intervention to increase literacy
Using visual phonics as a strategic intervention to increase literacy
 
research-base-early-childhood-literacy-development.pdf
research-base-early-childhood-literacy-development.pdfresearch-base-early-childhood-literacy-development.pdf
research-base-early-childhood-literacy-development.pdf
 
Phonemic awareness
Phonemic awarenessPhonemic awareness
Phonemic awareness
 
Ela coordinators final
Ela coordinators finalEla coordinators final
Ela coordinators final
 
Reprinted from Young Children • January 2011 91® 2, 3.docx
Reprinted from Young Children • January 2011 91® 2, 3.docxReprinted from Young Children • January 2011 91® 2, 3.docx
Reprinted from Young Children • January 2011 91® 2, 3.docx
 
Oral Language and Literacy Powerpoint
Oral Language and Literacy PowerpointOral Language and Literacy Powerpoint
Oral Language and Literacy Powerpoint
 
Lr %20reporting%20form%20-%20 elementary-eng%20(1)
Lr %20reporting%20form%20-%20 elementary-eng%20(1)Lr %20reporting%20form%20-%20 elementary-eng%20(1)
Lr %20reporting%20form%20-%20 elementary-eng%20(1)
 
Literacy Pedagogy
Literacy PedagogyLiteracy Pedagogy
Literacy Pedagogy
 
Strickland Ncfl Conference
Strickland Ncfl ConferenceStrickland Ncfl Conference
Strickland Ncfl Conference
 
Strickland Ncfl Conference
Strickland Ncfl ConferenceStrickland Ncfl Conference
Strickland Ncfl Conference
 
Family Literacy & The Achievement Gap
Family Literacy & The Achievement GapFamily Literacy & The Achievement Gap
Family Literacy & The Achievement Gap
 
Tev a4
Tev a4Tev a4
Tev a4
 
Word Hikes with Little Tikes
Word Hikes with Little TikesWord Hikes with Little Tikes
Word Hikes with Little Tikes
 
dissertation protocol presentation
dissertation protocol presentationdissertation protocol presentation
dissertation protocol presentation
 
ELD 506: Second Language Acquisition
ELD 506: Second Language AcquisitionELD 506: Second Language Acquisition
ELD 506: Second Language Acquisition
 
Young learners
Young learnersYoung learners
Young learners
 
Language and education
Language and educationLanguage and education
Language and education
 
Where Communication and Reading Difficulties Meet
Where Communication and Reading Difficulties MeetWhere Communication and Reading Difficulties Meet
Where Communication and Reading Difficulties Meet
 
Selecting A topicJob PositionFor the first part of the project,.docx
Selecting A topicJob PositionFor the first part of the project,.docxSelecting A topicJob PositionFor the first part of the project,.docx
Selecting A topicJob PositionFor the first part of the project,.docx
 

More from The Art of Learning (20)

Exploring teacher beliefs
Exploring teacher beliefsExploring teacher beliefs
Exploring teacher beliefs
 
Web inclusión
Web inclusión Web inclusión
Web inclusión
 
Experiencing technology in early childhood learning
Experiencing technology in early childhood learningExperiencing technology in early childhood learning
Experiencing technology in early childhood learning
 
Copei congress aug 2015
Copei congress aug 2015Copei congress aug 2015
Copei congress aug 2015
 
SPLASH INTO PREK 2015
SPLASH INTO PREK 2015SPLASH INTO PREK 2015
SPLASH INTO PREK 2015
 
Journeys Training 2015
Journeys Training 2015Journeys Training 2015
Journeys Training 2015
 
Hmh Splash into Pre K Planning 2015
Hmh Splash into Pre K Planning 2015Hmh Splash into Pre K Planning 2015
Hmh Splash into Pre K Planning 2015
 
¿Cómo le digo?
¿Cómo le digo?¿Cómo le digo?
¿Cómo le digo?
 
K 12 proposal oct 23, 2012
K 12 proposal oct 23, 2012K 12 proposal oct 23, 2012
K 12 proposal oct 23, 2012
 
Skills of the 4 learning styles
Skills of the 4 learning stylesSkills of the 4 learning styles
Skills of the 4 learning styles
 
Star material reflection september 2012
Star material reflection september 2012Star material reflection september 2012
Star material reflection september 2012
 
Ijtlhe141
Ijtlhe141Ijtlhe141
Ijtlhe141
 
Critically reflectiveteaching
Critically reflectiveteachingCritically reflectiveteaching
Critically reflectiveteaching
 
Critically reflective teaching
Critically reflective teachingCritically reflective teaching
Critically reflective teaching
 
Critical teaching reflection
Critical teaching reflectionCritical teaching reflection
Critical teaching reflection
 
Ciq
CiqCiq
Ciq
 
Brookfield summary
Brookfield summaryBrookfield summary
Brookfield summary
 
Brookfield
BrookfieldBrookfield
Brookfield
 
What we can learn from finland
What we can learn from finlandWhat we can learn from finland
What we can learn from finland
 
The finland phenomenon
The finland phenomenonThe finland phenomenon
The finland phenomenon
 

Recently uploaded

Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Celine George
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxMULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxAnupkumar Sharma
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptxiammrhaywood
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parentsnavabharathschool99
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYKayeClaireEstoconing
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfSpandanaRallapalli
 
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinoFILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinojohnmickonozaleda
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxCulture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxPoojaSen20
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management SystemChristalin Nelson
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfphamnguyenenglishnb
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxAshokKarra1
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomnelietumpap1
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy
 
Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)cama23
 

Recently uploaded (20)

Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxMULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parents
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdf
 
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinoFILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipino
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
 
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxCulture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management System
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptx
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choom
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
 
Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)
 
Raw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptxRaw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptx
 

Teacher rating of oral language & literacy troll

  • 1. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 554 (Black plate) CV plate) (PANTONE 300 David K. Dickinson Allyssa McCabe Kim Sprague Teacher Rating of Oral This rating system measures skills Language and critical to the New Standards for Speaking and Listening. TROLL Literacy (TROLL): progress in language and literacy Individualizing can be used to track children’s curriculum, and to stimulate early literacy development, to inform focused communication between parents and teachers. instruction with a standards-based rating tool K eisha is a quiet little girl with tawny group of no more than three other children skin, long black hair, and large brown where he was able to ask questions as a way to eyes. Her teacher has observed that clarify the meaning of a story. She suggested to she is shy with other children, reluctant to par- his mother that his older brothers be encouraged ticipate in groups, and often the last to join in ac- to read to him at home. She also noted that his tivities, but the teacher never has had to scores on the language and reading subtotals of reprimand Keisha. Only when the teacher sat the TROLL were high—higher than his writing down to fill out reports on the language devel- subtotal—and she was knowledgeable about his opment of each of her students did she realize exact writing skills and limitations. Keisha has a problem. CJ is an energetic almost 5-year-old African Reading, writing, and oral American boy who attends childcare from 7:00 language: Roots of literacy a.m. to 4:00 p.m. five days a week. His teacher Early reading and writing abilities are by observed that “CJ has demonstrated strong use now well-known dimensions of early literacy. of his oral language skills since entering my pro- Through their preschool years, children progres- gram. CJ speaks clearly and is easily understood sively construct understandings of writing (e.g., by adults.” The teacher was enrolled in a col- Bissex, 1980) and reading (e.g., Sulzby & Teale, lege course that focused on enriching children’s 1991). Similarly, the contribution of children’s language and literacy skills. She noticed after phonological awareness has often been explored completing the TROLL assessment of CJ that he and is also widely recognized (Bryant, did not always choose to attend to stories in MacLean, & Bradley, 1990; Cronin & Carver, large group and appeared most interested in sto- 1998; Speece, Roth, Cooper, & de la Paz, 1999; ries when reading one-on-one or in a small Stanovich, 1992; Vellutino & Scanlon, 2001; 554 The Reading Teacher Vol. 56, No. 6 March 2003 ©2003 International Reading Association (pp. 554–564)
  • 2. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 555 (Black plate) CV plate) (PANTONE 300 Wagner, Torgesen, Laughon, Simmons, & acquisition of literacy or their emergent reading Rashotte, 1993; Wagner et al., 1997). and writing skills. In response to this need, we However, there are other lesser known oral present an accessible means of evaluating each language skills relevant to literacy that include the child in a classroom for literacy-related abili- development of narrative ability (Dickinson & ties. One way to help teachers track children’s Tabors, 2001; see McCabe & Rollins, 1991, for development is by periodic reflection on demon- review), use of talk while pretending (Dickinson, strations of early literacy. Even though teachers 2001; see Pelligrini & Galda, 1993, for review), may lack prior formal training regarding assess- and varied vocabulary usage (Tabors, Beals, & ment of language and literacy development, we Weizman, 2001). To be able to read and write ef- have found that they can recognize critical as- fectively, children must develop strong oral lan- pects of this development. Using the Teacher guage skills (Dickinson & McCabe, 1991; Rating of Oral Language and Literacy (TROLL) Dickinson & Tabors, 2001; Snow, 1983; Snow, to evaluate children can help teachers assess the Burns, & Griffin, 1998). Oral language skills effectiveness of an educational program. blossom during the preschool years, but they are also very vulnerable and in need of stimulation New Standards: Speaking and during this time, as a number of major organiza- listening for preschool through tions involved in the education of young children have recognized. third grade Because speaking and listening are so criti- A call for developmentally cal for literacy development in early childhood, the New Standards project, a program of the appropriate assessment National Center on Education and the Economy The International Reading Association (Tucker & Codding, 1998), has developed (IRA) and the National Association for the research-based standards for speaking and lis- Education of Young Children (NAEYC) jointly tening in preschool through third grade (New formulated a position statement regarding early Standards Speaking and Listening Committee, literacy development (1998). The statement ac- 2001). These standards complement those al- knowledges the difficulty that teachers face, for ready developed for reading and writing. The example, in kindergarten classrooms where a speaking and listening standards include specif- five-year range in children’s literacy skills is not ic recommendations for teachers regarding ben- uncommon (Riley, 1996). Estimating where eficial habits of conversation, useful kinds of each child is in terms of the acquisition of speak- talk such as narratives and explanations, and lan- ing, listening, reading, and writing skills is criti- guage conventions relevant to early childhood. cal to providing developmentally appropriate Many programs are concerned with ensuring instruction to all children in this wide range. The that their students meet such national standards. position statement is quite clear that throughout these critical years accurate assessment of chil- Development of TROLL dren’s knowledge, skills, and dispositions in reading and writ- To guide teachers’ observations of children’s ing will help teachers better match instruction with how and individual language and literacy skills and in- what children are learning. However, early reading and writ- terests, we created an instrument that focuses on ing cannot simply be measured as a set of narrowly defined skills on standardized tests. These measures often are not re- key abilities. In constructing this tool, we drew liable or valid indicators of what children can do in typical on the same body of theory and research that was practice, nor are they sensitive to language variation, culture, the foundation for the speaking and listening or the experiences of young children. (International Reading standards. Indeed, we contributed to both efforts. Association & National Association for the Education of TROLL is a tool developed by the first author Young Children, 1998, p. 38; emphasis added) to provide teachers with a way to track the lan- guage and literacy skills and interests of children As if these difficulties were not enough, in their classrooms and is represented in its en- preschool teachers face time constraints and typ- tirety in Table 1. Although it was developed for ically have not been trained to evaluate chil- research purposes separate from the New dren’s language development as it relates to the Standards initiative, TROLL addresses all the Teacher Rating of Oral Language and Literacy (TROLL) 555
  • 3. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 556 (Black plate) CV plate) (PANTONE 300 central speaking and listening skills in the New course, if a teacher can rate a child’s competence Standards, as well as many of the early reading in a language other than English, it would be of and writing skills covered by the companion great interest to rate the child’s skill in both reading and writing standards. Of special interest English and his or her first language. Whenever is the fact that it allows teachers to track chil- possible, educators need to involve the parents of dren’s interests in various language and literacy ESL students. In fact, maternal reports of activities—something that no direct assessment preschoolers’ literacy (when children were 3 or 4 tool can capture. years old) significantly predicted much of the variation in kindergarten tests, grade 1 teacher Using TROLL to inform instruction assessments, and direct assessments of decod- No formal training is required to use the ing given near the end of first grade (Dickinson TROLL instrument; however, it is most effective & DeTemple, 1998). Thus, if TROLL were used if teachers know about language and literacy de- collaboratively with parents, it could provide a velopment. In other words, TROLL can make powerful way to organize a multifaceted conver- knowledgeable teachers better. This tool is de- sation about a child’s full range of language and signed for classroom teachers to easily track the literacy development. language and literacy development of all their stu- dents. The TROLL requires only 5 to 10 minutes TROLL has been used extensively for each child and need not disrupt classroom ac- Over the last several years, TROLL has been tivities (it can be completed during naptime). used with 973 children in the context of research Teachers can use the information to inform examining early literacy development. Over 100 their teaching by identifying (a) children who are teachers have been involved in this process. displaying evidence of serious delay and who may One measure of a good test is that all items need formal assessment by audiologists or speech- on the test tap related abilities. We analyzed re- language pathologists and (b) children who are sponses for 534 of these preschool children and showing high levels of literacy development and found strong indications that TROLL meets therefore need special additional challenges in this standards expected of research tools in this re- area. Furthermore, by completing TROLL several gard. Specifically, Cronbach’s alpha estimates of times over the course of a year, teachers can track internal consistency ranged from .77 to .92 for the progress of all their students. separate subscales, indicating strong internal Second, teachers could combine results for consistency. For the total TROLL scores, alphas all the children in their class to determine which exceeded .89 for each age. areas need more systematic instruction. For ex- Another way of determining the value of a ample, if all children in a class score relatively tool is the extent to which a child’s performance low on rhymes, their teacher might want to begin on that tool compares to performance on other providing numerous opportunities to listen to measures. After all, TROLL relies on a teacher’s and produce rhyming chants, songs, and poems. professional judgement or perception of a child’s Teachers should consider using TROLL rat- development rather than formal testing of actual ings of children as a basis for discussions with development. It is therefore reassuring to find parents. In fact, as we saw in the case of CJ at the that, for this sample, the ratings teachers provid- outset of this article, teachers are likely to initiate ed using TROLL compared favorably to formal such discussions without anyone urging them to assessments by researchers. These measures in- do so. (Recall that the teacher recommended that cluded the well-established Peabody Picture CJ’s mother get his older brothers to read with Vocabulary Test (PPVT-III), which is a measure him one-on-one because that was an effective of receptive vocabulary, as well as measures of setting for the child.) emergent literacy and early phonological aware- Parents can also serve as a source for rat- ness. Teacher ratings of children’s language and ings using the TROLL. In particular, teachers of literacy development on the TROLL show mod- bilingual children often have a difficult time rat- erate associations with children’s scores on all ing the language competence of children who three of those direct assessments despite the fact speak English as a second language (ESL). Of that teachers never saw those test results. So in 556 The Reading Teacher Vol. 56, No. 6 March 2003
  • 4. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 557 (Black plate) CV plate) (PANTONE 300 about five minutes, and with no special training This difference partly reflects the fact that on the TROLL, teachers themselves can index TROLL assesses other factors that teachers take what specially trained researchers would spend into consideration as they rate individual 25–30 minutes per child assessing. children—factors that are not captured in the Of course, the TROLL teacher ratings do direct, formal assessments. TROLL captures the not agree completely with the researchers’ tests. kind of information the position statement by Table 1 Teacher Rating of Oral Language and Literacy (TROLL) Language use 1. How would you describe this child’s willingness to start a conversation with adults and peers and continue trying to communicate when he or she is not understood on the first attempt? Select the statement that best describes how hard the child works to be understood by others. Child almost never Child sometimes be- Child begins conver- Child begins conver- begins a conversa- gins conversation with sations with both peers sations with both tion with peers or the either peers or the and teachers on occa- peers and teachers. teacher and never teacher. If initial ef- sion. If initial efforts fail, If initial efforts fail, he keeps trying if un- forts fail he or she of- he or she will some- or she will work hard successful at first. ten gives up quickly. times keep trying. to be understood. 1 2 3 4 2. How well does the child communicate personal experiences in a clear and logical way? Assign the score that best describes this child when he or she is attempting to tell an adult about events that hap- pened at home or some other place where you were not present. Child is very tenta- Child offers some in- Child offers informa- Child freely offers in- tive, only offers a few formation, but infor- tion and sometimes formation and tells words, requires you mation needed to includes the neces- experiences in a way to ask questions, has really understand the sary information to that is nearly always difficulty responding event is missing (e.g., understand the event complete, well se- to questions you ask. where or when it hap- fully. quenced, and com- pened, who was pres- prehensible. ent, the sequence of what happened). 1 2 3 4 3. How would you describe this child’s pattern of asking questions about topics that interest him or her (e.g., why things happen, why people act the way they do)? Assign the score that best describes the child’s approach to displaying curiosity by asking adults questions. To your knowledge, On a few occasions On several occasions Child often asks the child has never the child has asked the child has asked adults questions re- asked an adult a adults some ques- interesting questions. flecting curiosity. question reflecting tions. The discussion On occasion these These often lead to curiosity about why that resulted was have lead to an inter- interesting, extend- things happen or brief and limited in esting conversation. ed conversations. why people do depth. things. 1 2 3 4 (continued) Teacher Rating of Oral Language and Literacy (TROLL) 557
  • 5. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 558 (Black plate) CV plate) (PANTONE 300 Table 1 (continued) Teacher Rating of Oral Language and Literacy (TROLL) 4. How would you describe this child’s use of talk while pretending in the house area or when playing with blocks? Consider the child’s use of talk with peers to start pretending and to carry it out. Assign the score that best applies. Child rarely or never On occasion the Child engages in pre- Child often talks in engages in pretend child engages in pre- tending often and elaborate ways while play or else never tending that includes conversations are pretending. talks while pretend- some talk. Talk is sometimes important Conversations that ing. brief, may only be to the play. On occa- are carried out “in used when starting sion child engages in role” are common and the play, and is of some back-and-forth are an important part limited importance to pretend dialogue with of the play. Child the ongoing play ac- another child. sometimes steps out tivity. of pretend play to give directions to another. 1 2 3 4 5. How would you describe the child’s ability to recognize and produce rhymes? Child cannot ever Child occasionally Child spontaneously Child spontaneously say if two words produces or identi- produces rhymes and rhymes words of rhyme and cannot fies rhymes when can sometimes tell more than one sylla- produce a rhyme given help. when word pairs ble and always iden- when given exam- rhyme. tifies whether words ples (e.g., rat, cat). rhyme. 1 2 3 4 6. How often does child use a varied vocabulary or try out new words (e.g., heard in stories or from teacher)? Never Rarely Sometimes Often 1 2 3 4 7. When child speaks to adults other than you or the teaching assistant, is he or she understandable? Never Rarely Sometimes Often 1 2 3 4 8. How often does child express curiosity about how and why things happen? Never Rarely Sometimes Often 1 2 3 4 Language subtotal ___________ Reading 9. How often does child like to hear books read in the full group? Never Rarely Sometimes Often 1 2 3 4 (continued) 558 The Reading Teacher Vol. 56, No. 6 March 2003
  • 6. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 559 (Black plate) Table 1 (continued) Teacher Rating of Oral Language and Literacy (TROLL) 10. How often does child attend to stories read in the full group or small groups and react in a way that indicates comprehension? Never Rarely Sometimes Often 1 2 3 4 11. Is child able to read storybooks on his or her own? Does not pretend to Pretends to read Pretends to read and Reads the written read books reads some words words 1 2 3 4 12. How often does child remember the story line or characters in books that he or she heard before either at home or in class? Never Rarely Sometimes Often 1 2 3 4 13. How often does child look at or read books alone or with friends? Never Rarely Sometimes Often 1 2 3 4 14. Can child recognize letters? (choose one answer) None of the letters of the alphabet ....................................1 Some of them (up to 10)....................................................2 Most of them (up to 20) ....................................................3 All of them..........................................................................4 15. Does child recognize his or her own first name in print? No Yes 1 2 16. Does child recognize other names? No One or two A few Several (up to four or five) (six or more) 1 2 3 4 17. Can child read any other words? No One or two A few Several (up to four or five) (six or more) 1 2 3 4 18. Does child have a beginning understanding of the relationship between sounds and letters (e.g., the letter B makes a “buh” sound)? No One or two A few Several (up to four or five) (six or more) 1 2 3 4 (continued) Teacher Rating of Oral Language and Literacy (TROLL) 559
  • 7. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 560 (Black plate) Table 1 (continued) Teacher Rating of Oral Language and Literacy (TROLL) 19. Can child sound out words that he or she has not read before? No Once or twice One syllable words Many words often 1 2 3 4 Reading subtotal ___________ Writing 20. What does child’s writing look like? Only draws or Some letter-like Many conventional Conventional letters scribbles marks letters and words 1 2 3 4 21. How often does child like to write or pretend to write? Never Rarely Sometimes Often 1 2 3 4 22. Can child write his or her first name, even if some of the letters are backward? Never Rarely Sometimes Often 1 2 3 4 23. Does child write other names or real words? No One or two A few (up to four or five) Several (six or more) 1 2 3 4 24. How often does child write signs or labels? Never Rarely Sometimes Often 1 2 3 4 25. Does child write stories, songs, poems, or lists? Never Rarely Sometimes Often 1 2 3 4 Writing subtotal __________ (out of 24 possible) Oral language subtotal __________ (out of 32 possible) Reading subtotal __________ (out of 42 possible) Total TROLL score __________ (out of 98 possible) Note. Copyright ©1997 Education Development Center. Reproduced with permission. 560 The Reading Teacher Vol. 56, No. 6 March 2003
  • 8. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 561 (Black plate) CV plate) (PANTONE 300 IRA and NAEYC recommended be captured in failure by virtue of overlooking children expect- assessment. Formal tests measure how well a ed to fail. child does at only one point in time; children This lack of revision of judgments about lit- may be tired or sick on the day of the PPVT-III eracy skills and interests points to the value of assessment and receive a dismal score for their teachers carrying out periodic informal assess- receptive vocabulary, whereas their teacher ments of children to provide concrete evidence knows that on most days they are quick to pick of children’s growth. For example, teachers can up on the vocabulary of classroom units and ar- ticulate when sharing stories of personal experi- ask children to write their own or others’ names ence. The TROLL score is not as vulnerable to or to identify letters in them. fluctuations in a child’s performance as are the In general, then, rather than contribute to formal tests. self-fulfilling prophecies of children’s success or Furthermore, as noted earlier, the TROLL failure, we hope that TROLL will predict possi- includes information about the child’s engage- ble failure to learn to read in order to prevent ment in literacy activities and patterns of use of such failure. That is, we hope that teachers will oral language. Formal assessments do not tap use this instrument to give struggling children such interests and inclinations to use language the help they need to succeed so that they never and print in any way. And yet, a child’s initia- have to experience failure at a later point. tive in this area could be an important determi- Specifically, we (Dickinson, 2001) recommend nant of the child’s future success. that teachers make sure that one or more adults Overall, children’s scores improve from fall to spring. However, the correlations between read with small groups of children every day and TROLL scores and direct assessment measures ensure that all children have this experience once of literacy are generally less reliable in the spring a week. Teachers can also set aside time when than in the fall, which is just the opposite of what children tell stories. Finally, teachers need to in- one would predict. After all, teachers have had troduce varied and challenging vocabulary as a far more interaction with children—and should routine part of the curriculum. therefore be more sensitive to their reading and writing skills—in the spring than in the fall. In What TROLL scores mean fact, however, there is no firm correlation be- Table 2 displays what different scores on tween teacher TROLL scores in the spring and TROLL indicate about a child’s overall develop- formal assessments of children’s emergent liter- mental level. For example, a score of 66 in the acy conducted at that time, although correlations with vocabulary (PPVT) and phonological spring indicates that the child is making progress awareness (EPAP) remain moderately strong. that is average for 4-year-olds in this sample. Unfortunately, this may reflect the fact that The sample consisted only of low-income chil- teachers do not revisit their assessment of chil- dren, so these scores should be regarded as pro- dren’s literacy skills as much as they should. In visional. However, we argue that the well-known the fall, teachers may arrive at judgments about academic disadvantages of low-socioeconomic a child’s accomplishments that they fail to up- status (SES) preschool children (e.g., Stipek & date. Children’s progress in language and liter- Ryan, 1997) make this sample important in its acy may go undetected by their teachers. This own right. If a child from a low-SES family finding is sobering. scores at the 10th percentile, for example, this re- One danger of any judgment is that it can be- sult cannot be dismissed as a result of economic come a self-fulfilling prophecy (Rosenthal & disadvantage; such a child is scoring very poorly Jacobsen, 1968). Teachers’ opinions of children at the very outset of their education can predict chil- relative to his or her economic peers. Scores at dren’s success just by virtue of the teacher giving the 75th and, especially, the 90th percentile, extra attention, motivation, or instruction to those however, should prompt a teacher to provide op- children they expect to become the most accom- portunities for children to read more advanced plished. Conversely, teacher expectations— books, engage in writing frequently, and talk at never revisited—can predict other children’s length about challenging and interesting topics. Teacher Rating of Oral Language and Literacy (TROLL) 561
  • 9. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 562 (Black plate) Table 2 What TROLL scores mean 3-year-olds’ 4-year-olds’ 5-year-olds’ Relative standing Recommendations/ TROLL scores TROLL scores TROLL scores on the TROLL meaning Fall Spring Fall Spring Fall Spring n = 115 n = 55 n = 336 n = 234 n = 83 n=229 40 44 43 46 51 55 10th percentile Assessment by child of audi- ologist, speech-language pathologist. Discuss concerns with parents. 44 49 52 55 59 65 25th percentile Assessment of child by speech-language pathologist, extra involvement in extended conversations, and other literacy activities. 51 56 61 66 68 76 50th percentile Child is performing at an average level. 61 62 71 74 75 85 75th percentile Child is performing above average. 68 69 80 84 85 91 90th percentile Child should be encouraged to read and write at advanced levels in school and at home. Note. Our data come from a low-income sample. In national studies children from such homes tend to receive less support for early lan- guage and literacy development than children from economically advantaged homes. Children from more advantaged backgrounds would be expected to receive somewhat higher ratings than those reported above (roughly 5–6 points higher on average). Program evaluation potential: to spring on average in comparison to a control group. TROLL measures appropriate Furthermore, the classrooms that supported language and literacy instruction such advances had improved classroom language As we mentioned, children’s scores on and literacy practices. Teachers who participated TROLL might well serve as an impetus to plan in LEEP made greater efforts to engage children systematic language and literacy instruction for a in conversations and to provide opportunities for class. In fact, such instruction has been imple- children to write and to use books. The change mented by a number of Head Start programs in that appeared to reflect the most major shift was the Boston, Massachusetts, area, where TROLL the extent to which teachers planned activities detected changes that occurred as a result of pro- with the intention of having children practice gram improvement efforts. Head Start teachers literacy-related skills. Enriching the literacy en- and their supervisors volunteered to participate vironment had one additional effect that might in a professional development program called come as a surprise. Children whose teachers par- LEEP (Literacy Environment Enrichment ticipated in LEEP displayed significantly more Program). They received academic credit for growth in social skills than their peers, as as- participating in two intensive three-day blocks sessed by the Social Skills Rating System separated by three months. TROLL scores for (Gresham & Elliott, 1990). Children who are children whose teachers participated in LEEP busy talking, reading, and writing—activities were significantly higher than for children registered by TROLL—were more likely to be whose teachers did not. Specifically, children in viewed by their teachers as developing stronger LEEP classrooms gained more overall from fall skills in collaborating with others. 562 The Reading Teacher Vol. 56, No. 6 March 2003
  • 10. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 563 (Black plate) CV plate) (PANTONE 300 Case studies for productive conversations with colleagues and We conclude by returning to Keisha and CJ. parents. Keisha scored the lowest on the TROLL of any- one in her class of 4-year olds—a total of 44 points. Her teacher realized that she spent far Dickinson teaches at the Lynch School of Education (Boston more time talking to Keisha’s high-scoring class- College, Chestnut Hill, MA 02467-3813, USA). McCabe mates than she did to Keisha. Children who al- teaches at the University of Massachusetts Lowell, and ready were the most advanced talkers were the Sprague works at the Education Development Center in ones who asked questions, participated in group Newton, Massachusetts. discussions, and took many opportunities to ex- plain activities to other children or tell stories about themselves. The teacher found that in her References classroom, as in the classrooms of other Bissex, G.L. (1980). GNYS at wrk: A child learns to write and preschool teachers (see Dickinson & Tabors, read. Cambridge, MA: Harvard. Bryant, P., MacLean, M., & Bradley, L. (1990). Rhyme, lan- 2001), the old adage of “the rich get richer” ap- guage, and children’s reading. Applied Psycholinguistics, plied to language and literacy development. The 11(3), 237–252. teacher also realized that several of the children Clay, M.M. (1979). Stones—The concepts about print test. who misbehaved also received low scores, and Exeter, NH: Heinemann. Cronin, V., & Carver, P. (1998). Phonological sensitivity, rapid she made an effort to involve them in more con- naming, and beginning reading. Applied Psycholinguistics, versations. Two such boys, in particular, seemed 19(3), 447–462. to thrive on this extra attention for desirable be- Dickinson, D.K. (2001). Large-group and free-play times: Conversational settings supporting language and literacy de- havior and were noticeably better behaved by the velopment. In D.K. Dickinson & P.O. Tabors (Eds.), end of the year. Beginning literacy with language, pp. 223–256. Baltimore, In the coming weeks, Keisha’s teacher made MD: Brookes. a concentrated effort to involve her in conversa- Dickinson, D.K., & DeTemple, J. (1998). Putting parents in the picture: Maternal reports of preschoolers’ literacy as a pre- tion every day. The teacher also shared her dictor of early reading. Early Childhood Research Quarterly, TROLL assessment of Keisha with the child’s 13(2), 241–263. mother, who acknowledged that she had been Dickinson, D.K., & McCabe, A. (1991). The acquisition and de- velopment of language: A social interactionist account of lan- struggling with a number of issues and had not guage and literacy development. In J.F. Kavanagh (Ed.), The had much time to talk with Keisha, let alone read language continuum from infancy to literacy (pp. 1–40). with her. The teacher recommended regular trips Parkton, MD: York. to the library and setting aside time at meals just Dickinson, D.K., & Tabors, P.O. (2001). Beginning literacy with language: Young children learning at home and school. to talk about the day. By the end of the year, Baltimore, MD: Brookes. Keisha was far more talkative and began to ini- Gresham, F.M., & Elliott, S.N. (1990). Social skills rating sys- tiate looking at books on her own. She did not tem: Ages 3–5. Circle Pines, MN: American Guidance Service. have to fail at reading in order to get the help International Reading Association & National Association for the she needed to succeed. Keisha benefited from Education of Young Children. (1998). Learning to read and the kind of early intervention strongly recom- write: Developmentally appropriate practices for young chil- dren. Young Children, 53(4), 30–46. mended by Snow et al. (1998, pp. 318–319). McCabe, A., & Dickinson, D.K. (2001, Summer). Good talk, CJ’s teacher responded to his advanced close listening: Laying solid foundations for literacy. Children skills (he scored 71, which placed him above the and Families, pp. 21–22. 90th percentile) by making sure that his broth- McCabe, A., & Rollins, P.R. (1991). Assessment of preschool narrative skills: Prerequisite for literacy. Miniseminar pre- ers read to him frequently and by involving him sented at the Annual Convention of the American Speech- a couple of times a week in small-group book Language-Hearing Association, Atlanta, GA. reading, when she encouraged his conversations New Standards for Speaking and Listening Committee. (2001) New standards for speaking and listening for preschool and explained a number of terms in books that through third grade. Philadelphia: National Center on were unfamiliar to him. Education and the University of Pennsylvania. Tracking children’s language and literacy Pellegrini, A.D., & Galda, L. (1993). Ten years after: A reexam- development is a critical yet challenging task. ination of symbolic play and literacy research. Reading Research Quarterly, 28, 162–175. The TROLL provides one means for teachers to Riley, J. (1996). The teaching of reading. London: Paul accomplish this and can provide a starting point Chapman. Teacher Rating of Oral Language and Literacy (TROLL) 563
  • 11. 3/03 RT #31 Dickinson 2/12/03 1:44 PM Page 564 (Black plate) CV plate) (PANTONE 300 Rosenthal, R., & Jacobsen, L. (1968). Pygmalion in the class- Tabors, P.O., Beals, D.E., & Weizman, Z.O. (2001). “You know room: Teacher expectation and pupils’ intellectual develop- what oxygen is?” Learning new words at home. In D.K. ment. New York: Holt, Rinehart and Winston. Dickinson & P.O. Tabors (Eds.), Beginning literacy with lan- Snow, C.E. (1983). Literacy and language: Relationships during guage: Young children learning at home and school (pp. the preschool years. Harvard Educational Review, 53, 93–110). Baltimore, MD: Brookes. 165–189. Tucker, M.S., & Codding, J.B. (1998). Standards for our Snow, C.E., Burns, M.S., & Griffin, P. (Eds.). (1998). Preventing schools: How to set them, measure them, and reach them. San reading difficulties in young children. Washington, DC: Francisco, CA: Jossey-Bass. National Research Council, National Academy Press. Vellutino, F.R., & Scanlon, D.M. (2001). Emergent literacy Speece, D.L., Roth, F.P., Cooper, D.H., & de la Paz, S. (1999). skills, early instruction, and individual differences as deter- The relevance of oral language skills to early literacy: A mul- minants of difficulties in learning to read: The case for early tivariate analysis. Applied Psycholinguistics, 20(2), 167–190. intervention. In S. Neuman & D. Dickinson (Eds.), Handbook Stanovich, K.E. (1992). Speculations on the causes and conse- of early literacy research (pp. 295–321). New York: Guilford. quences of individual differences in early reading acquisi- Wagner, R.K., Torgesen, J.K., Laughon, P., Simmons, K., & tion. In P.B. Gough, L.C. Ehri, & R. Treiman (Eds.), Reading Rashotte, C.A. (1993). Development of young readers’ phono- acquisition (pp. 307–342). Hillsdale, NJ: Erlbaum. logical processing abilities. Journal of Educational Stipek, D.J., & Ryan, R.H. (1997). Economically disadvantaged Psychology, 85, 83–103. preschoolers: Ready to learn but further to go. Developmental Wagner, R.K., Torgesen, J.K., Rashotte, C.A., Hecht, S.A., Psychology, 33(4), 711–723. Barker, T.A., Burgess, S.R., et al. (1997). Changing relations Sulzby, E., & Teale, W. (1991). Emergent literacy. In R. Barr, M. between phonological processing abilities and word-level Kamil, P. Mosenthal, & P.D. Pearson (Eds.), Handbook of reading as children develop from beginning to skilled read- reading research (Vol. II, pp. 727–758). New York: ers: A 5-year longitudinal study. Developmental Psychology, Longman. 33, 468–479. Place your ad in THE READING TEACHER Do you have a and/or position opening in JOURNAL OF ADOLESCENT the reading field? & ADULT LITERACY We can help you find the and reach top reading educators highly qualified person you with news about your products, are looking for. Contact IRA services, position openings, Advertising Manager, Linda conferences/seminars, etc. Hunter, at 302-731-1600, ext. at a very reasonable cost. 261 or lhunter@reading.org. CALL NOW: We offer special discounted Linda Hunter, Advertising Manager rates for position opening ads. (302) 731-1600, ext. 261 FAX 302-369-8476 01-128 A&M 11/01 98-27 A&M 6/00 564 The Reading Teacher Vol. 56, No. 6 March 2003