This curriculum vitae summarizes the qualifications of Susan S. Kirschenbaum. She received her PhD in Experimental Psychology from the University of Rhode Island in 1985. Her professional work experience includes over 30 years as a cognitive scientist and engineering psychologist at the Naval Undersea Warfare Center Division Newport. She has extensive experience conducting research on decision making, expertise, training, and human systems integration. She has authored numerous publications in these areas and received several awards for her independent research contributions.

1. Curriculum Vitae
Susan S. Kirschenbaum
Permanent Address: Office Address:
1783 South Road Naval Undersea Warfare Center,Division Newport
Kingston, Rhode Island 02881 1176 Howell St
Building 1171/1, Code 2532
Newport, RI 02841
Phone: (401) 789-0984 Office: (401) 832-3835
Cell: (401) 742-3558 E-Mail: susan.kirschenbaum@navy.mil
Education:
University of Rhode Island Ph.D.,1985
Kingston, RI 02881 Experimental Psychology
Dissertation: Acquisition of self-efficacy expectations as a function of task difficulty, experience, and
social comparison information. Albert Silverstein, Major Professor.
University of Rhode Island M.A.,1983
Kingston, RI 02881 Experimental Psychology
Thesis: Learned self-competence as a function of response contingency of success for first graders.
Albert Silverstein, Major Professor.
University of Rhode Island M.A.,1975
Kingston, RI 02881 Reading Education
George Washington University B.A.,1965
Washington, D.C. Elementary Education
References:
Mr. William Glenney
Deputy Director
CNO Strategic Studies Group
686 Cushing Road
Simms Hall East
Newport, RI 02881
glenneyw@usnwc.edu
(860) 912-0003
Mr. Nickolas Guertin,
DASN RDT&E
Prototyping Experimentation and Transition
1000 Navy Pentagon
4C689
Washington, DC 20050
nickolas.h.guertin@navy.mil
(703) 697-6850
Dr. Yvonne Masakowski

2. College of Operational & Strategic Leadership (COSL)
686 Cushing Road
Newport, Rhode Island 02841-1207
Yvonne.Masakowski@usnwc.edu
(401) 841-6411
Professional Work Experience:
Security Clearance: TOP SECRET
Cognitive Scientist 2014-October, 2016
Combat Systems Department,NUWC
Responsible for developing and executing research into the cognition of submarine decision making
and the effects of Human Systems Integration (HSI) decisions on system . Lead for Open Systems
Architecture Training Working Group under DASN (RTD&E). TechnicalPoint of Contact (TPOC)
for Small Business Innovative Research (SBIR) projects. HSI Lead and mentor at NUWC. Lead for
Workforce Development project to investigate requirements for SSN(X) control room and manning.
Method is decision-maker centered scenario driven gaming-like process to extract ideas from
experienced commanders. Periodically teach an in-house course for scientists and engineers on
Human Systems Integration/Human Factors.
Technology Fellow 2012-2014
Chief of Naval Operations Strategic Studies Group (CNO SSG)
Responsibilities include participating in and leading teams during all phases of the SSG process of
innovation. Organized a program of speakers including internationally recognized experts in
numerous fields. Planned and led site visits at major innovation centers across the country. Played
leadership role in concept teams investigating the role and innovations for personnel, logistics, and
command leadership. Developed and researched innovative concepts for “Own the Undersea” (SSG
XXXII) and “Expeditionary Operations” (SSG XXXIII) in response to CNO tasking.
Engineering Psychologist, 1985-2012
Combat Systems Department
Naval Undersea Warfare Center Division Newport
Investigate the relationship between human cognitive performance and operability in
submarine command and control. Emphasis is on information requirements to support
decision making. Major research interests are in how computer-presented information
supports decision making and problem solving; individual differences, especially expertise;
training for accelerated expertise, and in computational cognitive modeling.
Served as Visiting Scientist at:
 The Human-Computer-Interaction Lab, Naval Research Laboratory, Washington, DC
 Cognitive and Neural Sciences Division of the Office of Naval Research, Arlington, VA;
 Swinburne Computer-Human Interaction Laboratory (SCHIL), School of Information
Technology, Swinburne University, Melbourne, Australia
 Naval Sea Systems Command 05H

3. Other assignments:
 Lead, Human Systems Integration (HSI) for NUWCDIVNPT.
 Mentor for New Professionals in Human Factors and HSI professionals
 Conference Chair of the Undersea Human Systems Integration Symposium 2004 held in
Newport RI and 2006 Symposium held in Mystic, CT
US representative to The Technical Cooperation Panel’s (TTCP) HUM Group, Submarine
Panel where, in cooperation with other US, UK, Canadian, Australian, and New Zealand
representatives we investigated issues relevant to humans in submarines. The results were
reported in reports and technical exchanges in the participating countries.
Select Research Projects:
Mentor Investigator for The Cognition ofExpertise investigation the elements of expertise for Fire
Control Technicians and officers, including Perspective Commanding Officers. This work has
implications for training and system design. Funded by NUWC.
Principal Investigator for Voice Interactive Intelligent Tutoring Systems (ITS) for Shiphandling
that investigated interactive intelligent spoken tutoring. Work performed in collaboration with
Stanford University and funded by Office of Naval Research,Dr. Perez,Sponsor. The
Shiphandling ITS is being procured by the Surface Warfare Officers School.
Principal Investigator for Representing Uncertainty in Complex Domains that tested the
Representation Match Hypothesis for the understanding of uncertainty representations. Funded by
Office of Naval Research,Dr. Schmidt-Nielson, Sponsor.
Principal Investigator for Environmental Visualization that is working to improve decision aids
and visualization systems for Navy Meteorologists. This work was augmented by a replication
and extension study with the Royal Australian Navy forecasters. Funding provided by the Office
of Naval Research,under the KSA FNC.
Lead for Analysis Team studying the placement of equipment, manning, use of specific
technologies, etc. in the Virginia Control Room as part of the series of Concept of Operations
Experiments (CoopExs). Directed the collection and analysis of data pertaining to space,
crowding, manning, usage, noise, distractions, information flow, and visibility under various
conditions and scenarios..
Awards:
Fellow of the American Psychological Association
Fellow of Division 21, Applied Experimental and Engineering Psychologists
1996 NUWC Special Achievement Award for Independent Research
Research Affiliate, Human-Computer Interaction Lab (at NavalResearch Laboratory)
Sigma Xi National Research Honor Society
Professional affiliations:
Adjunct Professor,Department of Psychology, University of Rhode Island
American Psychological Association
and Division 21, Applied Experimental and Engineering Psychologists
Human Factors and Ergonomics Society

4. Cognitive Science Society
Service to the profession:
Conference Chair of Undersea Human-Systems Integration Symposium, 2004 and 2006
Editor, Newsletter for Division 21 of APA,Applied Experimental and Engineering Psychologists
Member at large, Executive Committee of APA Division 21, Applied Experimental and
Engineering Psychologists
Representative to Governing Council of APA from Division 21, 1992-1993
Chair of the Program Committee for the 1992 Convention, of APA Division 21
Applied Experimental and Engineering Psychologists
Chair and organizer of technical sessions, workshops, and symposia at Human Factors and
Ergonomics Society, SIGCHI, IEEE International Conference on Systems, Man, and
Cybernetics, and other conferences
Co-Organizer of Scaled Worlds ’99
Representative Presentations and publications:
Papers:
Kirschenbaum, S. S., Trafton, J. G., Schunn, C. D., and Trickett, S. B. (2014). Visualizing
Uncertainty: The Impact on Performance. Human Factors, 56(3), 509-520.
Kirschenbaum, S. S. (July, 2002). Lessons learned and mis-conceptions: Eighteen years of submarine
decision research. The Submarine Review. 44-50.
Trafton, J.G., Kirschenbaum, S. S., Tsui, T. L., Miyamoto, R. T., Ballas, J. A., and Raymond, P.
D. (2000). Turning Pictures into Numbers: Use of Complex Visualizations. International
Journal of Human Computer Studies, Special issue on "Empirical Evaluations of Information
Visualizations." 53(5), 827-850.
Ehret, B. D., Gray, W. D., & Kirschenbaum, S. S. (2000). Contending with complexity:
Developing and using a scaled world in applied cognitive research. Human Factors, 42(1), 8-
23.
Mahan, R. P., Kirschenbaum, S. S., Jilg, J. M., and Marino, C. (1998). Supporting diagnostic
judgment during delayed-feedback decision making through reliability feedforward
techniques. International Journal of Cognitive Ergonomics, 2(3), 217-242.
Kirschenbaum, S. S. and Arruda, J. (1994). The effects of graphic and verbal probability
information on command decision making. Human Factors, 36(3), 406-418.
Kirschenbaum, S. S. (1992). The effect of level of experience on information gathering
strategies. Journal of Applied Psychology, 77, 343-352.
Invited Talks:
Kirschenbaum, S.S., Wong, J.H.,& Peters, S. (Sept, 2010). Tutoring Ship Handling Skills: Intelligent
Tutor and Expert Model. Invited paper presented at the Human Factorsand Ergonomics Conference,
San Francisco, CA.
Kirschenbaum, S. S. (October, 2002). Uncertainty and automation. Invited talk at the NATO
Research and Technology Organization (Aerospace Medical Panel) Symposium on the role
of humans in intelligent and automated systems, Warsaw, Poland.
Kirschenbaum, S. S. (June, 2001). Decisions Under Conditions of Uncertainty. Invited talk given
at the Decision Making in the 21st Century: Multi-national Issues in Team Training and
Performance Workshop, THALES Château des Mesnuls, Paris, France

5. Kirschenbaum, S. S. (October, 1999). How the Expert Decision Maker Manages Information.
Invited talk given at The Technical Cooperation Program, Maritime Systems Group
Technical Panel One (Data Integration for Maritime Systems) 6th Specialists’ Meeting,
Newport, RI.
Kirschenbaum, S. S. (April, 1998). Evaluating Concepts of Operation for Team / System
Collaboration. Invited talk at the NATO Research and Technology Organization (Aerospace
Medical Panel) sponsored International Conference on Collaborative Crew Performance in
Complex Operational Systems, Edinburgh, Scotland.
Kirschenbaum, S. S., and Gray, W. D., (March, 1997). Decision Maker Schema and Subgoals in
a Simulated Submarine. Invited talk at Midyear Science Symposium of Division 21 of APA.
Kirschenbaum, S. S. (1992, August). The paradox of decision making experience and technology
expertise. (Paper presented at the 5th Annual Group Processes Conference, Pittsburgh, PA).
Gray, W. D., and Kirschenbaum, S. K. (August 1995). Cognitive Models of Situation
Assessment. Invited talk presented at the ONR Common Tactical Picture meeting. Arlington,
VA.
Books and Chapters:
Militello, L., Wong, W., Kirschenbaum, S.S., & Patterson, E. (2010). Systematizing Discovery
in Cognitive Task Analysis. In K. L. Mosier & U. M. Fischer (eds.) Informed by Knowledge:
Expert Performance in Complex Situations. (Chapter 18, pp. 295-312). New York:
Psychology Press.
Kirschenbaum, S. S. (2010). Expertise in the submarine domain: The impact of explicit display
on the interpretation of uncertainty. In K. L. Mosier & U. M. Fischer (eds.) Informed by
Knowledge: Expert Performance in Complex Situations. (Chapter 12, pp. 189-200). New
York: Psychology Press.
Kirschenbaum, S. S., McInnis, S. & Correl, K. P. (2009). Contrasting Submarine Specialty
Training: Sonar and Fire Control . In K. Anders Ericsson (Ed) The Development of
Professional Performance: Approaches to Objective Measurement and Design of Optimal
Learning Environments (Chapter 14). New York: Cambridge University Press.
Kirschenbaum, S.S., Trafton, J.G. & Pratt, E.A.(2007). Comparative Cognitive Task Analysis. In
Gray, W. D., & Kirschenbaum, S. S. (2000). Analyzing a novel expertise: An unmarked road. In
J. M. C. Schraagen & S. F. Chipman & V. L. Shalin (Eds.), Cognitive task analysis (pp. 275-
290). Mahwah, NJ: Erlbaum.
Peer Reviewed Conferences and Proceedings:
Kirschenbaum, S.S., Wong, J.H., & Peters, S. (2010). Tutoring Ship Handling Skills:Intelligent
Tutor and Expert Model in a Simulation. Paper presented at 2010 Human Factors and
Ergonomics Conference (San Francisco, CA).
Kirschenbaum, S.S., Trafton, J.G., Tricket, S. B. & Schunn, C.D. (2006). Impact Of Uncertainty
Representation On Decision Making, In Proceedings of the 47th Annual Meeting of the
Psychonomic Society. Houston,TX.
Kirschenbaum, S. S. (2004). The Role Of Comparison in Weather Forecasting: Evidence From
Two Hemispheres! In Proceedings of the Human Factors and Ergonomics Society 48th
Annual Meeting. Santa Monica, CA: Human Factors and Ergonomics Society
Kirschenbaum, S. S. (2002). Visualizing Uncertain Information. In The Cognition of Complex
Visualizations Symposium, J. G. Trafton (Chair). In W. D. Gray & C. D. Schunn (Eds.),

6. Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society (p.
18). Mahwah, NJ: Erlbaum.
Sodhi, M., Reimer, B., Cohen, J.L.,Vastenburg, E., Kaars,R. and Kirschenbaum, S. (2002). On-road
driver eye movement tracking using head-mounted devices. In Proceedings of the 2002 symposium
on Eye tracking research & applications, ACM,New Orleans, Louisiana, 2002.
Kirschenbaum, S. S. (2000). Integrating Information From Multiple Sources: Expert Decision
Making Procedures. In RTO Meeting Proceedings: Usability Of Information In Battle
Management Operations. (chapter 15). Neuilly-Sur-Sein Cedex, France: NATO Research and
Technology Organization.
Technical Reports:
Kirschenbaum, S. S. (25 Jan, 2002). Royal Australian Navy Meteorology and Oceanography
Operations Research Report. NUWC-NPT Technical Report 11,346. Newport, RI: Naval
Undersea Warfare Center Division Newport.
Kirschenbaum, S. S., Gray, W. D., and Ehret, B. D. (1997). Subgoaling and Subschemas for
Submariners: Cognitive Models of Situation Assessment. NUWC-NPTTechnical Report
10,764-1/GMU-HFAC Technical Report: 97-02-25.
Kirschenbaum, S. S. (April 1994). Command Decision-Making: A Simulation Study. NUWC-
NPT Technical Report 10,350. Newport, RI: Naval Undersea Warfare Center Division
Newport.