Thomson Reuters and its role in supporting and evaluating research

THOMSON REUTERS AND ITS ROLE IN
SUPPORTING AND EVALUATING RESEARCH
REUTERS/Cheryl Ravelo
David Horky
Country Manager – BeNeLux, Central and Eastern Europe
david.horky@thomsonreuters.com

2
AGENDA
I. Thomson Reuters Introduction
II. The Web of Science™ - Discovery starts here
III. The Journal Citation Reports - Choosing wisely where to publish
IV. ResearcherID
V. Bibliometric solutions and services

3
OUR COMPANY
• Thomson Reuters is the world’s leading source of intelligent
information for businesses and professionals
• We combine industry expertise and innovative technology
to deliver critical information to leading decision makers
• We are the world’s most trusted news organization
• We serve professionals in the financial and risk, legal, tax
and accounting, intellectual property and science and
media markets

4
A LOOK AT OUR PROFESSIONAL
BUSINESSES
Tax & Accounting
Financial & Risk
Thomson Reuters Tax & Accounting
is the leading global provider of
integrated tax compliance and
accounting information, software
and services for professionals in
accounting firms, corporations,
law firms and government.
Legal
Thomson Reuters Legal is the leading
provider of critical information, decision
support tools, software and services
to legal, investigation, business and
government professionals around
the world. We offer a broad range
of online services that utilize our
databases of legal, regulatory,
news and business information.
Thomson Reuters Financial & Risk
is the leading provider of regulatory and
operational risk management solutions.
These solutions deliver critical news,
information and analytics, enable
transactions, and bring together
communities that allow trading,
investing, financial and corporate
professionals to connect.
Intellectual Property & Science
Thomson Reuters IP&S is the
leading provider of comprehensive
intellectual property (IP) and
scientific information, decision
support tools, and services that
enable governments, academia,
publishers, corporations and law
firms to discover, develop and
deliver innovations.

5
IP&S SOLUTIONS SUPPORT THE INNOVATION
LIFECYCLE
GOVERNMENT &
ACADEMIA
LIFE
SCIENCES
IP
SOLUTIONS
Helping Our Customers Bring Ideas and Innovations to the World
Reliable content,
analytics and services
that improve Pharma
R&D productivity
World-class solutions
to manage, protect
and capitalize on IP
assets
Research data and
tools to identify,
evaluate and promote
the best research
Strong business: • >$1B revenue • Market leading offerings
Global organization: • 4,000 staff in 26 countries • 15,000 customers, 20M+
users

6
THE STORY OF IP & SCIENCE – THE
INNOVATION LIFECYCLE
- Corporations
- Law Firms
CommercializationApplied R&DBasic Research
DISCOVER DEVELOP DELIVER 
Collaboration Development Exploitation
Connecting the scientific
community to the world’s
best science
Drive more effective and
innovative research and
development
Commercialize and protect
the world’s most valuable
inventions

7
THE INNOVATION LIFE CYCLE
https://www.youtube.com/watch?v=ibfrzjb_fB0

8
SUPPORTING ACADEMIC INSTITUTIONS

11
EUGENE GARFIELD’S “ASSOCIATION OF IDEAS
INDEX”-1955
17
Web of Science is the “web” presentation of journal citation indexes
developed five decades ago by Dr. Eugene Garfield, founder of ISI (now
Thomson Reuters G&A) and an icon in the realm of scholarly information

12
SCIENCE CITATION INDEX® 1964

13
12,000,000+
Patents (per year)
5,000,000+
Conference paper
50,000+
Academic books
10,000+
Science, Social Science
art and Humanistic magazines
400,000+
industrial standards
2,000,000+
chemical structural formula
5,000+
Paper formats
80 million+
Gene Sequences
42,000+
International trademark
applications (per year)
110,000
Conferences
SEARCHING INNOVATION IN A WORLD OF
INFORMATION EXPLOSION
Information≠Knowledge

14
JOURNALS MUST BE SELECTED
papers will be read by a
researcher in a year, on
average
200+
of journals (50,000+) on
average a scientist is capable
of reading in a year.
0.4%
Tenopir C. What Scientists Really Need. In: American Association for the
Advancement of Science Meeting (AAAS). Washington D.C.; 2005.

15
JOURNAL SELECTION PROCESS FOR WEB OF
SCIENCE CORE COLLECTION
Journal
Publishing
Standards
Editorial
Content
International
Diversity
Citation
Analysis
Four Points of Evaluation
Core coverage in Web of Science is not static !

16
FOR DECADES, THOMSON REUTERS HAS
CAREFULLY EVALUATED JOURNALS FOR
POTENTIAL INCLUSION IN THE DATABASE
SELECTIVE……YET COMPREHENSIVE
• “Multidisciplinary” coverage
– enable to analyze the whole context of scientific research
• “Multiyear” coverage
– enable to analyze the history and development of sciences
• “Cover to Cover” policy
– enable to follow the flow of a topic regardless of communication type
• “ALL Authors, ALL Addresses”
– enable to analyze by author name, by institution
• “ALL Cited References”
– enable to perform analyses on literature that is not indexed

17
- Counts of articles = measure research productivity
- Citation metrics = measure research impact
Citations are an indicator of an article’s impact and usefulness
to the worldwide research community; they are the mode by
which peers acknowledge each other’s research.
They are the “coin of the scientific community” – Robert Merton
Citation Basics:
What is a citation?
A journal article receives a citation when another publication
references it in its bibliography

18
2014
Cited
References
1974 1998
2000
1993
2003Times
Cited
Related
Records
2006
2004
1999
2012
1994
2000
2007
CONCEPT OF CITATIONS

19
Europe North
America
Asia
Pacific
Latin
America
Middle
East &
Africa
46.5%
28%
16%
5% 3.5%
MULTI-SOURCE AND MULTIDISCIPLINARY
27,300 Journals
52,000 Books
8.2+ Million conference proceedings
51.8+ Million patents
3.8+ Million Data studies and Data Sets
Journals
Data Citation Index
Web of Science Core Collection
BIOSIS Citation Index
Current Contents Connect
Derwent Innovation Index
Zoological Record
Medline
Regional Citation Indexes
Inspec
Food Science and Technology Abstract
CABI: CAB Abstracts and Global Health
90+ Million unique records
800+ Million Citation links

20
THE WEB OF SCIENCE CORE COLLECTION
• 55M+ records: The largest citation database (800M+
references, back to 1898)
• Multidisciplinary
• Independent and neutral selection of content
• 12,500+ Journals, 12,000+ annual conferences, 50,000
Books (as of 2013)
• High quality/value metadata
• The most trusted citation information source (used by all
major research institutions, governments and international rankings)

21
THE WEB OF SCIENCE CORE COLLECTION
GOOGLE SCHOLAR AGREEMENT
Unique link to and from Google Scholar to allow better full
text retrieval (from the Web of Science), as well as access
to selected quality content (from Google scholar).

22
Confidential - Thomson Reuters - Do Not
ACCESS THE WEB OF SCIENCE FROM YOUR
MOBILE DEVICE
Once you have your profile set up, you
can access the Web of Science:
– From phones and tablets, enter:
m.webofknowledge.com
then search Web of Science, Medline and other
databases to which your institution subscribes to.
– You can search, sort, refine, email, add to EndNote,
see the full text links, citation counts and your search
history
• More details:
http://wokinfo.com/about/mobile/
Web of Science

23
WILDCARD CHARACTERS (TRUNCATION)
Symbol Retrieves Example
* Zero or more characters
hydroxy* = hydroxylase
hydroxydopamine
hydroxyethyl
? One character only
en?oblast = entoblast
endoblast
$ Zero or one character
eight$ = eight
eighth
eighty

24
PROXIMITY OPERATORS
Phrase
Searching
Exact matches for phrases can be found by searching on terms
enclosed in quotation marks. Wildcard characters can be used
inside quotation marks.
“color theory” = color theory
“color* theory” = color theory
colorful theory
Near/ Finds terms in the same field; user specifies proximity. Default is
15 words if user does not specify a number.
color near/5 theory = color theory
theory of color
color plays a role in this theory
theory. In this way, color…
Same Terms must occur within the same sentence. Use in Address field
only.
By default, there is an implied AND connecting terms entered as a phrase.
Searching a phrase retrieves records that contain all searched terms found in the
titles, abstract or key words fields, e.g. color theory = color AND theory

25
SEARCH OPERATORS
All search terms must occur to be retrieved.
TOPIC: aspartame AND cancer
Retrieves documents that contain both aspartame and cancer.
Any one of the search terms must occur to be retrieved. Use
when searching variants and synonyms.
TOPIC: aspartame OR saccharine OR sweetener
Retrieves documents that contain at least one of the terms.
Excludes records that contain a given search term.
TOPIC: aids NOT hearing
Retrieves documents with aids, excluding any which also
contain hearing.

26
TOPIC SEARCH
Search field selections are made
from the pull-down menu
Example: (bird* or avian) and (flu or influenz*)
Add additional fields to your search

27
ADDITIONAL WAYS TO SEARCH
• Author
– For best results, search an author’s last name and truncated first initial
– To reduce noise in search results, combine a name search with the author’s
institution in the address or organization-enhanced field
Ex: flavell r* AND yale university
– Always search on variations for spaced or hyphenated names
Ex: de la cruz f* OR delacruz f*
• Address or Organization-Enhanced
– Use these fields to find papers written by authors in a particular region or
institution
– For best results, consult the Org-Enhanced search aid or list of suggested
address abbreviations
– Use wildcard characters liberally for an address search to pick up name
variations

28
USING TERM INDEXES
Term indexes are available for the
Author, Group Author, Publication
Name, and Organization-Enhanced
fields. Click Select from Index to
navigate to the search aid.

29
USING TERM INDEXES (CONT’D)
Enter part of the term in the search
box or use the alphabetical list to
locate terms.
Click ADD to add terms to the box
below, then click OK to add them to
the main Search page.

30
AUTHOR IDENTIFIERS
www.researcherid.com
Use the Author Identifiers field to
search by ResearcherID number or
ORCID identifier.

31
CITED REFERENCE SEARCH: INTRODUCTION
• Start with a known item (ex: journal article)
‒ “Source” item
• Searching for the item in the cited reference
search panel does NOT retrieve the article record.
It retrieves records for articles that have cited it.
─ Cited References stand in for subject terms
• Allows you to move forward in time, discovering
relationships between published works as
determined by article authors

32
• Explore hidden connections between
research papers
• Find new, unknown information based on
older, known information
• Find variant citations
• Search for citations to non-journal literature
‒ Works of art: fiction, paintings, musical scores
‒ Patents
BENEFITS

33
CITED REFERENCE INDEX
Source Record Entry
Cited Reference Entry

34
This is the bibliography from the
paper on the previous slide.
Each reference is also added as
an entry in the Cited Reference
Index to create a pool of
interconnected citation records.
Entries that have no links are either
incorrect citations, or are citations to
documents that are NOT source
records in the Web of Science™.
Items that are correct
citations to other source
records in the Web of
Science™ are linked to
those records.

35
Becomes:
…and is linked to all versions of the source article in Web of Science™:
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003).
Measuring inconsistency in meta-analyses. British Medical Journal,
327(7414), 557-560. doi: 10.1136/bmj.327.7414.557

36
Results appear as a link in the
search history.
ADVANCED SEARCH

37
ADVANCED SEARCH FIELDS
Tag Definition Example
SU=
Web of Science™ Research Area: broad categories
assigned by Thomson Reuters at the journal level;
unified across all Web of Science™ databases
SU=CHEMISTRY
WC=
Web of Science™ Core Collection Subject
Category: categories assigned at the journal level that
are unique to the Web of Science™ Core Collection;
also used as Journal Citation Reports categories
WC=CHEMISTRY
INORGANIC NUCLEAR
IS= ISBN or ISSN
IS=0197-5897
IS=9780230307186
UT=
Accession number: a unique identifying number
associated with each record
UT=WOS:000297310900004
UT=000297310900004
The following fields are available from the Advanced Search panel only:

38
SEARCH RESULTS
Use the “Sort by” drop-down menu
to change the order of results.
Your search statement
and total number of results
appears at the top of the page.
Click an article title to
move to a full record

39
Click Cited References to
view this article’s
bibliography, or list of items
cited by this article.
Links to other Thomson Reuters products,
such as Journal Citation Reports or
Essential Science Indicators are displayed
along the top.

40
Remember: Some references
may not be linked because they
are not covered in the Web of
Science™, or may be a citation
variant.
Click the title link to move to the full
record.

41
To find other articles in the
Web of Science™ Core
Collection that have cited
resources also cited by this
article, click the View Related
Records link in the full record.

42
By doing a Related Records search, you
have retrieved more records about your
topic without having to add additional
specific vocabulary to your query.
Related Records results are sorted so
that those records that share the most
references in common with the “parent”
record are listed at the top of your
search results. You may click on the
linked number to view those shared
references.

43
• See the full citation picture with citation data
reported from:
– Biosis Citation Index
– Chinese Science Citation Database
– Data Citation Index
– SciELO Citation Index
– Web of Science™ Core Collection
• Article citation counts include cites from all five
sources regardless of your subscription package
– Links to view the citing articles are dependent upon your
subscription access
TIMES CITED CITATION COUNTS

44
Times Cited counts will change
as more items that cite this
article are added
to the Web of Science™.
Click the All Databases Times Cited
number in the Citation Network to view
items from all citation indexes in the Web
of Science™ that have cited this article.
The most recent citation is displayed
below.
Click the Times Cited link in the full
record to view items in the Web of
Science™ Core Collection that have
cited this article.

45
These articles have cited
the Claas article on the
H5N1 virus.

46
Click the Citation Map link to create
a graphical representation of citation
activity for this article.Select a direction to create a map of the
article’s Cited References, Citing Articles,
or both. Choose 1 or 2 citation
generations, then click the Create Map
button.

47
Use the Appearance menu to
order and color-code nodes by
country, institution or journal title.
When you have
finished creating your
map, download it as an
image under the
Manage menu.
CITATION MAP

48
Click the Analyze Results button on the
Search Results Summary page to rank
your search results by fields such as
Institution Name, Author, Publication
Year, Country/Territory and Web of
Science Category.
Refine results by Organization, Author,
Publication Year, Country/Territory,
Funding Agency, Document Type and
more. You can refine any results set,
including Times Cited and Related
Records Results.
Clicking the more options /
values… link will display up to
100 items sorted by record count.

49
After marking items on the list, choosing
Refine will limit results to your selections.
Choosing Exclude will eliminate your
selections from the result set.
The drop-down
menu allows you
to sort results
alphabetically.
Click Analyze Results to
group and rank records in
this set.

50
Select a field by
which to rank
your results, set
display and sort
options, then
click Analyze.
Results will display in ranked order. To view
results, mark off the desired result sets, and
click View Records. Clicking Exclude
Records will display all other results in the
set.
Save analysis data
to a text file that can
be imported into a
spreadsheet.

51
You can create a Citation Report for
any results set, including the Marked
List.
CITATION REPORT

52
The report automatically generates two
graphs, and calculates basic statistics
about articles in your set, including h-
index and average citations per item.
Articles are sorted by Times Cited
count by default. Use the pull-down
menu to change the sort order, and
the arrow buttons to view how many
citations each article received per
year.
Use the drop-down menu to
save the report directly into an
Excel spreadsheet. You can
export up to 500 records at a
time.

53
SEARCH HISTORY
Search statements are maintained in a
search history. You can combine sets using
Boolean operators from the Advanced Search
page.

54
SAVING SEARCH HISTORIES
From the Search History or
Advanced Search page, click Save
History to save your search history.
If you choose to create an alert, note
that only results matching the final
query will be sent to your e-mail
address.

55
You may set up a citation alert to track
new citations to a particular paper. You
must register on Web of Science™ or sign
in with your email address and password
to take advantage of this feature.

56
You will receive a confirmation that the alert
was created. When new citing articles are
added to Web of Science™ Core Collection,
you will receive an e-mail notification.
The alert information displays in the Citation
Alerts section of the Saved Searches and
Alerts page when you are signed in. Your
alerts, which expire after one year, may be
renewed from this page

II. THE JOURNAL
CITATION REPORTS

58
Publish or perish:
Choose wisely WHERE to publish

59
THE JOURNAL CITATION REPORTS (JCR)
The JCR is a trusted source of journal metrics used by all
major publishers, research institutions and research
funders globally used for:
– Journal competitor analysis and benchmarking
– Library collection development
– Manuscript submission decisions
– Scientometric research

60
THE WORLD WELL-KNOWN JOURNAL IMPACT
FACTOR
2011 2012 2013
IF2013 =
times cited in 2013
total publications in 2011 and 2012

61
THREE SCENARIOS FOR PUBLICATION
STRATEGY
min
max
25%
25%
25%
25%
median
Q1
Q2
Q3
Q4
Moderate
Approach
Conservative
Approach
Ambitious
Approach
ImpactFactor

62
THE VALUE THE JOURNAL CITATION
REPORTS :
DEEPER JOURNAL ANALYTICS
• Easy to analyze across
editions and years
• Drill down to the article
level for transparent source
information
• Visualize data in an
unmatched way for analysis
of citation relationships
(networks, journal side-by-
side comparison)
•Easy to create, save, and
export reports
• Expanded indicators,
trend analyses and access
to historical data

63
INCITES JOURNAL CITATION REPORTS
INTEGRATED WITH THE WEB OF SCIENCE
63
Access Journal Citation
Reports from anywhere
View summary journal
information within the Web
of Science interface

64
The Compare Journals feature enables the instant comparisons
of selected journals. It can be useful for look at Trends to identify
the trajectory of journal performance

66
RESEARCHER ID
• www.researcherid.com
• Online registry for creating a unique researcher ID
number
• Build a publication list identifying your work
• Make your profile public or private
– Public profiles can be searched and viewed by others
• Generate citation metrics including:
• H-index
• Citation distribution per year
• Total Times Cited count
• Average Times Cited

68
RESEARCHERID-ORCID INTEGRATION

71
WHAT IS ORCID?
Feature ResearcherID ORCID
Persistent ID Yes Yes
User profile Yes Yes
Publication
List
Yes Yes
Citation
metrics
Yes No
User privacy
controls
Yes Yes
Curator
Link www.researcherid.com/ https://orcid.org

72
Search the Web of Science with
ResearcherID or ORCID numbers

73
RESEARCHERID LABS
• Every member of ResearcherID has a Labs page.
• Availability of features is dependent on a
researcher's privacy settings and on whether their
publication list contains records added from Web of
Science.
• Chart and map additional data on each member's
collaborators and on those papers citing a
researcher’s works.
• Incorporate a ResearcherID "badge" into your own
Web page or blog.

77
RESEARCHER ID BADGE
http://www.nil.wustl.edu/labs/kevin/kevin.htm

IV. BIBLIOMETRIC SEVICES
AND SOLUTIONS

81
APPLICATIONS OF BIBLIOMETRIC ANALYSIS
1. Quantification:
• Data reduction (extracting essential information)
• Data cleaning and data disambiguation
Data
•Web of Science
Thomson Reuters
Expertise &
Processing
• Address unification
• Data cleansing &
standardization
• Normalization &
baselines
InCites
• For more than four decades Thomson Reuters has provided a wide
range of tools and services supporting research evaluation.
• Our specialist work with Web of Science data and ensure maximum
standardization and unification before delivery to customers.
• Not just simple counts and averages, but real metrics founded on
baselines for comparison and normalized statistics.

82
2. Measuring:
• What can and what should be measured?
• What are appropriate measures for the purpose?
Top Performance
and
Scientific Excellence
Normalization
Productivity
and
Impact
Scientific
Collaborations
• Hot Papers
• Highly Cited Papers
• ESI Most Cited
• THE Ranked
• % Documents in 1%
• % Documents in 10%
• Average Percentiles
• Average Quartiles
• Research Fronts
• Co-citations
•Bibliographic Coupling
• Baselines
• International
Collaborations
• % International
Collaborations
• % Industry
Collaborations
• Normalized Citation
Impact
• Normalized Citation
Impact – Country
Adjusted
•Journal Normalized
Citation Impact
• Fractional Counting
• % Open Access
• Grants
•Self-Citations
• Patents
• h-index
• Citation Impact
•Impact Relative to
Country
•Impact Relative to Area
•Impact Relative to
World

83
3. Benchmarking
• Comparison (like with like)
• Putting data into context
• Consider limitations

84
4. Presentation and interpretation
• Visualizations + interpretation of observations
• Linking bibliometric indicators to results of other methods

87
NATIONAL COMPARISONS – MONITOR YOUR
PRODUCTIVITY
Need to consider the publication
practices and fields of research;
Do we follow a dominant
“quantitative publication”
strategy or are we more
selective in what and where we
publish?

88
INCITES - COUNTRY COMPARISON AND
NORMALIZED CITATION IMPACT
Red Line indicates
the World Average
Impact
Impact shows a constant upward
trend, which is a good indication
of improved research
performance

89
• International research collaboration has intensified and is often
regarded as an indicator of quality and a way to develop and
disseminate scientific knowledge
• Funding agencies such as the EC stimulate collaboration within the
European Union by applying it as a funding criterion
What is the return on international collaboration?
InCites – Monitor your International Collaboration

90
HOW MUCH CZECH REPUBLIC IS
COLLABORATING INTERNATIONALLY?
International
collaborations are
considered to be
drivers of impact
(citations)
International
collaborations
require considerable
effort and funding

91
International Collaborations - Countries
With which countries
Czech Republic has
produced most
Highly Cited Papers?
With which countries
Czech Republic has
produced most
collaborations
(#of documents)?

92
International Collaborations - Institutions
With which institutions
Czech Republic has
produced most
collaborations
(#of documents)?
With which institutions
Czech Republic has
produced the most
successful
collaborations (NCI)?

93
INDUSTRY COLLABORATIONS – IMPACT OF
PUBLICATIONS
How impactful are
Czech Republic
publications in
collaboration with the
industry?

94
IN WHICH DISCIPLINES ARE CZECH REPUBLIC
RESEARCHERS MOST ACTIVE?

95
HOW MUCH CZECH REPUBLIC RESEARCHERS
COLLABORATE IN THE DISCIPLINES THEY
ARE MOST ACTIVE?

96
Assess your journal strategy in all disciplines with
journal ranking indicators
Identify in which journals
you publish the most

97
INSTITUTIONAL COMPARISONS – MONITOR
YOUR PRODUCTIVITY
How do selected
Czech Republic
institutions rank
in terms of
research
output?

98
INSTITUTIONAL COMPARISONS –NORMALIZED
CITATION IMPACT FOR 2008-2012
How does your
institution compare
with the National
Country Average ?
How do
selected Czech
Republic
institutions rank
in terms of
performance in
the fields they
publish (NCI)?
At any time you can drill
down to article level
metrics analysis

99
THOMSON REUTERS CUSTOM ANALYTICS
99
Global Research Reports: http://researchanalytics.thomsonreuters.com/grr/
Research Performance Reports: http://www.evidence.co.uk/index.php?page=47
Research Analytics: http://researchanalytics.thomsonreuters.com/

100
10

101
10

102
10

103
10

104
ADDITIONAL RESOURCES:
• Customer Technical Support:
http://ip-science.thomsonreuters.com/techsupport/
• To view additional recorded training, visit our website:
http://thomsonreuters.com/products_services/science/training/
• If you have questions, contact the training team:
http://science.thomsonreuters.com/info/contacttraining/

THANK YOU
REUTERS/Cheryl Ravelo
David Horky
Country Manager – BeNeLux, Central and Eastern Europe
david.horky@thomsonreuters.com

Thomson Reuters and its role in supporting and evaluating research

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (6)

Similaire à Thomson Reuters and its role in supporting and evaluating research

Similaire à Thomson Reuters and its role in supporting and evaluating research (20)

Plus de KnihovnaUTB

Plus de KnihovnaUTB (20)

Dernier

Dernier (20)

Thomson Reuters and its role in supporting and evaluating research