seminarios bibliometricos 2017 · +2.500 nuevos títulos en diciembre 2017 y posible ampliación...

SEMINARIOS BIBLIOMETRICOS 2017

La Bibliometria su historia, su buen uso, su futuro

Sebastien Vellay, Country Manager Miguel Garcia, Solution Specialist Rachel Mangan, Training Manager

Historia

Bibliometrics overview

3

HISTORIA

Source: http://jongose.ninja

4

¿QUE ES LA BIBLIOMETRIA?

5

¿PORQUE UTILIZAR BIBLIOMETRIA?

6

•

•

•

¿PORQUE UTILIZAR BIBLIOMETRIA?

—

¿QUE MIDEN LAS CITAS DE VERDAD?

8

MEJORES PRACTICAS: PEER REVIEW INFORMADA

9

MÉTRICAS DE CITAS SON SOLO UNA PIEZA DEL PUZZLE DE PERFORMANCE DE LA INVESTIGACIÓN. •

•

•

–

–

–

–

–

•–

–

Ejemplos de indicadores bibliometricos

11

NÚMERO DE PUBLICACIONES Y DE CITAS

12

% DOCUMENTOS CITADOS

La porcentaje de documentos que han recibido pelo menos una

cita en un grupo de publicaciones.

Citation Frequency Distribution

41,691 de 123,565

publicaciones nunca han sido citadas (34.5%).

% Documentos citados = 65.5%

13

EL ÍNDICE H

Un investigador tiene un H-index de X, si tiene al menos X

publicaciones que tengan recibido al menos X citas.

• Creado por el físico J. Hirsch en 2005

+ Combina productividad (número de documentos) y impacto número de citas) + Se puede aplicar a cualquier nivel de agregación + Tiene mejores resultados para grandes cantidades de publicaciones de grande impacto LIMITACIONES - Muy dependiente del tiempo - Ignora la edad - No considera diferencias de áreas

14

LIMITES DE H-INDEX

15

CITATION IMPACT (AVERAGE CITATIONS)

Un pilar de las mejores practicas:

NO confiar en un solo indicador pero utilizar una combinación

16

DIFFERENCES IN AVERAGE CITATION RATES

Citation Impact can

vary significantly

across different

disciplines and time

periods.

Cannot be compared

without some form of

normalization to allow

for the differences in

fields and time

17

DIFFERENCES IN AVERAGE CITATION RATES

18 EXAMPLES OF DIFFERENCES IN CITING BEHAVIOUR PER CATEGORIES

19

THE INFLUENCE OF CONTEXT IN METRICS

Research communities have radically different “Citation behaviours” and patterns.

It is therefore essential to contextualize citation metrics

20

JOURNAL RANKING INDICATORS

Some commonly used journal ranking indicators available via the

Journal Citation Reports

- Journal Impact Factor

- 5 year Journal Impact Factor

- Immediacy index

- Eigenfactor score

21

JOURNAL IMPACT FACTOR REFLECTS A JOURNAL’S OVERALL PERFORMANCE

22


To contextualise the Journal Impact Factor, we calculate normalised metrics, based on percentiles distribution of Impact Factors of journals in the same category. QUARTILES ARE MOST COMMONLY USED

23


24

SELF CITATIONS AT JOURNAL LEVEL – REV BRAS FARMACOGN: Regional coverage Expansion

– First Journal Impact Factor in 2009 was 3.462

Journal was suppressed from 2010 & 2011 JCR

26

NORMALIZATION IN PRACTICE

27

IS high or low?

0

25 20

high

0

1000

low

CONTEXT IS EVERYTHING INDICTORS MUST BE PUT INTO CONTEXT TO BE USEFUL: CATEGORY, JOURNAL, PEERS, GLOBAL ‣ NORMALIZED INDICATORS — for relative performance comparisons ‣ PERCENTILES — where does it fall in the range of values? ‣ BENCHMARKS — how does it compare with a group or globally?

NORMALIZATION IN PRACTICE

28

28

Percentile is a value above which a certain proportion of

the observations fall

Percentiles allow the classification of publications

into meaningful citation impact classes

The smaller the percentile number, the higher the

number of citations

Document Type: Article

15/4.31 =3.48

Average of citations received by an article published in 2006 in the Transformations in Business & Economics journal

Indicator of performance of this

Article in the Transformations in

Business & Economics journal:

If>1, performs higher than average

If<1, performs lower than average

World Average = 1

(When actual number of citations =

expexted number of citations)

CONTEXTUALIZACIÓN A NIVEL DE PAPER

29

BIBLIOMETRIC INDICATORS

Journal Ranking Indicators

Performance in field & journal

Scientific Excellence

Productivity

and

Impact

Scientific

Collaborations

• Journal Impact Factor

•Journal Impact Factor

without self citations

•Journal Impact Factor

for 5 years

•Quartile in Category

•Immediacy Index

•Eigenfactor Score

• Cited & Citing

Relations of a Journal

with other Journals

• International

Collaborations

• National

Collaborations

• Industry

Collaborations

•

•Category Normalized

Citation Impact

•Journal Normalized

Citation Impact

•% Documents in 1%

• % Documents in 10%

• Average Percentiles

•Hot Papers

• Highly Cited Papers

• Research Fronts

• Baselines

• # of documents

• # of OA documents

• # of funded documents

• # of citations

•% of Documents cited

•2nd generation citations

•Citation per document

•H-index

•Impact Relative to

Country

•Impact Relative to Area

•Impact Relative to

World

• What can and what should be measured? • What are appropriate measures for the purpose? • Each indicator answers 1 question, not ALL questions.

30

SPECIAL CASES

Negative Citations Arts & Humanities Mutual Citations Multi-authored Papers

o

31

EMERGING SOURCES CITATION INDEX: COVERAGE THROUGHOUT THE WORLD

5200 journals already selected and in WoS 2500 European Journals 40% in Social Sciences

34% of ESCI journals are Open Access

+2.500 nuevos títulos en Diciembre 2017 y posible ampliación con 10 años de archivos

32

Productivity

And Impact Normalization Top Performance

Scientific

Collaborations

Web of Science

Documents

Times Cited

Citation Impact

% of documents cited

H Index

Average percentile

Category Normalized

Citation Impact

Category Expected

Citations

Hot Papers

Journal Normalized

Citation Impact

Journal Expected

Citations

% Documents in Top

1%

% Documents in Top

10%

Highly Cited Papers

% Industry

Collaborations

% International

Collaborations

Journal Ranking Indicators

Journal Impact Factor

Impact Factor w/o

Self Cites

5 year Impact Factor

Immediacy Index

Eigenfactor

Collaborations with

Organizations

Collaborations with

Countries

Collaborations with

Authors

• What can and what should be measured?

• What are appropriate measures for the purpose?

RESPONSIBLE USE OF BIBLIOMETRIC INDICATORS: A BASKET OF INDICATORS. NO MAGIC RECIPE FITS ALL

33

-Bibliometrics are not evaluative by nature – however they are used as a Science Policy tool.

Currently, a lack of systematic:

•Bibliometrics education & training for research management & research evaluation

•Training programs focused more on academic objectives

•Development of problem-solving skills based on standardized techniques

•Professionalization of Bibliometrics science for librarians, archivists, professionals

“It is a matter of common knowledge that

there is a lack of bibliometric expertise

and education on the one hand, and an

increasing demand on the other” –

J. Gorraiz, 2011”

RESPONSIBLE USE OF BIBLIOMETRIC INDICATORS: BRIDGING THE GAP BETWEEN THEORY AND PRACTICE

34

And, above all, present the results openly and honestly

David Pendlebury (2008): “Using Bibliometrics in Evaluating Research”

Ten Rules in Using Publication and Citation Analysis

1. Consider whether available data can address the question

2. Choose publication types, field definitions, and years of data

3. Decide on whole or fractional counting

4. Judge whether data require editing to remove “artifacts”

5. Compare like with like

6. Use relative measures, not just absolute counts

7. Obtain multiple measures

8. Recognize the skewed nature of citation data

9. Confirm that the data collected are relevant to the question

10. Ask whether the results are reasonable


35

http://wokinfo.com/media/mtrp/UsingBibliometricsinEval_WP.pdf


36

CAN I TRUST YOUR DATA?

Statistics are as valid as the data behind them

37

AT THE HEART OF OUR SOLUTIONS: THE WEB OF SCIENCE CORE COLLECTION

Consistent indexing for complete analysis

Cover-to-cover indexing

All author names

All author addresses (affiliations)

Funding Agencies & Grant Numbers (Funding text)

Subject Area Classification

Open Access

38

Journal Publishing Standards

Editorial Content International

Focus Citation Analysis

Does this journal

target an

international

audience or

specifically a

regional audience?

Is international

representation

among authors and

board members at

an appropriate level

for such a journal?

Total citations

Recent citation

activity

Author and editorial

board members’

citations in the

literature

Integration of the

journal into the

literature over time

Peer review

Ethical publishing practices

Meets technical requirements (XML / PDF)

English-language bibliographic information

Timeliness of publication*

* Evaluated after selection

International editorial conventions

Scholarly

community

recommendation

or demonstrated

interest

Will this journal

enrich WoS with

novel content?

How does this

journal compare with

covered journals of

similar scope?

Is this subject

already well

covered?

Green = ESCI Requirements

Black = SCIE/SSCI/AHCI Requirements

WEB OF SCIENCE CORE COLLECTION SELECTION PROCESS

39

>1 Billion cited references

All authors and bibliographic information

All affiliations and addresses

All funding sources (2008) manually

captured

AT THE HEART OF OUR SOLUTIONS: THE WEB OF SCIENCE CORE COLLECTION

40

ANALYSIS SOURCE

CONTINUOUS DISAMBIGUATION EFFORT

41

DIFFERENT LEVELS OF METADATA – OPEN ACCESS JOURNALS

OPEN ACCESS TITLES IN WOS CORE COLLECTION (2,900+ TITLES)

15.8 14.6

12.7

10.4 8.7

7.5 6.1

5.1 3.5

2.4 2.0 1.4

0

2

4

6

8

10

12

14

16

18

2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2004

% of Growth in OA WoS Core Collection publications