RefResh 2018

1st Workshop on Reframing Research (@ EuroCSS symposium)
5 Dec. 2018, Cologne, Germany

Over the last decade, research has been scaling up in terms of publications, authors, contributing institutions and funded projects. Nowadays, research literature is estimated to round up 100-150 million publications with an annual increase rate around 1.5 million new publications. The fourth paradigm shift of science on one side, and the ever-increasing availability of data about research drivers and outcomes on the other have enabled scientists and researchers to "place the practice of science itself under the microscope" and dissect and analyse it in unprecedented ways.

For these reasons, it is of paramount importance to study such an articulated, global-scale, evolving system in order to understand its dynamics, patterns, internal equilibria and interactions among the diverse scientific actors. In particular, recent studies have proved that a holistic study of research as a complex phenomenon inserted in a delicate socioeconomic and geopolitical context, rather than as an isolated, context-unaware system, can provide a deeper insight on how research and researchers influence and are influenced by world outside academia. Such an analysis can provide answers to socioeconomic questions, frame academic research on a geopolitical canvas, provide insights on the factors that generate successful science, allocate better resources and therefore benefit of greater impact and efficacy.

Workshop Goals

The main objective of the proposed workshop is to bring together researchers from both quantitative and qualitative studies, practitioners and policy makers working in the field of academic research, scholarly communication and knowledge production in order to reframe research in relation to the underlying socioeconomic and geopolitical canvas.

In particular, we intend to encourage interdisciplinary analysis that considers research as a complex system that influences and is influenced by society, economics, culture, and politics. This would include analysis of academic social networks and interactions among different communities, exploration of factors influencing or preventing scientific collaboration and knowledge dissemination, exploration of trends, polarisations and biases in research, methodologies, indicators and measures for assessing research impact on society and industry, policies and practices fostering a better scientific progress and so on.


  • Analysis of patterns and trends in academia
  • Research equality, fair opportunities and access to funding streams
  • Gender, racial and geographic trends and biases
  • Mutual influence of research and politics
  • Societal impact of research
  • Analysis of researchers mobility and careers
  • Predatory publishing and bogus conferences
  • Misrepresentation of science and public opinion mining
  • Acceleration of scientific progress
  • Structure and evolution of science
  • Evolution and diffusion of research concepts across research areas
  • x.metrics (scientometrics, informetrics and altmetrics)
  • Assessment of interdisciplinarity
  • Impact of Open Access and Open Science
  • Policy making and strategic decision for research
  • Traditional publishing caveat, critiques and alternative models
  • Novel peer review practices

Call for Extended Abstracts

Important dates

7 October 2018 14 October 2018 (23.59 Hawaii Standard Time): Extendend abstracts submission
21 October 2018 29 October 2018: Notification (Registration details available here)

Submission guidelines

RefResh 2018 looks for extended abstracts around the listed topics summarising the work to be presented.
We encourage researchers to also submit abstracts of work that has already been published and/or submit work in progress.
Submissions have to be up to 3 pages (in English) excluding references and pictures in Springer LNCS format.
Extended abstracts should be submitted as pdf files through EasyChair conference management system here.

The submissions will be evaluated according to their significance, originality, technical content, style, clarity, and relevance to the workshop.
Please give a sufficiently detailed description of your work and your methods so we can adequately assess its relevance.
Please consider that reviewers will be from an interdisciplinary community.
RefResh also supports the Linked Research principles; we applaud authors having care to consider them when preparing their papers.

It is our intention to publish, if possible, the workshop proceedings in CEUR workshop series or, in alternative, as Open Access post-print on Zenodo.

For any other question, feel free to contact us at


RefResh 2018 is a co-located event of the 2nd European Computation Social Science Symposium (EuroCSS), 5-7 Dec. 2018, Cologne, Germany.
The workshop will take place on the 5th of December. Authors are required to register via Eventbrite here!

Pre-symposium registration

Venue: Cologne Marriott Hotel (Johannisstrasse 76-80, 50668 Cologne, Germany)
The pre-symposium day venue is not the same as the main symposium venue.

Introduction + Keynote

Title: "Responsible Social Computing: Validating Network Data and Theory"
Speaker: Prof. Jana Diesner

Responsible Social Computing: Validating Network Data and Theory Social Computing combines the benefits of using large-scale data with the consideration of societal implications and ethical concerns. I exemplify possible biases in social network data and theories by presenting on my group’s research on two questions about interaction-based and information-based systems: How do limitations related to the provenance and quality of data impact scientific results? I present on the impact of commonly used techniques for name disambiguation on the properties and dynamics of communication and collaboration networks, and highlight measurement-induced biases in metrics and theories about social interactions. I also present our work on assessing the reliability of common methods for extracting network data from text data. Once we have reliable data, how can we use text mining to enrich network data to validate classic social science theories in contemporary settings? I provide an example where we applied domain-adjusted sentiment analysis to label edges in an over-time communication network to test structural balance theory. I also report on our work on validating triadic closure. The work presented in this talk contributes to the discovery of patterns of interactions between agents and information, making sense of qualitative, distributed, and multi-modal data in a scalable way, and advancing the transparency, accountability, fairness, and ethics of computing and technology.

Session 1

10:30 - 10:50 "How Communities Mediate the Diffusion of Science: The Case of Granovetter’s Weak Ties Hypothesis"
Anna Keuchenius, Petter Törnberg and Justus Uitermark

10:50 - 11:10 "Predicting Research Trends From Arxiv"
Steffen Eger, Fitz Chao, Florian Netzer and Iryna Gurevych

11:10 - 11:30 "Mining Citation Networks to Detect and Analyze Cliques and Cartel-Like Patterns"
Joseph Davis

Coffee break

Session 2

12:00 - 12:20 "Linguistic discrimination in scientometrics"
Luc Boruta

12:20 - 12:40 "Academic performance of students in a transdisciplinary bachelor's degree"
María Fernanda Papa, María Valeria De Castro, Pablo Becker, Esperanza Marcos Martinez and Luis Olsina

12:40 - 13:00 "Influence of structural determinants on performance and survival: case of Russian universities"
Angelika Tsivinskaya


Please be reminded that the registration does not include the costs for lunch on pre-symposium day – lunch at own expenses will be available at Marriott Hotel, and you can also find a lot of choices for lunch near the hotel.

Session 3

14:30 - 14:50 "Reputation or peer review? The role of outliers"
Francisco Grimaldo, Mario Paolucci and Jordi Sabater Mir

14:50 - 15:10 "Peer-reviews on the blockchain"
Zeeshan Jan, Allan Third, Michelle Bachler and John Domingue

15:10 - 15:30 "Mapping gender in the transforming research life cycle"
Vilte Banelytė, Vilius Stančiauskas, Vitalis Nakrošis and Edit Görögh

Poster talks

15:30 - 15:45 "A Socio-computational Examination of Gender Bias in Science"
Brett Buttliere, Seren Yenikent and Kseniia Zviagintseva

15:45 - 16:00 "Gender Bias in Academic Publishing: Assessing the Gender Gap in Computational Social Science"
Lisa Hehnke

Coffee break

Interactive session

Waiting together for...

The 1st #EuroCSS Science Slam! A fun event with interesting science talks; it will take place in Die Wohngemeinschaft from 20:00.
Check info on the main symposium website.

Workshop organisation

Workshop Chairs

  • Andrea Mannocci (Knowledge Media Institute, Open University, Milton Keynes, UK)
  • Francesco Osborne (Knowledge Media Institute, Open University, Milton Keynes, UK)
  • Paolo Manghi (Istituto di Scienza e Tecnologie dell'Informazione (ISTI) of the Consiglio Nazionale delle Ricerche (CNR), Pisa, Italy)

Program committee

  • Angelo Salatino (Knowledge Media Institute, Open University, UK)
  • Leonardo Candela (ISTI-CNR, Italy)
  • Allan Third (Knowledge Media Institute, Open University, UK)
  • Enrico Motta (Knowledge Media Institute, Open University, UK)
  • Patricia Feeney (Crossref)
  • Pinelopi Troullinou (Knowledge Media Institute, Open University, UK)
  • Jodi Schneider (University of Illinois Urbana Champaign, US)
  • Maria Koutraki (FIX Karlsruhe, Germany)
  • Antonina Dattolo (University of Udine, Italy)
  • Claudio Atzori (ISTI-CNR, Italy)
  • Daniel Garijo (Information Sciences Institute, University of Southern California, US)
  • Alessia Bardi (ISTI-CNR, Italy)
  • Katrin Weller (GESIS - Leibniz Institute for the Social Sciences, Germany)