Reproducibility of Research Output

Wann
Dienstag, 5. November 2024
9 bis 15 Uhr

Wo
Online

Veranstaltet von
FDM-BB

Vortragende Person/Vortragende Personen:
Various

This is an all-day online event. Please register for some or all events below.

Session 1 – Online Talks 

Registration: Please register here for the talks. You will receive the Zoom link after registering for the event.

 9 – 10 AM

Perceived Barriers to Open Science among Researchers

Abstract: Open Science principles are generally well-received by researchers, but not everyone may adhere to them despite the perceived benefits. We explore why researchers perceive limitations to open science and highlight variations across different research fields.

Speaker: Dr. Christian Riedel (SFB 1294 Data Assimilation: Project Z03 Information Infrastructure for Data Assimilation, University of Potsdam)

The reproducibility of findings in linguistics and psychology: Where are we now, and how do we move forward?

Abstract: In 2019 the Journal of Memory and Language instituted an open data and code policy; this policy requires that, as a rule, code and data be released at the latest upon publication. How effective is this policy? We compared 59 papers published before, and 59 papers published after, the policy took effect. After the policy was in place, the rate of data sharing increased by more than 50%. We further looked at whether papers published under the open data policy were reproducible. The reproducibility rate ranged from 34% to 56%, depending on the reproducibility criteria. The strongest predictor of whether an attempt to reproduce would be successful is the presence of the analysis code: it increases the probability of reproducing reported results by almost 40%. We propose two simple steps that can increase the reproducibility of published papers: share the analysis code, and attempt to reproduce one’s own analysis using only the shared materials.

Speaker: Dr. Anna Laurinavichyute (SFB 1287 Limits of Variability in Language: Project Q Scientific Service and Infrastructure Project, University of Potsdam)

Session 2 – Online Workshop 

Registration: Please register here for this workshop. You will receive the Zoom link after registering for the event. The maximum number of participants for this event is 50. You will be notified whether we can offer you a space for this event as soon as possible.

10.15 AM – 12.15 PM

Reproducibility in Scientific Publications 

Abstract: Reproducibility is one of the fundamentals of scientific results, yet we sometimes don’t follow agreed-upon best practices. In the early 2010s, this led to a reproducibility crisis that shook the core of psychology and medicine and led to a much stronger awareness and – in some fields – regulation. We will take a closer look on how reproducibility is achieved when data and code are involved and how we can implement best practices in our own publications.

Speaker: Hendrik Geßner (Team ‘Operation Applications’ (Lead), Center for Information Technology and Media Management, University of Potsdam)

Session 3 – Online Workshop 

Registration: Please register here for this workshop. The maximum number of participants for this event is 20. You will be notified whether we can offer you a space for this event as soon as possible.

1 – 3 PM

FAIR Software and Containerization by NFDIxCS

Abstract: Research software is a critical issue in almost every research discipline. Creating software for research requires not only methods from the research discipline but also skills in software engineering. This time-consuming process often leaves little room to make the software accessible and usable before submitting a paper, thesis, or completing a project, resulting in the loss of valuable scientific contributions. In our hands-on workshop, we will showcase techniques to enhance the reproducibility of your research software at any project stage. Participants will learn about the benefits of containerization for computational work and how reproducible software with metadata can open up their work to the broader research community. The NFDIxCS consortium focuses on the development of a Research Data Management Container (RDMC), which involves containerizing software along with its data and context. Beyond this workshop, we will also provide insights into current discussions around metadata applications, long-term archiving, and addressing security/privacy concerns in RDMCs. While primarily designed for practitioners, this workshop is also valuable for senior scientists interested in understanding these essential processes.

Speaker: Jan Bernoth (Team ‘Institutionelle Infrastrukturen’ (Lead) at the Chair for Complex Multimedia Application Architectures, Researcher in NFDIxCS, PhD Candidate, University of Potsdam)

More information