No Cover Image

Journal article 16 views 1 download

Reproducibility in Research: Systems, Infrastructure, Culture / Tom Crick; Benjamin A. Hall; Samin Ishtiaq

Journal of Open Research Software, Volume: 5

Swansea University Author: Crick, Tom

  • 73-2363-1-PB.pdf

    PDF | Version of Record

    This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0).

    Download (631.24KB)

Check full text

DOI (Published version): 10.5334/jors.73

Abstract

The reproduction and replication of research results has become a major issue for a number of scientific disciplines. In computer science and related computational disciplines such as systems biology, the challenges closely revolve around the ability to implement (and exploit) novel algorithms and m...

Full description

Published in: Journal of Open Research Software
ISSN: 2049-9647
Published: Ubiquity Press 2017
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa43573
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract: The reproduction and replication of research results has become a major issue for a number of scientific disciplines. In computer science and related computational disciplines such as systems biology, the challenges closely revolve around the ability to implement (and exploit) novel algorithms and models. Taking a new approach from the literature and applying it to a new codebase frequently requires local knowledge missing from the published manuscripts and transient project websites. Alongside this issue, benchmarking, and the lack of open, transparent and fair benchmark sets present another barrier to the verification and validation of claimed results.In this paper, we outline several recommendations to address these issues, driven by specific examples from a range of scientific domains. Based on these recommendations, we propose a high-level prototype open automated platform for scientific software development which effectively abstracts specific dependencies from the individual researcher and their workstation, allowing easy sharing and reproduction of results. This new e-infrastructure for reproducible computational science offers the potential to incentivise a culture change and drive the adoption of new techniques to improve the quality and efficiency – and thus reproducibility – of scientific exploration.
Keywords: reproducible research, cyberinfrastructure, scientific workflows, computational science, open science, data sharing, code sharing, best practices
College: College of Science