Conference Paper/Proceeding/Abstract 312 views
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Pages: 1 - 14
Swansea University Author:
Chat Wacharamanotham
Full text not available from this repository: check for access using links below.
DOI (Published version): 10.1145/3313831.3376448
Abstract
Several fields of science are experiencing a “replication crisis” that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Fa...
Published in: | Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems |
---|---|
ISBN: | 978-1-4503-6708-0 |
Published: |
New York, NY, USA
ACM
2020
|
URI: | https://cronfa.swan.ac.uk/Record/cronfa60607 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
first_indexed |
2022-08-15T13:55:06Z |
---|---|
last_indexed |
2023-01-13T19:20:51Z |
id |
cronfa60607 |
recordtype |
SURis |
fullrecord |
<?xml version="1.0"?><rfc1807 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><datestamp>2022-10-31T15:01:47.8089270</datestamp><bib-version>v2</bib-version><id>60607</id><entry>2022-07-22</entry><title>Transparency of CHI Research Artifacts: Results of a Self-Reported Survey</title><swanseaauthors><author><sid>5310be7eb485ebc96c9671f5a45d6f62</sid><ORCID>0000-0003-4831-2516</ORCID><firstname>Chat</firstname><surname>Wacharamanotham</surname><name>Chat Wacharamanotham</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2022-07-22</date><deptcode>SCS</deptcode><abstract>Several fields of science are experiencing a “replication crisis” that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scientific progress.Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018–2019 papers, asking if they share their papers’ research materials and data, how they share them, and why they do not. The results (34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices.This paper and all data and materials are freely available at https://osf.io/3bu6t.</abstract><type>Conference Paper/Proceeding/Abstract</type><journal>Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems</journal><volume/><journalNumber/><paginationStart>1</paginationStart><paginationEnd>14</paginationEnd><publisher>ACM</publisher><placeOfPublication>New York, NY, USA</placeOfPublication><isbnPrint>978-1-4503-6708-0</isbnPrint><isbnElectronic/><issnPrint/><issnElectronic/><keywords>Open Science, public data sharing, open data, data availability</keywords><publishedDay>23</publishedDay><publishedMonth>4</publishedMonth><publishedYear>2020</publishedYear><publishedDate>2020-04-23</publishedDate><doi>10.1145/3313831.3376448</doi><url/><notes/><college>COLLEGE NANME</college><department>Computer Science</department><CollegeCode>COLLEGE CODE</CollegeCode><DepartmentCode>SCS</DepartmentCode><institution>Swansea University</institution><apcterm/><funders/><projectreference/><lastEdited>2022-10-31T15:01:47.8089270</lastEdited><Created>2022-07-22T22:05:34.9594876</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Mathematics and Computer Science - Computer Science</level></path><authors><author><firstname>Chat</firstname><surname>Wacharamanotham</surname><orcid>0000-0003-4831-2516</orcid><order>1</order></author><author><firstname>Lukas</firstname><surname>Eisenring</surname><order>2</order></author><author><firstname>Steve</firstname><surname>Haroz</surname><order>3</order></author><author><firstname>Florian</firstname><surname>Echtler</surname><order>4</order></author></authors><documents/><OutputDurs><OutputDur><Id>108</Id><IsDataAvailableOnline>true</IsDataAvailableOnline><DataNotAvailableOnlineReasonId xsi:nil="true"/><DurUrl>https://osf.io/3bu6t</DurUrl><IsDurRestrictions>false</IsDurRestrictions><DurRestrictionReasonId xsi:nil="true"/><DurEmbargoDate xsi:nil="true"/></OutputDur></OutputDurs></rfc1807> |
spelling |
2022-10-31T15:01:47.8089270 v2 60607 2022-07-22 Transparency of CHI Research Artifacts: Results of a Self-Reported Survey 5310be7eb485ebc96c9671f5a45d6f62 0000-0003-4831-2516 Chat Wacharamanotham Chat Wacharamanotham true false 2022-07-22 SCS Several fields of science are experiencing a “replication crisis” that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scientific progress.Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018–2019 papers, asking if they share their papers’ research materials and data, how they share them, and why they do not. The results (34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices.This paper and all data and materials are freely available at https://osf.io/3bu6t. Conference Paper/Proceeding/Abstract Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems 1 14 ACM New York, NY, USA 978-1-4503-6708-0 Open Science, public data sharing, open data, data availability 23 4 2020 2020-04-23 10.1145/3313831.3376448 COLLEGE NANME Computer Science COLLEGE CODE SCS Swansea University 2022-10-31T15:01:47.8089270 2022-07-22T22:05:34.9594876 Faculty of Science and Engineering School of Mathematics and Computer Science - Computer Science Chat Wacharamanotham 0000-0003-4831-2516 1 Lukas Eisenring 2 Steve Haroz 3 Florian Echtler 4 108 true https://osf.io/3bu6t false |
title |
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey |
spellingShingle |
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey Chat Wacharamanotham |
title_short |
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey |
title_full |
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey |
title_fullStr |
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey |
title_full_unstemmed |
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey |
title_sort |
Transparency of CHI Research Artifacts: Results of a Self-Reported Survey |
author_id_str_mv |
5310be7eb485ebc96c9671f5a45d6f62 |
author_id_fullname_str_mv |
5310be7eb485ebc96c9671f5a45d6f62_***_Chat Wacharamanotham |
author |
Chat Wacharamanotham |
author2 |
Chat Wacharamanotham Lukas Eisenring Steve Haroz Florian Echtler |
format |
Conference Paper/Proceeding/Abstract |
container_title |
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems |
container_start_page |
1 |
publishDate |
2020 |
institution |
Swansea University |
isbn |
978-1-4503-6708-0 |
doi_str_mv |
10.1145/3313831.3376448 |
publisher |
ACM |
college_str |
Faculty of Science and Engineering |
hierarchytype |
|
hierarchy_top_id |
facultyofscienceandengineering |
hierarchy_top_title |
Faculty of Science and Engineering |
hierarchy_parent_id |
facultyofscienceandengineering |
hierarchy_parent_title |
Faculty of Science and Engineering |
department_str |
School of Mathematics and Computer Science - Computer Science{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Mathematics and Computer Science - Computer Science |
document_store_str |
0 |
active_str |
0 |
description |
Several fields of science are experiencing a “replication crisis” that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scientific progress.Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018–2019 papers, asking if they share their papers’ research materials and data, how they share them, and why they do not. The results (34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices.This paper and all data and materials are freely available at https://osf.io/3bu6t. |
published_date |
2020-04-23T04:18:51Z |
_version_ |
1763754252983861248 |
score |
11.024221 |