No Cover Image

Journal article 83 views 16 downloads

A Knowledge Graph Based Approach to Social Science Surveys

Jeff Z. Pan, Elspeth Edelstein, Patrik Bansky, Adam Wyner Orcid Logo

Data Intelligence, Volume: 3, Issue: 4, Pages: 477 - 506

Swansea University Author: Adam Wyner Orcid Logo

  • 58564.pdf

    PDF | Version of Record

    © 2021. Published under a Creative Commons Attribution 4.0 International (CC BY 4.0) license.

    Download (529.82KB)

Check full text

DOI (Published version): 10.1162/dint_a_00107

Abstract

Recent success of knowledge graphs has spurred interest in applying them in open science, such as on intelligent survey systems for scientists. However, efforts to understand the quality of candidate survey questions provided by these methods have been limited. Indeed, existing methods do not consid...

Full description

Published in: Data Intelligence
ISSN: 2641-435X
Published: MIT Press - Journals 2021
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa58564
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract: Recent success of knowledge graphs has spurred interest in applying them in open science, such as on intelligent survey systems for scientists. However, efforts to understand the quality of candidate survey questions provided by these methods have been limited. Indeed, existing methods do not consider the type of on-the-fly content planning that is possible for face-to-face surveys and hence do not guarantee that selection of subsequent questions is based on response to previous questions in a survey. To address this limitation, we propose a dynamic and informative solution for an intelligent survey system that is based on knowledge graphs. To illustrate our proposal, we look into social science surveys, focusing on ordering the questions of a questionnaire component by their level of acceptance, along with conditional triggers that further customise participants' experience. Our main findings are: (i) evaluation of the proposed approach shows that the dynamic component can be beneficial in terms of lowering the number of questions asked per variable, thus allowing more informative data to be collected in a survey of equivalent length; and (ii) a primary advantage of the proposed approach is that it enables grouping of participants according to their responses, so that participants are not only served appropriate follow-up questions, but their responses to these questions may be analysed in the context of some initial categorisation. We believe that the proposed approach can easily be applied to other social science surveys based on grouping definitions in their contexts. The knowledge-graph-based intelligent survey approach proposed in our work allows online questionnaires to approach face-to-face interaction in their level of informativity and responsiveness, as well as duplicating certain advantages of interview-based data collection.
Keywords: Intelligent survey system, Dynamic and informative system, Knowledge graph, Linguistic grammaticality judgements
College: College of Science
Issue: 4
Start Page: 477
End Page: 506