Seeking reproducibility: assessing a multimodal study of the testing effect

  • Authors
  • Beardsley M, Hernández Leo D, Ramírez R
  • UPF authors
  • HERNÁNDEZ-LEO, DAVINIA; RAMIREZ MELENDEZ, RAFAEL; BEARDSLEY, MARC YOSHIMI;
  • Type
  • Scholarly articles
  • Journal títle
  • Journal of Computer Assisted Learning
  • Publication year
  • 2018
  • Volume
  • 34
  • Number
  • 4
  • Pages
  • 378-386
  • ISSN
  • 0266-4909
  • Publication State
  • Published
  • Abstract
  • Low-cost devices have widened the use of multimodal data in experiments providing a more complete picture of behavioural effects. However, the accurate collection and combination of multimodal and behavioural data in a manner that enables reproducibility is challenging and often requires researchers to refine their approaches. This paper presents a direct replication of a multimodal wordlist experiment. Specifically, we use a low¿cost Emotiv EPOC® to acquire electrophysiological measures of brain activity to investigate whether retrieval during learning facilitates the encoding of subsequent learning as measured by performance on recall tests and reflected by changes in alpha wave oscillations. Behavioural results of the wordlist experiment were replicated, but physiological results were not. We conclude the paper by highlighting the challenges faced in terms of replicating the previous work and in attempting to facilitate the reproducibility of our own experiment.
  • Complete citation
  • Beardsley M, Hernández Leo D, Ramírez R. Seeking reproducibility: assessing a multimodal study of the testing effect. Journal of Computer Assisted Learning 2018; 34(4): 378-386.
Bibliometric indicators
  • 10 times cited Scopus
  • 9 times cited WOS
  • Índex Scimago de 1.382 (2018)