(Text from the original announcement at the web of the TIDE research group, here)

1st EATEL/ECTEL Workshop on the “Profession” in Technology-Enhanced Learning: Open Science

4th Sep. 2018, afternoon (see within ECTEL schedule)

Workshop Organizers

Dr. Davinia Hernández-Leo, Universitat Pompeu Fabra Barcelona, Spain

Dr. Stian Håklev, Ecole Polytechnique Fédérale de Lausanne, Switzerland

as an inititive of EATEL, the European Association of Technology-Enhanced Learning

see also EATEL Webinars - Series "The Profession": Webinar 1 “Open Science in Technology-Enhanced Learning”

The European Association of Technology-Enhanced Learning (EATEL) seeks to drive community discussion that can help to maintain high standards of research quality and professionalism in the domain of TEL. In this line, EATEL has initiated a Webinar series on “The Profession” (http://ea-tel.eu/). This workshop complements this online initiative, offering a face-to-face space for knowledge and experience sharing around overarching aspects related to the TEL research profession. These overarching aspects will consider important challenges for our field that are derived from its own nature (e.g. interdisciplinarity) and from key issues in Responsible Research and Innovation (RRI) (Strand et al, 2015). These RRI issues go from gender and diversity equality and inclusion, to public engagement, sustainability, ethics, and open science. The topic chosen for the first edition of the Webinar series and workshop is “Open Science as it applies to TEL”. Open Science is a critical issue considered by the research community at large, including our TEL community (see Statement of Open Science by EC-TEL this year, following the lead of other conferences of the community).

Open Science goes beyond Open Access, which focuses on access to and preservation of scientific information. The ongoing phenomenon of Open Science promotes on the one hand, transparent and frequent updates of research progress; and other other hand, reproducible, accurate and verifiable research (Winfield, 2014), bringing benefits for the individual researchers, the research community and the society.

Like other fields, TEL research suffers from problems such as challenges to replicate (Beardsley et al, 2018), validity, publication bias, and high costs of access to publications (van der Zee & Reich, 2018). There are several initiatives that aim to change closed and nontransparent approaches to research. van der Zee & Reich (2018) discuss that it is possible to engage in “Open Educational Science” by making more transparent and accessible each stage of the scientific cycle (research design, data collection, analysis, and publication) with open approaches to science, such as pre-registration, data sharing, transparent analyses, and open access publication. The Open Science Framework (https://osf.io/) offers a space to report pre-registered and exploratory analyses to be reviewed by other researchers before running the interventions. There are now several specialized Web platforms (e.g. Zenodo, Figshare, LearnSphere, GitHub) where researchers can share datasets and software used in studies so that other researchers can reproduce or extend the analysis. However, the use of these initiatives is in its early days and despite there starts to be some remarkable open science practices in our domain, they are not broadly known, documented and shared within the community for widespread adoption.  

This workshop invites 1-2 page submissions that present Open Science practices in our domain and discuss the benefits and challenges of Open Science as it applies to TEL. For example, submissions can explain successful cases of doing Open Science in their research (research groups and labs, PhD work, research project, etc.) and discuss obstacles they are facing, strategies they have developed, etc. Obstacles and challenges that may be discussed can be of different nature, from data sharing, privacy and ethical issues to contextual aspects, to data formats and tools.

Workshop Program

13.30 - 13.45 Welcome and Introduction, Davinia Hernández-Leo, Stian Håklev (workshop organizers, EATEL board members)

13.45 - 14.15 Sharing thoughts, all workshop participants

14.15 - 15.30 Presentations and dicussion

• "Analytics we can trust: On the importance of Verification in the design of Big Data educational technologies"
  Giora Alexandron (Weizmann Institute of Science, Israel)
• "Opening up TEL Research: A critical perspective from two case studies"
  Juliana Elisa Raffaghelli (Universitat Oberta de Catalunya), Patrizia Maria Margherita Ghislandi (University of Trento), Matteo Bozzi (University of Trento) and Maurizio Zani (Politecnico di Milano)
• "Open Science strategies in TEL labs: the case of the TIDE_UPF research group"
  Davinia Hernández-Leo (Universitat Pompeu Fabra, Barcelona)

15.30 - 18.00 Group activities, all workshop participants

• Collect practices, tools, challenges, reference people, reccomendations etc relevant to Open Science in TEL.
• Look towards the future: what is needed for a broader adoption of Open Science in our domain.
• Discuss/plan a collective publication.

Workshop goals

• Provide a forum to discuss overarching challenges in the TEL domain as it refers to Open Science.
• Identify best practices of Open Science as it applies to TEL.
• Gather feedback to EATEL about how we as a community and through the association can promote Open Science in TEL.
• Consolidate the new EATEL initiative about “The Profession” seeking to share experience and maintain high standards of research quality and responsible professionalism in the domain of TEL.

Workshop outcomes

• Articulating a EATEL white paper that includes a compilation of the contributions to the workshop. The white paper will be published in the EATEL website.
• The possibility of writing a journal publication with the analysis of the Open Science cases, benefits and challenges will be considered and discussed with the workshop participants.

Submissions

Workshop participants are encouraged to submit at least one contribution (one or two pages long, ECTEL submission format) that present Open Science practices in our domain and discuss the benefits and challenges of Open Science as it applies to TEL. There is no restriction on the number of papers submitted by the same author. Submissions will be handled by EasyChair: https://easychair.org/conferences/?conf=telprofession18

Important Dates

Submissions deadline: June 20, 2018, July 2nd (extended)

Notifications and programme publication: July 15, 2018

Revised submissions: July 30, 2018

Workshop: September 4, 2018

Workshop Program Committee
 

Hendrik Drachsler, University of Frankfurt, DIPF, Germany

Mikhail Fominykh, Norwegian University of Science and Technology, Molde University College and independent researcher, Norway

Xiangen Hu,  The University of Memphis and Central China Normal University

Roberto Martinez-Maldonado, University Technology Sydney

Alejandra Martínez-Monés, University of Valladolid, Spain

Abelardo Pardo, University of South Australia

Daniel Spikol, Malmö University

References

Beardsley, M., Hernández-Leo, D., & Ramírez, R., (2018) Seeking reproducibility in multimodal learning experiments: Assessing an EEG study of the testing effect, Journal of Computer Assisted Learning, https://doi.org/10.1111/jcal.12265.

Strand, R., Spaapen, J., Bauer, M., Hogan, E., Revuelta, G., Stagl, S., Paula, L., & Pereira, Â. G. (2015). Indicators for promoting and monitoring responsible research and innovation. Report from the expert group on policy indicators for responsible research and innovation. Brussels: European Union Publications.

van der Zee, T., & Reich, J. (2018). Open Educational Science. http://doi.org/10.17605/OSF.IO/D9BME

Winfield, A. F. (2014), ‘Open science — a three level approach’. Presentation at the conference Science, Innovation and Society — Responsible Research and Innovation, Rome, 20 November.