Open seminar: “Multimodal data and multidisciplinary research on learning”

The LET research unit is organizing the open seminar “Multimodal data and multidisciplinary research on learning”, as part of the Gen Z project.

The seminar is to be held on December 4th 10:00-12:00 at the Business Kitchen stage of the University of Oulu. Details of the program and information on the presenters below.


10:00 Opening of the seminar, Sanna Järvelä

10:15 -10:45 Learning design and data analytics: from teacher communities to computer-supported collaborative learning scripts

Presenter: Davinia Hernández-Leo, Associate Professor, Information and Communication Technologies Department, University Pompeu Fabra, Barcelona

Brief description: I will present an overview of the educational technologies research conducted by the TIDE research group of the Information and Communication Technologies Department at Universitat Pompeu Fabra in Barcelona ( @TIDE_UPF). The overview will be articulated around the perspective, central to TIDE work, of supporting teachers and teacher communities (e.g a school) in the design of the best possible (technology-enhanced) learning activities considering their students and their contexts. Main research contributions that will be presented include a community platform for integrated learning design (ILDE, including multiple authoring tools e.g. edCrumble), scalable and flexible orchestration of computer-supported collaborative learning scripts (PyramidApp), and the use of data analytics at different levels (learning, design, community) to support teachers in learning (re)design. The presentation will include results of European, Spanish and Catalan projects (METIS, RESET, CoT) and our initial work in recently started projects (SmartLET, Illuminated).

Bio: Davinia Hernández-Leo is Associate Professor and Serra Hunter Fellow in the Department of Information and Communications Technologies at Universitat Pompeu Fabra, Barcelona (UPF), the Head of the Interactive and Distributed Technologies for Education group (TIDE), Vice-Dean of the UPF Engineering School and the Director of its Unit for teaching quality and innovation. She obtained her PhD at University of Valladolid (2007), has been a visiting scholar at the Open University of the Netherlands (2006), Virginia Tech (2012) and the University of Sydney (2015). Davinia's research lies at the intersection of network and computer applications, human-computer interaction and learning sciences, with a special focus on technologies for learning design, computer-supported collaborative learning (CSCL), analytics, architectures and devices for learning. She is Vice-President of the European Association of Technology-Enhanced Learning and a member of the editorial board of the IEEE Transactions of Learning Technologies. 


10:45-11:15 Exploring Multimodal Learning Analytics in relation to Social Robotics

Presenter: Daniel Spikol, Associate Professor, Department of Computer Science and Media Technology Faculty of Technology and Society Malmö University, Sweden.

Brief description: The talk presents key results and lessons learnt from the Practice-based Experiential Learning Analytics Research and Support (PELARS) project. PELARS was a three-year project that developed a learning analytics system to investigate small group learning for open-ended engineering tasks funded by the European Commission The aim of the talk is to share the results and to discuss potential connections between multimodal learning analytics (MMLA) and uses for social robotics. The different approaches of the project will be discussed that include the use of different sensors to capture, record, and analyse students physical interactions and how we used this data to create models to understand aspects of collaboration. To investigate the multimodal data, we started with a simple grading of the student's final products and progressed to a richer framework for assessing student non-verbal collaboration with different machine learning strategies. Some of the results illustrate that body location and movement are strong features for further investigating collaboration. However, challenges remain across the sustainability and ethics of how this data can be used to support the learners and teachers in creative, open-ended activities. More interesting how the different applications of MMLA that could be applied in social robotics for educational contexts.

Bio: Daniel Spikol, PhD Associate Professor, Docent Department of Computer Science and Media Technology Faculty of Technology and Society Malmö University, Sweden.

Scientist, educator, and creative technologist investigating how people learn and play. Spikol works for Malmö University and is a group leader in the Internet of Things and People Research Center. He previously worked for Linnæus University and Interactive Institute (RISE Swedish Research Institute). Spikol's passion is to design and develop digital experiences to provoke people's curiosity to explore the physical and digital world around them. Spikol combines a background in design, digital art, and computer science to investigate how people learn and play. He has over 60 scientific publications and digital art installations. He has worked for different companies, founded several companies, and actively works to integrate design with science, industry, and culture. His current research looks at understanding how people to collaborate to solve open-ended design tasks with physical computing with the aim to inspire learners for computational tinkering and thinking.

 More information about Daniel Spikol’s work at: IOTAP -

PELARS project -

Publications -


11:15-11:45 EDA and Sound in Collaborative learning. Application of Multimodal Learning Analytics

Presenter:  Milica Vujovic, Marie Curie PhD candidate, Information and Communication Technologies Department, University Pompeu Fabra, Barcelona

Short description: Investigating the role of environmental sound in the collaborative learning process. We present a pilot study where we investigate effects of environmental sound on participants’ electrodermal and voice activity (EDA, VA). Moreover, we propose a visualization to represent the dependence between the aforementioned parameters as a first design for a self-awareness tool. Preliminary results are provocative for future research: there seems to be dependences between the measured parameters and participants accept the proposed visualization as clear and useful.

Biography: Milica Vujovic is a INPhINIT “la Caixa” Marie Curie PhD candidate in Interactive and Distributed Technologies for Education (TIDE) Group in the Department of Information and Communication Technologies at Universitat Pompeu Fabra (UPF), Barcelona. Architectural and mechanical engineer with a history of working in the academia, architecture, mechanical and industrial engineering industry. Also, owns previous experience in teaching, within multidisciplinary subjects held at the Faculty of Architecture, University of Belgrade. Subjects referred to human interaction in smart environments and mechatronic solutions in architecture. Obtained a Master's Degree in Architecture (2011) and Master's Degree from Faculty of Mechanical Engineering (2014). Skilled in SolidWorks, AutoCAD, Computer-Aided Design (CAD), Revit and Matlab. Her research interests focus on Mechatronics, Human Computer Interaction and Smart Environment.

Viimeksi päivitetty: 26.11.2018