NAT Brain

Koalacademy

Language Learning With Brain Waves

We are developing the first language learning platform optimized to directly utilize brain waves. Our project leverages the subsequent memory effect, or the fact that memory outcomes (i.e. whether something will be remembered or forgotten) can be predicted based on brain activity during attempted memory encoding. Accordingly, we plan to develop a language learning game which will provide real-time feedback to users on whether the encoding of a given translation is likely to be successful or not. Initially, we will focus on Mandarin acquisition for English speakers because of the inherent difficulty involved in learning this language. We are aiming to reduce individual barriers in learning this complex but highly relevant language. We also plan to host our application on a remote web server, allowing open access to any users with the requisite hardware. Altogether, we aim to demonstrate the power of commercial BCIs in allowing average consumers to develop practical life skills in an efficient and engaging manner.

Underlying Principles

We take advantage of the subsequent memory effect (SME) which refers to the difference in brain activity between individuals studying items they will later remember and studying items they will later forget. Regarding EEG data, the study of items that will be remembered later is characterized by increased voltage readings over frontal and parietal regions following item presentation, as well as increased spectral power in bands such as theta. Here, we plan to leverage the power of deep machine learning models to exploit the intricacies of the SME beyond voltage and power readings. In particular, we will apply these models while individuals attempt to learn the “items” involved in learning a new language (such as characters or translations) with the goal of providing a real-time assessment of whether the study period was successful and whether it is likely that the individual will remember the item they are currently studying.

Functionality

In addition to offering feedback at the end of a given learning session (English to Mandarin association, and vice versa), we will offer users stats on their learning across multiple sessions via a profile dashboard as they progress in their learning, which in this case will be increasingly complex Mandarin characters Users can get a sense of their progress at a glance and will be provided a summary of the characters that they need to study more.

Our Vision

This project will culminate in a fully functioning, free to use, web-based game. Our base platform and existing code will remain Open Source and free for all to use ad infinitum. We expect our project to garner significant media attention given the broad coverage of our first project, AlphaBlaster, in 2019. This will be accomplished by reaching out both within the University of Alberta community as well as the broader Edmonton community. We will also share our project internally throughout the University of Alberta and the University of Calgary. Most importantly, we also plan to submit our project to the 2021 iteration of the NeuroTechX Open Competition, an international undergraduate neurotechnology design contest!

Koalacademy Project Team
Anna Romero Cameron Hildebrandt David Lam Eden Redman Harrison Fah Julie Pilz Landon Fuhr Matthew Danyluk Portia Rayner Ryan Kang Tanyaradzwa Gozhora
BA, Psychology BSc, Computer Science BSc, Neuroscience BA, Fine Arts and Design BSc, Computer Science BSc, Computer Science BSc, Physiology BSc, Neuroscience BSc, Mechanical Engineering BSc, Computer Science BSc, Computer Science