Koalacademy
Language Learning With Brain Waves
We are developing the first language learning platform optimized to directly utilize brain waves. Our project leverages the subsequent memory effect, or the fact that memory outcomes (i.e. whether something will be remembered or forgotten) can be predicted based on brain activity during attempted memory encoding. Accordingly, we plan to develop a language learning game which will provide real-time feedback to users on whether the encoding of a given translation is likely to be successful or not. Initially, we will focus on Mandarin acquisition for English speakers because of the inherent difficulty involved in learning this language. We are aiming to reduce individual barriers in learning this complex but highly relevant language. We also plan to host our application on a remote web server, allowing open access to any users with the requisite hardware. Altogether, we aim to demonstrate the power of commercial BCIs in allowing average consumers to develop practical life skills in an efficient and engaging manner.
Underlying Principles
We take advantage of the subsequent memory effect (SME) which refers to the difference in brain activity between individuals studying items they will later remember and studying items they will later forget. Regarding EEG data, the study of items that will be remembered later is characterized by increased voltage readings over frontal and parietal regions following item presentation, as well as increased spectral power in bands such as theta. Here, we plan to leverage the power of deep machine learning models to exploit the intricacies of the SME beyond voltage and power readings. In particular, we will apply these models while individuals attempt to learn the “items” involved in learning a new language (such as characters or translations) with the goal of providing a real-time assessment of whether the study period was successful and whether it is likely that the individual will remember the item they are currently studying.
Functionality
In addition to offering feedback at the end of a given learning session (English to Mandarin association, and vice versa), we will offer users stats on their learning across multiple sessions via a profile dashboard as they progress in their learning, which in this case will be increasingly complex Mandarin characters Users can get a sense of their progress at a glance and will be provided a summary of the characters that they need to study more.
Our Vision
This project will culminate in a fully functioning, free to use, web-based game. Our base platform and existing code will remain Open Source and free for all to use ad infinitum. We expect our project to garner significant media attention given the broad coverage of our first project, AlphaBlaster, in 2019. This will be accomplished by reaching out both within the University of Alberta community as well as the broader Edmonton community. We will also share our project internally throughout the University of Alberta and the University of Calgary. Most importantly, we also plan to submit our project to the 2021 iteration of the NeuroTechX Open Competition, an international undergraduate neurotechnology design contest!
|
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|---|---|
| Anna Romero | Cameron Hildebrandt | David Lam | Eden Redman | Harrison Fah | Julie Pilz | Landon Fuhr | Matthew Danyluk | Portia Rayner | Ryan Kang | Tanyaradzwa Gozhora |
| BA, Psychology | BSc, Computer Science | BSc, Neuroscience | BA, Fine Arts and Design | BSc, Computer Science | BSc, Computer Science | BSc, Physiology | BSc, Neuroscience | BSc, Mechanical Engineering | BSc, Computer Science | BSc, Computer Science |