aQWERTYon plus Visualization
#musicEducation #onlineLearning #visualization
aQWERTYon plus Visualization is a visual interface for aQWERTYon, a platform designed for learning music with the computer keyboard, that encourages anyone new to music to play the keyboard similarly as a musical instrument.
Date Fall 2019
Toolkits Three.js, Socket.IO
Platform aQWERTYon @ NYU Music Experience Design Lab
One observation we have from user testings for aQWERTYon is, users, especially those who have no previous experience in music will easily bring in their habit of typing, which limits their experience into a small area on the keyboard with only several keys being pressed. Is there a way to inspire users to explore more space on the keyboard, and even recognize & discover pressing keys in certain gestures pattern may create some surprising sound effects? Can we make keyboard-based music improvisation a fun and intriguing experience that even beginners feel much more confident and comfortable to play with?
Invite users to a prom on the keyboard…
Visualize key press trajectories with particle systems.
Based on Edan Kwan’s Particle Love, the visualizer converts users’ key press trajectories from aQWERTYon to particles and help users to play & learn music with the inspirations offered by visual effects.
Combined with projection technologies, the visualizer offers new opportunities for embodied music learning games and immersive music learning experiences based on aQWERTYon.
aQWERTYon
Visualizer
“It’s like playing the actual piano!”
