Serato Augmented Reality (2013)

Augmented display and interactive gamification of JFB movements on the turntables.

Unity Serato test export 5 Dec 2016

Posted by Just Add Music Media on Monday, 5 December 2016

Posted by Just Add Music Media on Wednesday, 7 December 2016

Why?

Using this software I was able to to create this simple proof of concept Augmented Reality display to demostrate JFB’s extreme movements to the audience.

Unity Serato test export 5 Dec 2016

Posted by Just Add Music Media on Monday, 5 December 2016

Posted by Just Add Music Media on Wednesday, 7 December 2016

What did I Create?

My proprietary analog to digital turntable software allows capturing of all the juicy data produced whilst performing on a Mixer and two wheels of steels in real time using leading DJing software Serato Scratch Live/DJ.

Learning via Gamification

All this data can be recorded and sorted in a standard plist format allowing for some fun Gaming/learning applications.
Tell me and I forget, teach me and I may remember, involve me and I learn.Benjamin Franklin
Using this data from a JFB routine I can create a DJ/Guitar hero type experience which guides the user through JFB movements on the turntables.
The difference between this system and games like DJ/Guitar hero is your using the real instruments. Using wearable technology like the Myo from Thalmic Labs.
The guidance system is intended to be displayed over the actual instruments using a live camera feed. Augmented systems like Magic Leap could really work in this situation rather than the user having to use conventional laptop screens or TV screens.

Recording the Crossfader movements of JFB

Interactive playback of Crossfader movements playback by me

Not just for DJ’s

This technique is just a example of using a system to record musician movements on their instruments. The playing back and tutition mode can be extended for any instruments using hand tracking devices like the Leap Motion and the Myo.
The intention is to make use of muscle memory, the user minmics professional musicicans using gamification. Once the user is deversed in cloning the musicians actual movements on real instruments they are inadvertantly capable of recreating these ‘routines’ without the aid of the computer system.