Software
AudioAnalysis is a small program for displaying the spectrum and spectrogram of incoming audio in realtime. It also provides realtime analyses of various perceptually relevant features.
A basic audio and video recorder, with the possibility to control brightness, contrast and saturation in realtime.
Simple, winamp-style, realtime video synthesis based on audio input.
The Jamoma GDIF tools are developed for recording and playing back GDIF files based on the SDIF format.
This software enables realtime streaming of mocap data from the MoCap toolbox for Matlab, synchronised with audio.
The MoCap Synthesiser is a set of generic tools for making real-time motion tracking devices into musical instruments, including the SoundSaber. One feature extraction module and two sound modules are included.
Mocapgrams are helpful tools for visualising a longer segment of mocap data. They allow easy visualisation of recurring patterns and periodicities in the mocapdata, and interconnectivity between markers.
Use any standard game controller (or other Human Interface Device) as a multipurpose music controller.
MuMYO is a musical instrument prototype, aimed to investigate the use of the MYO armand with various instrumental actions.
The Musical Gestures Toolbox (MGT) is a collection of tools for creating visualizations of video files. The toolbox was primarily developed for music researchers, but is also used for sports, dance, healthcare, architecture, and interaction design.
The Musical Gestures Toolbox for Matlab is aimed at analysing music-related body motion, using sets of audio, video and motion capture data as source material.
This is a collection of modules and abstractions developed in and for the graphical programming environment Max/MSP/Jitter.
The Musical Gestures Toolbox for Python is a collection of tools for video visualization and video analysis.
Musical Gestures Toolbox for doing various video-related tricks in the terminal. This is mainly based on the power of FFmpeg and ImageMagick.
Phidgets2MIDI is a small program for using electronic devices built with a Phidgets interfacekit to control MIDI instruments.
StreamViewer is a mxj-object for Max that visualises individual data streams.
Information about how use the MGT for Python on a Virtual Desktop Infrastructure (VDI).
How can you best edit a video file for analytical usage? In the following, we will go through some editing principles and look at relevant software.
Sonification is the process of turning data into sound. Here we look at some video sonification strategies.
This article presents a set of video-based visualisation techniques developed for the analysis of music-related body motion.
A standalone application for creating visualizations and extracting motion features from video files.
VideoEditor is a minimal video editing application for doing basic trimming, cropping, rotating and colour adjustments to a video file. Nothing more, nothing less.
VideoMix is a software for mixing and projecting videos in real time. The software allows simple sound-video interaction, face recognition, and some basic video editing.
This UDP datagram unpacker is a quick and easy way to use Xsens MVN data in Max/MSP.