13 March 2007

Brainstorm session on our goal


After the presentation of last friday we decided to choose a few effects and a few features and to implement these in real-time. The idea is to write working code with matlab at first and we can use simulink for the inputs/outputs and signal routing. Then we'll translate it to c code, using PureData probably for the routing part.
For feature extraction we would surely like to try onset detection and the other two we already worked on (rhythm/beat and pitch extraction).
As for the effects: delay and vibrato for sure, and then maybe a wah effect, panning, (,...)
The basic ideas we want to try with these effects and features are:
  • the delay time parameter of the delay effect controlled by the tempo of the song (auto-adaptive as well as adaptive (master channel or drums channel, with a mic or with insert cables))
  • the rate and depth of the vibrato will be faster with high pitched notes and/or loudness
  • the wah effect and the panner can be controlled with onset and beat detection, but this already works this way
  • when a singer sings a high and loud note, the delay effect can be more distinct and with a nice long delay (to make it stronger. this is the same as the sound engineers do by hand now)
  • ...
There might be added some other idea later on, but this are the starting blocks.
So the beat extraction will extract the tempo of the music andwe will use this to sync the other effects. This is one example of cross reference for our list of effects and features.

1 comment:

ronny said...

We might also include RMS and other very basic calculations on signals (without musical meaning that is) as features