BlueLab is currently experimenting with Volume Rendering of Sound. Volume Rendering is a visualization technique used to display 3D data. The current plugin prototype uses a set of rules to arrange samples in a volume, and makes possible to have several types of visualizations at the same time.
Each sound sample is arranged in a cube depending on position and color rules. These rules can depend on amplitude, frequency, pan position, chroma feature… Then we can have several types of visualization at the same time!
We have three axes: X, Y and Z. When looking at the cube from the front, the X axis corresponds to left and right, the Y axis corresponds to up and down, and the Z axis corresponds to front and back. Some rules can be defined for the X and Y axes. The Z axis is for the time flow.
EXAMPLE: 3D SPECTROGRAM
In this example, the rule for the X axis corresponds to lowest frequencies on the left, and highest frequencies on the right. The rule for the Y axis is lowest amplitudes downward, and highest amplitudes upward. The color rule is hottest colors for high amplitudes, and coldest colors for low amplitudes.
EXAMPLE: VECTORSCOPE + SPECTROGRAM + PANOGRAM
In this example, the rule for the X axis corresponds to stereo width and pan position. The rule for the Y axis is lowest frequencies downward, and highest frequencies upward. The color rule is hottest colors for high amplitudes, and coldest colors for low amplitudes.
Depending on the view orientation, we can see a vectorscope, a spectrogram, or a panogram. These three visualization types are combined in the same view.
Another example: evolution of the phases according to the frequency on the left, and evolution of the phases according to the time on the right.
SOME OTHER FEATURES
This was a presentation of the current BlueLab plugin prototype for Volume Rendering of Sound. BlueLab is currently improving the features of the plugin prototype, in order to be able to release a new product. Work in progress…