Tests of Volume Rendering of Sound

BlueLab is currently experimenting with Volume Rendering of Sound. Volume Rendering is a visualization technique used to display 3D data. The current plugin prototype uses a set of rules to arrange samples in a volume, and makes possible to have several types of visualizations at the same time.

DETAILED DESCRIPTION

Each sound sample is arranged in a cube depending on position and color rules. These rules can depend on amplitude, frequency, pan position, chroma feature… Then we can have several types of visualization at the same time!

We have three axes: X, Y and Z. When looking at the cube from the front, the X axis corresponds to left and right, the Y axis corresponds to up and down, and the Z axis corresponds to front and back. Some rules can be defined for the X and Y axes. The Z axis is for the time flow.

EXAMPLE: 3D SPECTROGRAM

In this example, the rule for the X axis corresponds to lowest frequencies on the left, and highest frequencies on the right. The rule for the Y axis is lowest amplitudes downward, and highest amplitudes upward. The color rule is hottest colors for high amplitudes, and coldest colors for low amplitudes.

EXAMPLE: VECTORSCOPE + SPECTROGRAM + PANOGRAM

In this example, the rule for the X axis corresponds to stereo width and pan position. The rule for the Y axis is lowest frequencies downward, and highest frequencies upward. The color rule is hottest colors for high amplitudes, and coldest colors for low amplitudes.

Depending on the view orientation, we can see a vectorscope, a spectrogram, or a panogram. These three visualization types are combined in the same view.

EXAMPLE: PHASES

Another example: evolution of the phases according to the frequency on the left, and evolution of the phases according to the time on the right.

SOME OTHER FEATURES

CONCLUSION

This was a presentation of the current BlueLab plugin prototype for Volume Rendering of Sound. BlueLab is currently improving the features of the plugin prototype, in order to be able to release a new product. Work in progress…