2020/05/02 – Volume Rendering of Sound

What’s new in the Lab?

BlueLab is currently experimenting with Volume Rendering of Sound. Volume Rendering is a visualization technique used to display 3D data. The current plugin prototype uses a set of rules to arrange samples in a volume, and makes possible to have several types of visualizations at the same time.

 

 

DETAILED DESCRIPTION

BlueLab | Audio Plugins - Volume Rendering of Sound - Cube

Each sound sample is arranged in a cube depending on position and color rules. These rules can depend on amplitude, frequency, pan position, chroma feature… Then we can have several types of visualization at the same time!

 

BlueLab | Audio Plugins - Volume Rendering of Sound - Cube Axis

We have three axes: X, Y and Z. When looking at the cube from the front, the X axis corresponds to left and right, the Y axis corresponds to up and down, and the Z axis corresponds to front and back. Some rules can be defined for the X and Y axes. The Z axis is for the time flow.

 

EXAMPLE: 3D SPECTROGRAM

BlueLab | Audio Plugins - Volume Rendering of Sound - 3D Spectrogram

In this example, the rule for the X axis corresponds to lowest frequencies on the left, and highest frequencies on the right. The rule for the Y axis is lowest amplitudes downward, and highest amplitudes upward. The color rule is hottest colors for high amplitudes, and coldest colors for low amplitudes.

 

EXAMPLE: VECTORSCOPE + SPECTROGRAM + PANOGRAM

BlueLab | Audio Plugins - Volume Rendering of Sound - Vectorscope + Spectrogram + Panogram

In this example, the rule for the X axis corresponds to stereo width and pan position. The rule for the Y axis is lowest frequencies downward, and highest frequencies upward. The color rule is hottest colors for high amplitudes, and coldest colors for low amplitudes.

Depending on the view orientation, we can see a vectorscope, a spectrogram, or a panogram. These three visualization types are combined in the same view.

 

EXAMPLE: PHASES

BlueLab | Audio Plugins - Volume Rendering of Sound - Evolution of the phases

Another example: evolution of the phases according to the frequency on the left, and evolution of the phases according to the time on the right.

 

SOME OTHER FEATURES

BlueLab | Audio Plugins - Volume Rendering of Sound - TransparencyTransparency

BlueLab | Audio Plugins - Volume Rendering of Sound - Rendering accuracyRendering accuracy

BlueLab | Audio Plugins - Volume Rendering of Sound - 3D Selection3D Selection

BlueLab | Audio Plugins - Volume Rendering of Sound - Threshold by colorThreshold by color

 

CONCLUSION

This was a presentation of the current BlueLab plugin prototype for Volume Rendering of Sound. BlueLab is currently improving the features of the plugin prototype, in order to be able to release a new product. Work in progress…

Leave a Reply

Your email address will not be published. Required fields are marked *