Video support

The idea is to extend the buzz concept to handle the audio and video together. Video support would allow to compose visual artwork simillar to music. It should be enabled by a setting as the extra feature should not clutter the ui and workflow for those who just want to compose audio. It is a complex project of its own and this page just serves as a scatch space for thoghts.

If video is enabled master-machine would also have a videosink.

Like there are audio generators and effects. we would have video generators and effects. When mixing video we might need to introduce a z-order.

We might also want audio->video elements (visualisations).

In order to produce synced graphics, it would be nice to slave a machine parameter to a parameter of another machine. E.g. derive a trigger for gfx from notes. This might need a transformation-function for the slave connection.

What do we need to extend?

Image/Video table

Like the wavetable hold samples, the image/video table would hold single images or video-clips.

Generators

Trackers

Like music tracker trigger samples, these elements would trigger images and video.

Titlers

These elements would produce text to use for overlays.

Analyzers

Generate video from audio (visalisations).

Effects

Mixers

Mix image streams e.g. based on fixed-alpha or by using a third (grayscale) stream for the mix-ratio.

Master

• buzztard needs to handle multiple sinks (audio_sink, video_sink) internally (one master)
• items are connected on the base of their pad-mime-types