Vl.audio breaks vl.mediafoundation

[Hadasi]

I have a video player that uses VL.Mediafoundation and its been working fine. I’ve been asked to add a music player and some sound effect to the installation. By adding VL.Audio (which uses ASIO4All) VLMediaFoundation’s player node does not load any videos or even show the duration of the videos.

Ideally, I would play the audio files from VL.Mediafoundation to compensate, but that doesn’t seem possible. I’m not sure this is possible from VL.GStreamer instead either at the moment, or whether I should convert the audio files into video files for the purpose.

Any suggestions? (I have managed to get irrklang to work but the license is a bit expensive and it feels a bit daft just to play a bit of audio.)

[Hadasi]

To add, there isn’t any error message.

To recreate:
with VL.Mediafoundation [006] and VL.Audio[0.2.4-alpha] installed, run the ‘How to play video’ help patch
reference VL.audio nuget. Add AudioEngine. The media foundation player should freeze.

[Elias]

Hm, just checked and works for me. Was using vvvv gamma preview (2020.3-0045 with Stride), VL.MediaFoundation (0.2.0-stride) and VL.Audio (0.2.4-alpha).
I get a short hickup when adding the AudioEngine node, but after that the ASIO4ALL (v2.14) window pops up in the bottom right corner and all is well from that moment on. Could also open the FFT help patch while the movie was still playing.

[Hadasi]

The issue was in Gamma 2020.2.2, but indeed, it isn’t present in the preview version

[bjoern]

Unfortunately I still encouter this issue. Tested with:

• 2021.4.0-0119
• VL.Video.MediaFoundation.0.0.10-alpha
• VL.Audio.0.2.23-alpha
• ASIO4ALL v.2.15 Beta 1

Here is a demo patch and some test files to demonstrate the issue. Not sure if it is a vvvv bug though because as soon as ASIO4ALL is running videos played in VLC also don’t output any sound, but at least the video part plays fine.

MediaFoundationAudioIssue.7z (591.4 KB)

Thought I had a workaround by using the fruity loops asio driver but it keeps crashing:

Using VL.Audio with Asio4All driver breaks VL.MediaFoundation VideoPlayer

I guess because of exclusive access to the audio device. Seems to work with the Fruity Loops driver. Just as hint / reminder for myself.

[tonfilm]

The solution could be to use FlexASIO in WASAPI shared mode:

GitHub - dechamps/FlexASIO: A flexible universal ASIO driver that uses the...

EDIT: scratch that, there is one bug that needs to be fixed first:

getLatencies() before createBuffers() returns error in violation of ASIO spec (triggers failure in NAudio)

[bjoern]

For reference:

Vl.audio wasapi

Just to let you know. The bug in FlexAsio has been fixed in the latest release. I’ve tried the VL.Audio help patches and all seem to run fine. Only had to set the default Sample Rate to 48000 and Desired Input Channels to 0 on my machine otherwise I’d get exceptions.

[tonfilm]

the latest VL.Audio package has WASAPI driver support.