Samsung TV App playback desync, crash after pausing longer than x-amount of time

[brothom 213]

I've encountered a strange issue that can be reproduced fairly easily.
This seems to only happen on the Samsung TV Emby App though.

* Play any media where your device can Direct Play video, but not audio
In my case HEVC 4K with EAC3 5.1. Make SURE the audio is being transocded.
* View (or seek) at least 5 or 10 minutes
* Pause playback and take a wee, grab something to drink, maybe some snacks too, take longer than 2 minutes, 5 to be sure
* Resume playback
* After resuming playback, within a minute, max 5, you will notice a freeze (for a few seconds)
* After a few more minutes playback will halt and the spinner will start spinning (looks like it's buffering)
* Eventually playback fully freezes, sometimes also freezing the app

I have a suspicion something goes wrong synchronising the transcoded audio to the Direct Play video. The logs just say that playback was stopped.