Live TV (ATSC/HDHomeRun): CEA-608 captions dropped by hardware (VAAPI) transcodes; Apple TV player

[bmoon 0]

## Environment
- Caption stream metadata: `Codec: eia_608, IsTextSubtitleStream: true, SubtitleLocationType: VideoSideData`, index 100.

It looks like AVPlayer's caption parsing for in-band 608 in a **progressive MPEG-2 TS** decodes the initial buffer and never processes subsequent caption data (in-band 608 handling is well supported for HLS/H.264 SEI; the progressive-MPEG-2-TS case appears unhandled or stalled).

## Finding 3 — no extraction fallback for live TV

Every `live.m3u8` request in the session log (all clients, ~18k requests) negotiate `SubtitleMethod=VideoSideData&VideoSideDataSubs=100&ManifestSubtitles=vtt` — i.e. captions are only ever carried **in-band**, and the `ManifestSubtitles=vtt` request never yields a WebVTT rendition for live streams. The transcode commands carry `-sn`. Server user policies expose no burn-in option per user. So when the in-band carrier is lost (Finding 1) or the player can't decode it (Finding 2), there is no third path — **a 608 → WebVTT extraction option for live TV would resolve all of the above**.

## Workaround that works today

Set the Apple TV app's player to **MVP** (the mpv-based player) and DirectStream the source (Max quality). mpv decodes the EIA-608 captions in software from the raw TS and renders them live:

- Captions update continuously (verified minutes at a time)
- Zero server transcode — the MPEG-2 stream is played as-is
- Quirk: after starting a session, the caption track sometimes needs to be re-selected (CC off → CC1) before mpv begins decoding — first selection at stream start appears to bind before caption decoding attaches

Android-family apps also expose a player choice; the same mpv route should fix captions there.

## Requests (in priority order)

1. **A53/CEA-608 caption injection for hardware H.264 encoders** in the transcode pipeline (VAAPI/QSV/NVENC), or transparent caption carry-over where the encoder supports user data — closes the silent caption loss for all HW-transcoding clients.
2. **Live TV subtitle extraction (608/708 → WebVTT)** as a server fallback when captions can't ride in-band — would rescue every affected client/player combination, including AVPlayer.
3. Investigate **in-band 608 decode stall in the Apple TV native player** on DirectStream of live MPEG-2 TS (Finding 2).
4. (Minor) AMD VAAPI intermittent `Access unit too large / Encode failed: -28` on live HLS transcodes, which surfaces the otherwise-unreachable software fallback.

Happy to attach the full ffmpeg transcode logs and session log excerpts on request.

[Luke 43239]

 

Hi there, let's look at an example. Please attach the information requested in how to report a media playback issue. Thanks!

 

[bmoon 0]

Logs.

ffmpeg-transcode-f09a8bba-1e9d-45ec-8dc0-ff78330490f8_1.txt ffmpeg-transcode-cbc4cc07-cba5-4818-a3f7-39a68c52b914_1.txt ffmpeg-transcode-92c2afb5-97d0-4eff-a555-3e16ae316f77_1.txt ffmpeg-transcode-8fdfd1c5-c441-42f6-8b93-144196d848ad_1.txt ffmpeg-transcode-3f2de129-de14-4e3c-9cbc-37aad14a094f_1.txt ffmpeg-transcode-1b9bce19-26d5-4a4f-ac3e-2e58ddad6f67_1.txt ffmpeg-transcode-12f09438-af02-4dfc-a02f-6567ffa32a65_1.txt ffmpeg-transcode-058ccb33-06f9-4de9-9c37-d9a87da322b9_1.txt ffmpeg-directstream-b071340c-beab-4dea-864f-a4f39a3a167e_1.txt embyserver.txt