ABR for files that have multiple video tracks

[johoja12 4]

A lot of my content I've reencoded to have multiple video tracks ( as well as audio tracks ) to allow for ABR.

 

I usually keep the original video, and original audio ( i.e 1080 h264, 10,000 Kb/s bitrate, and DTS audio ) but also i create an addtional track on with aac , 2 channel audio, and 2,000 Kb/s h264 720p. 

 

Example ffprobe :

    Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709/bt709/unknown), 1920x800, 17892 kb/s, SAR 1:1 DAR 12:5, 23.98 fps, 23.98 tbr, 16k tbn, 47.95 tbc (default)
    Metadata:
      handler_name    : VideoHandler
    Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 258 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
    Stream #0:2(eng): Audio: ac3 (ac-3 / 0x332D6361), 48000 Hz, 5.1(side), fltp, 640 kb/s
    Metadata:
      handler_name    : SoundHandler
    Side data:
      audio service type: main
    Stream #0:3(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 62 kb/s
    Metadata:
      handler_name    : SoundHandler
    Stream #0:4(eng): Subtitle: mov_text (tx3g / 0x67337874), 0 kb/s (default)
    Metadata:
      handler_name    : SubtitleHandler
    Stream #0:5(eng): Subtitle: mov_text (tx3g / 0x67337874), 0 kb/s
    Metadata:
      handler_name    : SubtitleHandler
    Stream #0:6(eng): Subtitle: mov_text (tx3g / 0x67337874), 0 kb/s
    Metadata:
      handler_name    : SubtitleHandler
    Stream #0:7(chi): Subtitle: mov_text (tx3g / 0x67337874), 0 kb/s
    Metadata:
      handler_name    : SubtitleHandler
    Stream #0:8(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1280x534 [SAR 801:800 DAR 12:5], 1984 kb/s, 23.98 fps, 23.98 tbr, 24k tbn, 47.95 tbc (default)

My request is for the Android TV app to be able to do ABR based on these types of files -- I know ExoPlayer does support it of out of the box not sure if that is what you guys are using but if it it is - it should be easy to add support for this! 

 

[ebr 16169]

Hi.  What situation is your Android TV device in where it would need to adapt the bitrate on the fly?

[embycities 0]

-delete- 

Edited August 3, 2018 by embycities

[johoja12 4]

Hi.  What situation is your Android TV device in where it would need to adapt the bitrate on the fly?

The server itself is not local - hence at the mercy of internet routing which in some cases can be great, and in other cases not great. ABR helps alleviate that pressure.

 

 

Also probably not specific to Android TV

[ebr 16169]

Okay, well, I believe ABR will require a form of streaming such as HLS (which is okay, that's what we use when we need to transcode or remux) but that also means that we'd need to force a remux in this situation and also would need to have the server understand and send on both video streams.

 

So, interesting idea but some work to do before it could be a reality.

 

Thanks.

[johoja12 4]

Okay, well, I believe ABR will require a form of streaming such as HLS (which is okay, that's what we use when we need to transcode or remux) but that also means that we'd need to force a remux in this situation and also would need to have the server understand and send on both video streams.

 

So, interesting idea but some work to do before it could be a reality.

 

Thanks.

 

Yeah HLS with the different tracks as part of the playlist would let you do that, and of course remux would be needed -- but remux trumps a full transcode.

 

Yeah I knew it was a long shot I figured I'd put it in and see what you guys think