Tone Mapping not applied on my clients

[KrakaClue 1]

Hi everyone,

I have a problem with the new feature "Tone Mapping" on my Windows server. I will try to give you all the information about my setup and tests:

"Server" specs:

Intel i5-8400 with iGPU UHD 630 and 16GB RAM

Emby lifetime subscription

All hardware and software transcoding is active (standard hardware transcoding work flawlessly with any clients).

Tested Clients:

1. Roku Streaming stick + 4k with no-HDR 1080p Monitor (emby client forced to maximum 8Mbps streaming)
2. Macbook Pro 2020 with HDR Display - Emby on Chrome Browser (emby client forced to maximum 8Mbps streaming)
3. Macbook Pro 2020 with HDR Display - Emby with Infuse Application --> This config guarantees direct HDR (emby client forced to maximum 8Mbps streaming)

Tested Video:

Spoiler

Dimension: 19172MB

Codec: HEVC

Profile: Main 10

Level: 153

Resolution: 3840x1608

Aspect Ratio: 160:67

Interlaced: No

Framerate: 23.976

Bitrate: 11,386 kbps

Video Range: HDR10

Color Primaries: bt2020

Color Spacebt: 2020nc

Color Transfer: smpte2084

Bit Depth: 10 bit

Pixel Format: yuv420p10le

Reference Frames: 1

 

Problem:

ToneMapping does not work with clients who needs SDR streaming, all colours looks washed out.

An example of video output in case 3:

An example of video output in case 1 and 2:

I took this video as reference because everyone know this scene, anyway I tested some other Movies with the same results.

LOG file:

>>>>>>  User policy for ########
        EnablePlaybackRemuxing: True
        EnableVideoPlaybackTranscoding: True
        EnableAudioPlaybackTranscoding: True

>>>>>>  Affected codecs
Encoder QuickSync Intel(R) UHD Graphics 630 - D3D11 - H.264 (AVC)
        Adapter #0: 'Intel(R) UHD Graphics 630 - D3D11' Id:16018 (Driver: , Vendor: 32902, SDK Version: 1.27)
        Frame Sizes: 32x32...8192x8192 - Width Alignment: 16 - Height Alignment: 16
        Color Formats: NV12, P010, QSV
        Profiles: Baseline Profile (Level 5.2), Main Profile (Level 5.2), High Profile (Level 5.2)

Decoder QuickSync Intel(R) UHD Graphics 630 - D3D11 - H.265 (HEVC)
        Adapter #0: 'Intel(R) UHD Graphics 630 - D3D11' Id:16018 (Driver: , Vendor: 32902, SDK Version: 1.27)
        Frame Sizes: 16x16...16384x16384 - Width Alignment: 2 - Height Alignment: 2
        Profiles: Main Profile (Level 6.2), Main 10 Profile (Level 6.2), Main Still Picture (Level 6.2)


>>>>>>  FindVideoEncoder - Media: h264, UseHardwareCodecs: True, Mode: Automatic
Info    Checking: 'QuickSync Intel(R) UHD Graphics 630 - D3D11 - H.264 (AVC)'
Info    Check successful - selecting 'QuickSync Intel(R) UHD Graphics 630 - D3D11 - H.264 (AVC)'

>>>>>>  FindVideoDecoder - MediaType: hevc, Mode: Automatic
Info    Checking: 'QuickSync Intel(R) UHD Graphics 630 - D3D11 - H.265 (HEVC)'
Info    Check successful - selecting 'QuickSync Intel(R) UHD Graphics 630 - D3D11 - H.265 (HEVC)'

>>>>>>  Processing Plan
Info    Name                                        CanDoInHardware      WillDoInHardware     Reason                                  
Info    QuickSync Intel(R) UHD Graphics 630 -... >> True                 True                 Hardware Codec                           
Info    VideoInput                               >> True                 True                 Same adapter Id (0), same hardware co... 
Info    Scaling                                  >> True                 True                                                          
Info    ToneMapping (when possible)              >> True                 True                                                          
Info    VideoOutput                              >> True                 True                 Hardware encoder                         
Info    QuickSync Intel(R) UHD Graphics 630 -... >> True                 True                 Hardware Codec                           

>>>>>>  Projected Processing Formats
Info    Previous                HW-Context   Format       SW-Format           Size   Next
Info    hevc_qsv             >> QSV          qsv          p010           3840x1608 >> vpp_qsv
Info    vpp_qsv              >> QSV          qsv          bgra             640x268 >> setparams
Info    setparams            >> QSV          qsv          bgra             640x268 >> hwmap
Info    hwmap                >> OPENCL       opencl       bgra             640x268 >> supertonemap_opencl
Info    supertonemap_opencl  >> OPENCL       opencl       bgra             640x268 >> hwmap
Info    hwmap                >> QSV          qsv          bgra             640x268 >> 

Can you help me with this problem?

[Carlo 4561]

Hi, right now only the server is tone mapping "smart" but the clients haven't been updated yet to take advantage of HDR->SDR.  Once this happens you shouldn't have to force bitrates to get tone mapping on the client side.

But for right now, let's see if we can figure this out for you.  Can you show us the Media Info section for that movie?
Bottom of the detail screen for the movie.

[KrakaClue 1]

47 minutes ago, cayars said:

Hi, right now only the server is tone mapping "smart" but the clients haven't been updated yet to take advantage of HDR->SDR.  Once this happens you shouldn't have to force bitrates to get tone mapping on the client side.

But for right now, let's see if we can figure this out for you.  Can you show us the Media Info section for that movie?
Bottom of the detail screen for the movie.

Hi Cayars,

Thank you for the information, I did not know only the server was tone mapping ready so far. So my question is: are there any clients except Roku and WebBrowser that support HDR>>SDR nowadays?

About your second question, the media info is:

Dimension: 19172MB
Codec: HEVC
Profile: Main 10
Level: 153
Resolution: 3840x1608
Aspect Ratio: 160:67
Interlaced: No
Framerate: 23.976
Bitrate: 11,386 kbps
Video Range: HDR10
Color Primaries: bt2020
Color Spacebt: 2020nc
Color Transfer: smpte2084
Bit Depth: 10 bit
Pixel Format: yuv420p10le
Reference Frames: 1

Best regards

[Carlo 4561]

Yes, I know the Shield TV & MiBox S can do HDR->SDR tone mapping.  I'd have to check the Firestick 4K as I'm not sure on that one. Likely others as well but those are ones I have.
But in order for those boxes to perform their magic they need to direct play the media.

That's where a bit of smarts are needed in the clients which is coming. The clients need to know if the hardware can play the HDR natively or if the hardware can tone-map itself. Then knowing that it can force a tone-map transcode if needed for systems that can't handle it on their own.

But of course it's not quite that simple as there are different HDR formats that complicate things as well as profile levels. With so many different combinations it's not so easy to do. 

[Luke 42083]

Hi @KrakaClue, has this answered your questions?

[KrakaClue 1]

2 hours ago, Luke said:

Hi @KrakaClue, has this answered your questions?

Yes it is! I realised there is no solution nowadays to see HDR content on Roku (even with direct play) on non-HDR monitor. I hope to see some updates in the future