I'm not sure if this is beta related or not, but since I'm running the beta server I'll start here.
I'm running Emby on a Ubuntu Linux server with an Geforce GTX 1050 2GB card.
Maybe one out of 5 or 10 times I try to transcode through Emby, the transcoding fails will CUDA_ERROR_OUT_OF_MEMORY: out of memory. Emby will then fall back on software encoding, even when there's too much other load on the box for software encoding to keep up.
I've checked nvidia-smi, and there is nothing else using the card, all 2GB of memory is free. If I restart the transcode, it will usually work. During a successful recording, the ffmpeg process is only using about 200MB out of the 2GB video memory available.
I've tried with both the 418 and 430 drivers.
What could be causing this issue?