Transcoding temp files - not deleteing

[thekingswolf 48]

I'm not sure what happened recently, but I checked the server monday and the drive where EMBY was installed was maxed out in capacity.  Looking at the file tree, 80% of storage was in 

 

AppData\Roaming\Emby-Server\programdata\transcoding-temp

 

It's like these temp files aren't being deleted now or something.  I had to manually go into the folder and delete all the files.  Been using Emby a little over a year now, never had this issue until the past few days.

Edited March 29, 2019 by thekingswolf

[Luke 42078]

Hi there, please attach the emby server log from when this happened. Thanks.

[thekingswolf 48]

https://paste.ubuntu.com/p/7KZ9RW2b4g/

[Luke 42078]

What Emby app were you playing with? When you stopped playback, how did you stop?

[thekingswolf 48]

my users use different apps, the transcoding wasn't me it was several other users using several different apps.  the temp files simply aren't auto deleting now

[thekingswolf 48]

this was mainly an issue because for the past year i've been using a 128gb SSD drive as the C drive where windows and the server is installed.  That drive was filling up with these files.  

I bought a samsung 1tb SSD and have now reinstalled everything from scratch on that.  hopefully with more breathing room the files will be clearing out more smoothly from now on.  I'll post again if the issue continues.

Edited April 6, 2019 by thekingswolf

[Luke 42078]

Thanks !

[thekingswolf 48]

they are still building up.  trans-coding temp files are just not being deleted.  files in there still from the fresh install on 4/5.  new log.

 

https://paste.ubuntu.com/p/p5zfX4bZw7/

[thekingswolf 48]

35,419 files and counting....

[Bearbearbear 0]

35,419 files and counting....

 

Happening for me as well.

[Luke 42078]

How did you stop playback?

[thekingswolf 48]

it doesn't make a difference.  and these files are across all users using different apps.  playback is begin stopped using the stop function, or sometimes the movies just plays through til the end until the file ends.  I see no difference in behavior based on methods used to stop playing the file.

 

On april 11th above i had almost 40k files and had to delete them all.  I just checked and i'm back up to 35k files again.

Edited April 17, 2019 by thekingswolf

[NicoLaz 4]

Similar with me: some files in recording-temp are not deleted. I wondered why my volume filled up so quickly. They were all cases where the server had to transcode but the playback was interrupted (DLNA PlayTo). It seems that, the temp files are not deleted properly in some of those cases. Restarting the server helps (folder is emptied), but that's only a temporary solution...

 

Running Emby on a QNAP TS-453A

Edited April 17, 2019 by NicoLaz

[Luke 42078]

it doesn't make a difference.  and these files are across all users using different apps.  playback is begin stopped using the stop function, or sometimes the movies just plays through til the end until the file ends.  I see no difference in behavior based on methods used to stop playing the file.

 

On april 11th above i had almost 40k files and had to delete them all.  I just checked and i'm back up to 35k files again.

 

Can you please go over an example playback session? Thanks.

[samuelqwe 317]

I just ran into this issue today. I was wondering why some metadata wasn’t loading as well as why most of my channels and scheduled recordings had disappeared, but as it turns out, Emby used all the remaining storage on my SSD (~180GB of it) for the temporary transcoding files. Rebooting the server does clear that used space, but that should be done automatically when no one has been on the server for hours.

 

I don’t know exactly when this happened last night or this morning, but I do know that some recordings that were supposed to happen this morning, did in fact not record. It’s truly frustrating to say the least.

 

I get that from time to time, there can be a glitch and something doesn’t stop properly, but there shouldn’t be 180GBs of files that are no longer needed just sitting there. I’m gonna have to run a script to clear that manually, or restart the server daily just to make sure this doesn’t happen again.

 

I would provide a log, but since I have no idea exactly when it happened, I don’t know which log file would contain that information.

Edited May 16, 2019 by samuelqwe

[awade 0]

I too am having this issue of emby using all my storage space and here's the interesting part: I have no media and only use emby for the Live TV (IPTV) feature plus guide data. I'm on Android TV Nvidia Shield and using both server and client there.

I just need to add to this: because I'm on an Nvidia Shield and have limited space with no need for external storage, this has made Emby unusable for me. I love the app (and so does my wife and believe me, that's saying ALOT) but I've had to stop the server and clear the data completely until this issue is resolved.

Edited May 18, 2019 by awade

[Luke 42078]

We're looking into this, thanks for reporting.

[awade 0]

Has this been figured out yet? I'm a premium subscriber but don't want to pay and start using Emby again if my Nvidia Shield disk space is going to max out and lock down my device every day.

[laie_techie 16]

Might need a cron job to run every 15 minutes and delete anything in the transcoding directory modified over 5 hours ago. These values should be configurable based on your needs. I suggested 5 hours to give enough time to watch the transcoded media before deleting. Something more complicated could query the file for content length and do some computation whether enough time has elapsed to have seen it.

 

BTW, solid state drive is a terrible choice for a temp directory as things are constantly being created and deleted; you will wear out your drive relatively quickly.

[Luke 42078]

The issue of the server not always closing live streams after stopping will be resolved in Emby Server 4.2. If you need immediate relief the fixes will be on the beta channel by tomorrow. Thanks.

[awade 0]

Thanks for posting here and letting us know Luke. I'm downloading the beta server for Android TV now. Really happy this has been resolved and thanks for your hard work it's highly appreciated.

[achalmers 3]

Is this still an issue?  I'm running the latest version of Emby and my C drive still keeps getting full.  My transcoding folder is 56GB and has files in it from 4 days ago. 

[Neminem 1518]

I using this script to clean up the Transcoding folder.

@echo off
:: set folder path
set dump_path="path to you transcoding temp files"
 
:: set min age of files and folders to delete
set max_days= days to retain files
 
:: remove files from %dump_path%
forfiles -p %dump_path% -m *.ts -d -%max_days% -c "cmd  /c del /Q @path"

Then i have it setup in task scheduler to run every 1 hour.

I have it set to retain files for 1 day, that should be enough.

Except for Le Mans + pre events & post events.

[Carlo 4561]

Just curious why do you care about the days?  If it's not locked and one hour old or so it should be fine to delete.  If Emby is still using the file it will be locked and you can't delete it.

[Neminem 1518]

I had the impression that emby would use the files, for rewind.

Was not sure, if the files would be locked, if a user would rewind.