Auto Organize Plugin seems to copy instead of move

[b0mb 35]

Hi!

 

For some weeks the auto organize plugin seems to copy instead of moving files.

 

All files are handled on my unraid cache disk. Processing new files usually was done in a few seconds but for a few weeks this takes ages and it looks like the plugin does copy the files.

 

It also seems to stop logging after processing the first file and than it writes constantly data to my cachedisk in unraid with 5 - 6 MB/s.

 

Pls find the logfile attached.

 

b0mb

Neues Textdokument.7z

[Luke 37022]

Have you explored the auto-organize plugin settings?

[b0mb 35]

Have you explored the auto-organize plugin settings?

yes! i guess so....

 

i´m using this for a long time and never had such a problem it suddenly started and i didn´t change anything...

Edited January 25, 2018 by b0mb

[Luke 37022]

Do you see any settings in the auto-organize configuration that might affect this?

[b0mb 35]

Do you see any settings in the auto-organize configuration that might affect this?

nah... same configuration like i´ve used the last 12 month.... 

 

it also works when i move the files by hand using midnight commander from the shell

 

what´s also interesting is that emby stops logging at the end and does always show the same line....

 

 

 

Edited January 25, 2018 by b0mb

[Luke 37022]

Ok so in the screenshot you've already configured the Transfer method to Move instead of copy.

 

I don't think there's anything we can do about this. It is probably just the way the runtime handles the file move for your platform and file system. I know on other platforms it definitely does a move.

[b0mb 35]

But it did also work for me in the past....is there any way for me to prove this?

 

the problems might began when autoorganize became a plugin....

Edited January 25, 2018 by b0mb

[Luke 37022]

The plugin is a community addition and contributions are welcome. If you look at the code it's very simple:

 

https://github.com/MediaBrowser/Emby.AutoOrganize/blob/master/Emby.AutoOrganize/Core/EpisodeFileOrganizer.cs#L560-L567

 

It picks File.Copy or File.Move. How the runtime handles File.Move is not something we can control.

[b0mb 35]

oki 

 

and how about that emby stopps logging and shows that library error?

[Luke 37022]

Can you show me an example? thanks.

[b0mb 35]

Can you show me an example? thanks.

2018-01-25 20:03:10.242 Info TaskManager: Executing Organize new media files
2018-01-25 20:03:10.242 Info HttpServer: HTTP Response 204 to 192.168.178.24. Time: 13ms. http://192.168.178.21:8888/emby/ScheduledTasks/Running/1ec5b785c4111045fc22055e467e2fff 
2018-01-25 20:03:10.255 Info HttpServer: HTTP GET http://192.168.178.21:8888/emby/ScheduledTasks?IsEnabled=true. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36
2018-01-25 20:03:10.259 Info HttpServer: HTTP Response 200 to 192.168.178.24. Time: 5ms. http://192.168.178.21:8888/emby/ScheduledTasks?IsEnabled=true 
2018-01-25 20:03:10.531 Info App: Sorting file /mnt/downloads/Download/!Serien/Supernatural.S12E20.Der.Fall.Tasha.Banes.German.DL.DD51.Dubbed.1080p.BluRay.x264.REPACK-GDR/Supernatural.S12E20.Der.Fall.Tasha.Banes.German.DL.DD51.Dubbed.1080p.BluRay.x264.REPACK-GDR.mkv
2018-01-25 20:03:10.704 Debug App: Extracted information from /mnt/downloads/Download/!Serien/Supernatural.S12E20.Der.Fall.Tasha.Banes.German.DL.DD51.Dubbed.1080p.BluRay.x264.REPACK-GDR/Supernatural.S12E20.Der.Fall.Tasha.Banes.German.DL.DD51.Dubbed.1080p.BluRay.x264.REPACK-GDR.mkv. Series name Supernatural, Season 12, Episode 20
2018-01-25 20:03:10.785 Info App: Sorting file /mnt/downloads/Download/!Serien/Supernatural.S12E20.Der.Fall.Tasha.Banes.German.DL.DD51.Dubbed.1080p.BluRay.x264.REPACK-GDR/Supernatural.S12E20.Der.Fall.Tasha.Banes.German.DL.DD51.Dubbed.1080p.BluRay.x264.REPACK-GDR.mkv into series /mnt/Serien/!Serien/Supernatural (2005)
2018-01-25 20:03:10.818 Info HttpServer: HTTP GET http://192.168.178.21:8888/emby/Library/FileOrganization?StartIndex=0&Limit=50. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36
2018-01-25 20:03:10.822 Info HttpServer: HTTP Response 200 to 192.168.178.24. Time: 5ms. http://192.168.178.21:8888/emby/Library/FileOrganization?StartIndex=0&Limit=50 
2018-01-25 20:03:11.049 Info HttpClient: GET: https://api.themoviedb.org/3/tv/1622/season/12/episode/20?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=images,external_ids,credits,videos&language=de&include_image_language=de,null,en
2018-01-25 20:03:12.187 Debug JsonSerializer: Deserializing file /config/cache/tmdb-tv/1622/season-12-episode-20-de.json
2018-01-25 20:03:12.219 Info HttpClient: GET: https://www.omdbapi.com?apikey=fe53f97e&plot=full&r=json&i=tt0460681&Episode=20&Season=12
2018-01-25 20:03:13.314 Info App: Sorting file /mnt/downloads/Download/!Serien/Supernatural.S12E20.Der.Fall.Tasha.Banes.German.DL.DD51.Dubbed.1080p.BluRay.x264.REPACK-GDR/Supernatural.S12E20.Der.Fall.Tasha.Banes.German.DL.DD51.Dubbed.1080p.BluRay.x264.REPACK-GDR.mkv to new path /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.712 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.713 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.713 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.714 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.714 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.714 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.714 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.715 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.715 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.715 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.716 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.716 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.716 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.717 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.717 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.717 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.718 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.718 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv
2018-01-25 20:03:13.718 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv

[Luke 37022]

What error are you referring to?

[b0mb 35]

What error are you referring to?

2018-01-25 20:03:13.718 Debug LibraryMonitor: Ignoring change to /mnt/Serien/!Serien/Supernatural (2005)/Season 12/Supernatural - S12E20 - Der Fall Tasha Banes.mkv

that line is constantly written to the logfile until i restart the container ....

[Luke 37022]

We will remove those logging lines, thanks.

[b0mb 35]

ok

 

and what belongs to the moving problem i think i´ll open a thread in unraid forum....

[b0mb 35]

@@Luke

 

Is there any chance to prove this from your side?

 

I've also tried to move a file using Mixplorer on my Android phone and sftp connection which also works as moving files using midnight commander... Actually only Emby seems to copy instead of moving the files. I might try filebot when I find some time.

 

I've never had such a problem with the auto organize Plugin in the past.... Hmm

 

Edit:

 

Btw i forgot to say... The files will be moved but not like they should when they are stored on the same drive. That's the problem I have. The files are moved like copying.... Or with copying speed

 

Gesendet von meinem Redmi Note 3 mit Tapatalk

Gui

Edited January 26, 2018 by b0mb

[Luke 37022]

The auto-organize plugin is a community addition. Right now I am just not able to dedicate that kind of time towards it. It would be great if a community member could help out with it, however, I'm pretty certain about this situation.

[b0mb 35]

The auto-organize plugin is a community addition. Right now I am just not able to dedicate that kind of time towards it. It would be great if a community member could help out with it, however, I'm pretty certain about this situation.

just tried filebot and it acts exactly like emby when moving... so it really might be an unraid problem - i´ve allready opened a thread there...

 

but we still have the problem that the logfile is constantly written after scanning the first file....

[Luke 37022]

See, there you go

[b0mb 35]

@@Luke

 

meanwhile i´ve found out that my problem is related to the acutal emby docker container or .dotnet

 

I´ve tried the latest build 3.2.70 with the container from linuxserver.io which is based on alpine linux and also mono.

 

... and everything works with this container like it used to work in the past. the files beeing processed are moved within seconds

 

Shall @@alucryd take a look at this?

Edited January 28, 2018 by b0mb

[Luke 37022]

No, there's nothing he can do about it. It probably needs to be reported on the dotnet core repo, but of course, I'm not just going to open a ticket without first putting together some samples and some proof.

 

If you want to open a ticket with your own github username saying "X doesn't work", then feel free. Maybe someone will respond and confirm that it is or isn't' expected.

 

One more thing - have you by chance setup your emby libraries with smb:// paths?

[b0mb 35]

yep!

 

my path are set with smb:// and i am not sure if the problem is .dotnet related.

 

I´ve tried moving files with filebot last friday and the process was the same like with actual docker container. (it doesn´t use .dotnet)

 

Maybe the problem is related to the base system used for the container or is this still suse in your docker containers?

Edited January 28, 2018 by b0mb

[Luke 37022]

Ok then this is actually Emby related because support for the SMB protocol is handled by a library we're embedding, and not by the runtime.

 

However - considering this is only affecting the auto-organize plugin, it is not something I'm going to be able to look at right now, sorry. Perhaps in the future.

[b0mb 35]

Oki... I think that might be the problem as I can say that the last mono builds also didn't work.

 

I would really appreciate if you would fix this is the near future ;-)

 

Gesendet von meinem Redmi Note 3 mit Tapatalk

Edited January 29, 2018 by b0mb

[mutu310 70]

Is this related to this issue which is still unsolved? https://emby.media/community/index.php?/topic/45616-inconvenience-in-auto-organise/