Google Drive times out sending file

[intellium 7]

Hi,

 

I seem to have hit some kind of weird timeout thing using Google Drive plugin to sync media. If I sync my TV shows, it works fine, no issues what so ever. Syncing per episode takes around 6 mins to upload.

 

However, when I try the same with movies, I hit an exception every single time around the 9 min. mark. This happens for every single movie I try. As I havent had any episode which took that long to upload, im unable to determine if it's definately time related, but it seems so. It complains about not finding the file in the temporary folder, but seemingly takes around 9 mins to notice that. Anybody have any clue as to whats going on ?

 

Running on the latest docker emby (beta) container. See attached relevant server log entries for a sync of a single movie:

2016-08-19 21:45:19.4093 Debug App: Sending /myth/movies/Movies/Divergent Series Allegiant, The/The Divergent Series Allegiant.mkv to Google Drive. Remote path: MIT-Emby/Original-High/Videos/Allegiant/The Divergent Series Allegiant.mkv
2016-08-19 21:45:19.4450 Debug GoogleDrive: Sending file MIT-Emby/Original-High/Videos/Allegiant/The Divergent Series Allegiant.mkv to Emby Cloud
2016-08-19 21:55:01.3254 Error App: Error transferring sync job file
        *** Error Report ***
        Version: 3.1.113.0
        Command line: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe -programdata /config -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartpath /usr/lib/emby-server/restart.sh
        Operating system: Unix 4.1.27.24
        Processor count: 24
        64-Bit OS: True
        64-Bit Process: True
        Program data path: /config
        Mono: 4.4.1 (Nightly 4.4.1.0/4747417 Fri Jul  1 11:23:27 UTC 2016)
        Application Path: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe
        Couldn't find file 0B_3GFeojOKVVR0VHOTlYY3RkMXM/The Divergent Series Allegiant.mkv
        System.IO.FileNotFoundException
          at MediaBrowser.Plugins.GoogleDrive.GoogleDriveService+<FindFileId>d__47.MoveNext () <0x402a0900 + 0x0055b> in <filename unknown>:0
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f6dfaea9ea0 + 0x00029> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f6dfaea7d60 + 0x000b3> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f6dfaea7cc0 + 0x00093> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f6dfaea7c70 + 0x0003a> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter`1[TResult].GetResult () <0x7f6dfaea80a0 + 0x00017> in <filename unknown>:0
          at MediaBrowser.Plugins.GoogleDrive.GoogleDriveService+<UploadFile>d__17.MoveNext () <0x402eeda0 + 0x00b9e> in <filename unknown>:0
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f6dfaea9ea0 + 0x00029> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f6dfaea7d60 + 0x000b3> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f6dfaea7cc0 + 0x00093> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f6dfaea7c70 + 0x0003a> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter`1[TResult].GetResult () <0x7f6dfaea80a0 + 0x00017> in <filename unknown>:0
          at MediaBrowser.Plugins.GoogleDrive.GoogleDriveServerSyncProvider+<SendFile>d__1.MoveNext () <0x402ee210 + 0x00372> in <filename unknown>:0
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f6dfaea9ea0 + 0x00029> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f6dfaea7d60 + 0x000b3> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f6dfaea7cc0 + 0x00093> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f6dfaea7c70 + 0x0003a> in <filename unknown>:0
          at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x7f6dfaea84e0 + 0x00017> in <filename unknown>:0
          at MediaBrowser.Server.Implementations.Sync.MediaSync+<SendFile>c__async6.MoveNext () <0x402ed2d0 + 0x008c8> in <filename unknown>:0
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f6dfaea9ea0 + 0x00029> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f6dfaea7d60 + 0x000b3> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f6dfaea7cc0 + 0x00093> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f6dfaea7c70 + 0x0003a> in <filename unknown>:0
          at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x7f6dfaea84e0 + 0x00017> in <filename unknown>:0
          at MediaBrowser.Server.Implementations.Sync.MediaSync+<GetItem>c__async3.MoveNext () <0x402e9000 + 0x00a2a> in <filename unknown>:0

2016-08-19 21:55:01.5673 Error App: Error syncing item
        *** Error Report ***
        Version: 3.1.113.0
        Command line: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe -programdata /config -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartpath /usr/lib/emby-server/restart.sh
        Operating system: Unix 4.1.27.24
        Processor count: 24
        64-Bit OS: True
        64-Bit Process: True
        Program data path: /config
        Mono: 4.4.1 (Nightly 4.4.1.0/4747417 Fri Jul  1 11:23:27 UTC 2016)
        Application Path: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe
        Couldn't find file 0B_3GFeojOKVVR0VHOTlYY3RkMXM/The Divergent Series Allegiant.mkv
        System.IO.FileNotFoundException
          at MediaBrowser.Plugins.GoogleDrive.GoogleDriveService+<FindFileId>d__47.MoveNext () <0x402a0900 + 0x0055b> in <filename unknown>:0
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f6dfaea9ea0 + 0x00029> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f6dfaea7d60 + 0x000b3> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f6dfaea7cc0 + 0x00093> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f6dfaea7c70 + 0x0003a> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter`1[TResult].GetResult () <0x7f6dfaea80a0 + 0x00017> in <filename unknown>:0
          at MediaBrowser.Plugins.GoogleDrive.GoogleDriveService+<UploadFile>d__17.MoveNext () <0x402eeda0 + 0x00b9e> in <filename unknown>:0
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f6dfaea9ea0 + 0x00029> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f6dfaea7d60 + 0x000b3> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f6dfaea7cc0 + 0x00093> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f6dfaea7c70 + 0x0003a> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter`1[TResult].GetResult () <0x7f6dfaea80a0 + 0x00017> in <filename unknown>:0
          at MediaBrowser.Plugins.GoogleDrive.GoogleDriveServerSyncProvider+<SendFile>d__1.MoveNext () <0x402ee210 + 0x00372> in <filename unknown>:0
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f6dfaea9ea0 + 0x00029> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f6dfaea7d60 + 0x000b3> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f6dfaea7cc0 + 0x00093> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f6dfaea7c70 + 0x0003a> in <filename unknown>:0
          at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x7f6dfaea84e0 + 0x00017> in <filename unknown>:0
          at MediaBrowser.Server.Implementations.Sync.MediaSync+<SendFile>c__async6.MoveNext () <0x402ed2d0 + 0x008c8> in <filename unknown>:0
        --- End of stack trace from previous location where exception was thrown ---
          at MediaBrowser.Server.Implementations.Sync.MediaSync+<GetItem>c__async3.MoveNext () <0x402e9000 + 0x0199f> in <filename unknown>:0
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f6dfaea9ea0 + 0x00029> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f6dfaea7d60 + 0x000b3> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f6dfaea7cc0 + 0x00093> in <filename unknown>:0
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f6dfaea7c70 + 0x0003a> in <filename unknown>:0
          at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () <0x7f6dfaea82e0 + 0x00012> in <filename unknown>:0
          at MediaBrowser.Server.Implementations.Sync.MediaSync+<GetNewMedia>c__async2.MoveNext () <0x402b6fa0 + 0x00c63> in <filename unknown>:0

[Luke 37060]

Hi, do you know how large the file is? We're currently aware of some issues transferring files that are larger than 2gb. thanks.

[intellium 7]

This one is 4.2 GB. 

Any workaround for syncing the large files ?

 

(Thanks for the quick reply )

[Luke 37060]

Right now you'll have to configure the quality so that the size is reduced. We will be reviewing this issue soon to work on resolving it. Thanks.

[intellium 7]

I see. I'll be awaiting the fix

Thanks for the info.

[intellium 7]

Is there any update regarding this issue? Can I help by providing more info? Do I need to create an issue on github for this ?

[Luke 37060]

Not yet. It is on our list for review. Thank you for your patience.

[intellium 7]

I tried circumventing it by manually uploading the larger (original) files, but that wont work seeing as I need to update the data.json file with the correct info, which seems like a lot of work. 

Perhaps I can try and script something to do this all outside of Emby, as it seems that everything can upload the larger files except Emby. 

Has anyone been looking at this issue, or has a clue on where to start looking?

[Luke 37060]

It's in our queue for review. We'll update when we know more. Thanks.

[intellium 7]

Some more info;

 

Running on Windows, everything seems to sync just fine (Just synced a 15GB Movie without issues). So the problem seems to be related to Linux / Mono ?

[Luke 37060]

Interesting, that's good info, thanks.

[intellium 7]

If you have any pointers on where to start looking, I'll see what I can do to fix this. Just did a few C# tutorials, this could be a nice exercise

[Luke 37060]

Unfortunately the issue reproduces in linux but not windows, so there is a possibility the problem is in the mono runtime. I have to take another look and see if there's a way to work around it for now.