Again with "Type definitions should start with a"

[NomadCF 15]

I'm again getting this error I've tired the fallowing to correct it.

• Delete library.db &  refreshinfo.db (after stopping emby and verifying no process was running in the bg)
• Delete all scheduled tasks (after stopping emby and verifying no process was running in the bg)
• Deleted all sync copies/versions of my files and any/all configs for "folder sync"

2016-01-02 00:28:29.6326 Error App: Error
	*** Error Report ***
	Version: 3.0.5800.3
	Command line: C:\Users\Gaming\AppData\Roaming\Emby-Server\System\MediaBrowser.ServerApplication.exe
	Operating system: Microsoft Windows NT 6.1.7601 Service Pack 1
	Processor count: 4
	64-Bit OS: True
	64-Bit Process: False
	Program data path: C:\Users\Gaming\AppData\Roaming\Emby-Server
	Application Path: C:\Users\Gaming\AppData\Roaming\Emby-Server\System\MediaBrowser.ServerApplication.exe
	Type definitions should start with a '{', expecting serialized type 'MediaSourceInfo', got string starting with: "{\"Protocol\":"File",\"Id\":"a8c4dc18c09a8de00dd5
	System.Runtime.Serialization.SerializationException
	   at ServiceStack.Text.Common.DeserializeTypeRefJson.StringToType(TypeConfig typeConfig, String strType, EmptyCtorDelegate ctorFn, Dictionary`2 typeAccessorMap)
	   at ServiceStack.Text.Common.DeserializeType`1.<>c__DisplayClass3.<GetParseMethod>b__1(String value)
	   at ServiceStack.Text.Json.JsonReader`1.Parse(String value)
	   at ServiceStack.Text.JsonSerializer.DeserializeFromString[T](String value)
	   at MediaBrowser.Common.Implementations.Serialization.JsonSerializer.DeserializeFromString[T](String text)
	   at MediaBrowser.Server.Implementations.Sync.SyncRepository.GetJobItem(IDataReader reader)
	   at MediaBrowser.Server.Implementations.Sync.SyncRepository.GetJobItemReader[T](SyncJobItemQuery query, String baseSelectText, Func`2 itemFactory)
	   at MediaBrowser.Server.Implementations.Sync.SyncRepository.GetJobItems(SyncJobItemQuery query)
	   at MediaBrowser.Server.Implementations.Sync.SyncManager.GetJobItems(SyncJobItemQuery query)
	   at MediaBrowser.Server.Implementations.Sync.SyncJobProcessor.<EnsureJobItems>d__b.MoveNext()
	--- End of stack trace from previous location where exception was thrown ---
	   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
	   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
	   at MediaBrowser.Server.Implementations.Sync.SyncJobProcessor.<EnsureSyncJobItems>d__46.MoveNext()
	--- End of stack trace from previous location where exception was thrown ---
	   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
	   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
	   at MediaBrowser.Server.Implementations.Sync.SyncJobProcessor.<SyncJobItems>d__53.MoveNext()
	--- End of stack trace from previous location where exception was thrown ---
	   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
	   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
	   at MediaBrowser.Server.Implementations.Sync.SyncManager.<GetReadySyncItems>d__64.MoveNext()
	--- End of stack trace from previous location where exception was thrown ---
	   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
	   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
	   at MediaBrowser.Server.Implementations.Sync.MediaSync.<GetNewMedia>d__1f.MoveNext()
	--- End of stack trace from previous location where exception was thrown ---
	   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
	   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
	   at MediaBrowser.Server.Implementations.Sync.MediaSync.<Sync>d__3.MoveNext()
	--- End of stack trace from previous location where exception was thrown ---
	   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
	   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
	   at MediaBrowser.Server.Implementations.Sync.MultiProviderSync.<Sync>d__a.MoveNext()
	--- End of stack trace from previous location where exception was thrown ---
	   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
	   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
	   at MediaBrowser.Common.Implementations.ScheduledTasks.ScheduledTaskWorker.<ExecuteInternal>d__c.MoveNext()
	
2016-01-02 00:28:29.6326 Info App: Cloud & Folder Sync Failed after 0 minute(s) and 11 seconds

PS. I think we really need a timeout in emby for everything/anything that tried to "call home" to emby.media. I was unable to load a few different parts of my emby servers due to it being unable to connect to emby.media today. 

[NomadCF 15]

And now I'm getting this error on a brand new server setup. different hardware, OS, everything.

2016-01-03 20:10:18.9328 Error App: Error
	*** Error Report ***
	Version: 3.0.5800.3
	Command line: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe -programdata /var/lib/emby-server -restartpath /usr/lib/emby-server/restart.sh
	Operating system: Unix 3.16.0.4
	Processor count: 8
	64-Bit OS: True
	64-Bit Process: True
	Program data path: /var/lib/emby-server
	Mono: 4.2.1 (Stable 4.2.1.102/6dd2d0d Thu Dec  3 03:58:58 UTC 2015)
	Application Path: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe
	Type definitions should start with a '{', expecting serialized type 'MediaSourceInfo', got string starting with: "{\"Protocol\":"File",\"Id\":"611cae1b44dddc3d2651
	System.Runtime.Serialization.SerializationException
	  at ServiceStack.Text.Common.DeserializeTypeRefJson.StringToType (ServiceStack.Text.TypeConfig typeConfig, System.String strType, ServiceStack.EmptyCtorDelegate ctorFn, System.Collections.Generic.Dictionary`2 typeAccessorMap) <0x409c0000 + 0x00f8b> in <filename unknown>:0 
	  at ServiceStack.Text.Common.DeserializeType`1+<>c__DisplayClass3[TSerializer].<GetParseMethod>b__1 (System.String value) <0x409bf830 + 0x0002f> in <filename unknown>:0 
	  at ServiceStack.Text.Json.JsonReader`1[T].Parse (System.String value) <0x409a98c0 + 0x001d4> in <filename unknown>:0 
	  at ServiceStack.Text.JsonSerializer.DeserializeFromString[T] (System.String value) <0x409a8dc0 + 0x0005f> in <filename unknown>:0 
	  at MediaBrowser.Common.Implementations.Serialization.JsonSerializer.DeserializeFromString[T] (System.String text) <0x409bab00 + 0x00043> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.SyncRepository.GetJobItem (IDataReader reader) <0x40e16640 + 0x005e4> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.SyncRepository.GetJobItemReader[T] (MediaBrowser.Model.Sync.SyncJobItemQuery query, System.String baseSelectText, System.Func`2 itemFactory) <0x40e15000 + 0x008a3> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.SyncRepository.GetJobItems (MediaBrowser.Model.Sync.SyncJobItemQuery query) <0x40e14ef0 + 0x000c7> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.SyncManager.GetJobItems (MediaBrowser.Model.Sync.SyncJobItemQuery query) <0x40e14d80 + 0x0002d> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.SyncJobProcessor+<EnsureJobItems>c__async0.MoveNext () <0x40e20000 + 0x004fb> in <filename unknown>:0 
	--- End of stack trace from previous location where exception was thrown ---
	  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7ff875aa06d0 + 0x00029> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7ff875a9e6b0 + 0x000a7> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7ff875a9e630 + 0x0006b> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7ff875a9e5e0 + 0x0003a> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () <0x7ff875a9eb10 + 0x00012> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.SyncJobProcessor+<EnsureSyncJobItems>c__async4.MoveNext () <0x40e1daa0 + 0x004c5> in <filename unknown>:0 
	--- End of stack trace from previous location where exception was thrown ---
	  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7ff875aa06d0 + 0x00029> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7ff875a9e6b0 + 0x000a7> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7ff875a9e630 + 0x0006b> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7ff875a9e5e0 + 0x0003a> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () <0x7ff875a9eb10 + 0x00012> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.SyncJobProcessor+<SyncJobItems>c__async6.MoveNext () <0x40e1cef0 + 0x0028a> in <filename unknown>:0 
	--- End of stack trace from previous location where exception was thrown ---
	  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7ff875aa06d0 + 0x00029> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7ff875a9e6b0 + 0x000a7> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7ff875a9e630 + 0x0006b> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7ff875a9e5e0 + 0x0003a> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () <0x7ff875a9eb10 + 0x00012> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.SyncManager+<GetReadySyncItems>c__async7.MoveNext () <0x40e1bc90 + 0x002fa> in <filename unknown>:0 
	--- End of stack trace from previous location where exception was thrown ---
	  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7ff875aa06d0 + 0x00029> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7ff875a9e6b0 + 0x000a7> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7ff875a9e630 + 0x0006b> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7ff875a9e5e0 + 0x0003a> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x7ff875a9ed10 + 0x00017> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.MediaSync+<GetNewMedia>c__async2.MoveNext () <0x40e1a840 + 0x00352> in <filename unknown>:0 
	--- End of stack trace from previous location where exception was thrown ---
	  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7ff875aa06d0 + 0x00029> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7ff875a9e6b0 + 0x000a7> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7ff875a9e630 + 0x0006b> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7ff875a9e5e0 + 0x0003a> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.GetResult () <0x7ff875a9e5c0 + 0x00012> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.MediaSync+<Sync>c__async0.MoveNext () <0x40dfce50 + 0x007e3> in <filename unknown>:0 
	--- End of stack trace from previous location where exception was thrown ---
	  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7ff875aa06d0 + 0x00029> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7ff875a9e6b0 + 0x000a7> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7ff875a9e630 + 0x0006b> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7ff875a9e5e0 + 0x0003a> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () <0x7ff875a9eb10 + 0x00012> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Sync.MultiProviderSync+<Sync>c__async0.MoveNext () <0x40df8dd0 + 0x00add> in <filename unknown>:0 
	--- End of stack trace from previous location where exception was thrown ---
	  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7ff875aa06d0 + 0x00029> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7ff875a9e6b0 + 0x000a7> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7ff875a9e630 + 0x0006b> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7ff875a9e5e0 + 0x0003a> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () <0x7ff875a9eb10 + 0x00012> in <filename unknown>:0 
	  at MediaBrowser.Common.Implementations.ScheduledTasks.ScheduledTaskWorker+<ExecuteInternal>c__async2.MoveNext () <0x40ca9a70 + 0x007c7> in <filename unknown>:0 
	
2016-01-03 20:10:18.9328 Info App: Cloud & Folder Sync Failed after 0 minute(s) and 0 seconds
2016-01-03 20:10:19.1711 Info App: Executing Scan media library

[Luke 42079]

That's really odd. I wonder if that's just a stroke of bad luck. I will look into it but for now just delete the sync db file.

[NomadCF 15]

I do think it's bad luck. So far I've been able to nail down to these variables when trying to reliably recreate this issue.

• A large sync list.  My sync lists are a minimum of 700 items and my largest is 13,000 (broken up  over 3 different "groups")
• some sort of server stop,  weather it  is a crash or a shutdown (with or with out a restart).
• It happens for frequently during a upgrade. 

As a safe guard I'm backing up the sync db every hour now  (filesystem snapshot, then a sqlite dump of the db), and I'll  just restore it when it goes corrupt again.

 

Other things I've noticed.

• If the sync list is under 25, I can't seem to recreate the issue.

• when going through the sync db.  I can't find an entry that "off"  or out of place compared to the others. So I can't tell what entry is the one causing it. Is there an extra  "debugging" option I can turn on that will help me point to the invalid entry ?