markmon 0 Posted January 24, 2019 Posted January 24, 2019 Hi all. I am trying to move from plex to emby. I have a very large library. I'm running emby server v4.0.1.0 I thought that the TV library was successfully scanned, but it seems about 1/3 of my shows have a folder with artwork and meta correct but then no files are found. I am familiar with expected file naming requirements and plex media server finds everything just fine. One example is The Fosters (2013) and the episodes are named in the folder: The Fosters (2013) - S01E01 - Pilot WEBDL-720p.mkv for example. My folders are flat so its TV FOLDER\SERIESNAME\Series S01E01 etc no season folders. The shows that have empty folders, in the embyserver-somenumber.txt log I see lines like this: 2019-01-23 05:43:11.816 Info HttpClient: GET https://www.thetvdb.com/api/GetSeries.php?seriesname=The+Fosters+(2013)&language=en 2019-01-23 05:43:12.428 Info HttpClient: GET https://api.themoviedb.org/3/find/tt2262532?api_key=f6bd687ffa63cd282b6ff2c6877f2669&external_source=imdb_id 2019-01-23 05:43:12.741 Info HttpClient: GET https://api.themoviedb.org/3/tv/46880?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=credits,images,keywords,external_ids,videos,content_ratings&language=en&include_image_language=en,null 2019-01-23 05:43:12.974 Info HttpClient: GET https://www.thetvdb.com/banners/posters/267907-6.jpg 2019-01-23 05:43:13.012 Info HttpClient: GET https://www.thetvdb.com/banners/graphical/267907-g4.jpg 2019-01-23 05:43:13.035 Info HttpClient: GET https://www.thetvdb.com/banners/fanart/original/267907-8.jpg 2019-01-23 05:43:13.109 Info HttpClient: GET https://assets.fanart.tv/fanart/tv/267907/hdtvlogo/the-fosters-2013-5193f21d3bed9.png 2019-01-23 05:43:14.101 Info HttpClient: GET https://assets.fanart.tv/fanart/tv/267907/tvthumb/the-fosters-2013-524713e8c14a9.jpg 2019-01-23 05:43:16.504 Info App: Creating Season Season 1 entry for The Fosters (2013) 2019-01-23 05:43:16.509 Info HttpClient: GET https://api.themoviedb.org/3/tv/46880/season/1?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=images,keywords,external_ids,credits,videos&language=en&include_image_language=en,null 2019-01-23 05:43:16.761 Info App: Creating Season Season 2 entry for The Fosters (2013) 2019-01-23 05:43:16.818 Info HttpClient: GET https://api.themoviedb.org/3/tv/46880/season/2?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=images,keywords,external_ids,credits,videos&language=en&include_image_language=en,null 2019-01-23 05:43:17.058 Info App: Creating Season Season 3 entry for The Fosters (2013) 2019-01-23 05:43:17.130 Info HttpClient: GET https://api.themoviedb.org/3/tv/46880/season/3?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=images,keywords,external_ids,credits,videos&language=en&include_image_language=en,null 2019-01-23 05:43:17.385 Info App: Creating Season Season 4 entry for The Fosters (2013) 2019-01-23 05:43:17.443 Info HttpClient: GET https://api.themoviedb.org/3/tv/46880/season/4?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=images,keywords,external_ids,credits,videos&language=en&include_image_language=en,null 2019-01-23 05:43:17.741 Info App: Creating Season Season 5 entry for The Fosters (2013) 2019-01-23 05:43:17.749 Info HttpClient: GET https://api.themoviedb.org/3/tv/46880/season/5?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=images,keywords,external_ids,credits,videos&language=en&include_image_language=en,null 2019-01-23 05:43:19.090 Info App: Removing virtual season The Fosters (2013) 1 2019-01-23 05:43:19.090 Info App: Deleting item, Type: Season, Name: Season 1, Path: , Id: 42558 2019-01-23 05:43:19.106 Info App: Removing virtual season The Fosters (2013) 2 2019-01-23 05:43:19.106 Info App: Deleting item, Type: Season, Name: Season 2, Path: , Id: 42559 2019-01-23 05:43:19.122 Info App: Removing virtual season The Fosters (2013) 3 2019-01-23 05:43:19.123 Info App: Deleting item, Type: Season, Name: Season 3, Path: , Id: 42560 2019-01-23 05:43:19.139 Info App: Removing virtual season The Fosters (2013) 4 2019-01-23 05:43:19.139 Info App: Deleting item, Type: Season, Name: Season 4, Path: , Id: 42561 2019-01-23 05:43:19.155 Info App: Removing virtual season The Fosters (2013) 5 2019-01-23 05:43:19.155 Info App: Deleting item, Type: Season, Name: Season 5, Path: , Id: 42562 2019-01-23 05:43:19.171 Info App: Removing virtual season The Fosters (2013) 1 2019-01-23 05:43:19.171 Info App: Deleting item, Type: Season, Name: Season 1, Path: , Id: 92101 2019-01-23 05:43:19.191 Info App: Removing virtual season The Fosters (2013) 2 2019-01-23 05:43:19.191 Info App: Deleting item, Type: Season, Name: Season 2, Path: , Id: 92102 2019-01-23 05:43:19.208 Info App: Removing virtual season The Fosters (2013) 3 2019-01-23 05:43:19.208 Info App: Deleting item, Type: Season, Name: Season 3, Path: , Id: 92103 2019-01-23 05:43:19.224 Info App: Removing virtual season The Fosters (2013) 4 2019-01-23 05:43:19.224 Info App: Deleting item, Type: Season, Name: Season 4, Path: , Id: 92104 2019-01-23 05:43:19.241 Info App: Removing virtual season The Fosters (2013) 5 2019-01-23 05:43:19.241 Info App: Deleting item, Type: Season, Name: Season 5, Path: , Id: 92105 Then later in the log this: 2019-01-23 05:46:36.820 Info App: Cleaning item Pilot type: Episode path: F:\TV\The Fosters (2013)\The Fosters (2013) - S01E01 - Pilot WEBDL-720p.mkv 2019-01-23 05:46:36.820 Info App: Deleting item, Type: Episode, Name: Pilot, Path: F:\TV\The Fosters (2013)\The Fosters (2013) - S01E01 - Pilot WEBDL-720p.mkv, Id: 12760 2019-01-23 05:46:36.831 Info App: Cleaning item Consequently type: Episode path: F:\TV\The Fosters (2013)\The Fosters (2013) - S01E02 - Consequently WEBDL-720p.mkv 2019-01-23 05:46:36.831 Info App: Deleting item, Type: Episode, Name: Consequently, Path: F:\TV\The Fosters (2013)\The Fosters (2013) - S01E02 - Consequently WEBDL-720p.mkv, Id: 12761 (Repeated for every file in all seasons, its long so I won't paste them all here). Does anyone have any suggestions or pointers on what is happening and how to debug it?
Luke 42080 Posted January 24, 2019 Posted January 24, 2019 Hi there, how did you setup the library in Emby library setup?
markmon 0 Posted January 25, 2019 Author Posted January 25, 2019 Hi there, how did you setup the library in Emby library setup? I set it up as TV, added two folders, then in settings: Language: English Country: USA Special Season by name: Specials Prefer embedded titles over filenames: Not checked Enable real time monitoring: Checked Series meta downloaders; (Note these all work as the meta and images are there just some files are not enumerated) TheTvDB - checked TheMovieDB - checked The Open Movie Database - Not Checked Season meta downloader: TheMovieDb: Checked Episode Meta Downloaders: TheTvDB: Checked TheMovieDB: Not Checked The Open Movie Database: not Checked Automatically refresh meta from internet: Never Metadata Savers: NFO - Not Checked Series Image Fetchers: (Working, images are present) TheTVDB Checked FanArt Checked TheMovieDb Not checked Season Image Fetchers: (Working, images are present) TheTVDB Checked FanArt Checked TheMovieDb Checked Episode Image Fetchers: TheTvDB: Checked TheMovieDb: Not checked The Open Movie DB: Not checked Screen Grabber: Checked Save Artwork Into Media Folders - Not checked Download images in advance - Checked Automatically merge series that are spread across multiple folders - Not checked Display missing episodes within seasons - Not checked (no episodes are actually missing from disk anyway) Chapter Images: Enable chapter image Extraction - Not Checked Extract chapter images during the library scan - Not Checked Subtitle Downloads: Language - nothing checked Open Subtitles - not checked Only download subtitles that are a perfect match for my video files - checked Skip if the default audio track matches the download language - not checked Skip if the video already contains embedded subtitles - not checked Save subtitles into media folders - not checked Min resume percentage: 5 Max resume percentage: 90 Min resume duration (seconds): 180 Please let me know if there's anything else I can provide. I also have movies in a movie library but I'm not sure if they all scanned in. It doesn't show a count.
Happy2Play 9782 Posted January 25, 2019 Posted January 25, 2019 I set it up as TV, added two folders, then in settings: Please let me know if there's anything else I can provide. I also have movies in a movie library but I'm not sure if they all scanned in. It doesn't show a count. What are the paths for those folders you entered for that Library?
markmon 0 Posted January 25, 2019 Author Posted January 25, 2019 What are the paths for those folders you entered for that Library? F:\TV G:\ArchivedTV Again, it finds 75% of the files. If the path was off it would find none.
Luke 42080 Posted January 25, 2019 Posted January 25, 2019 Can we look at the folder structure of a specific example? thanks !
markmon 0 Posted January 25, 2019 Author Posted January 25, 2019 Can we look at the folder structure of a specific example? thanks ! Sure. It was in the original post: One example is The Fosters (2013) and the episodes are named in the folder: The Fosters (2013) - S01E01 - Pilot WEBDL-720p.mkv for example. So this one is F:\TV\The Fosters (2013)\The Fosters (2013) - S01E01 - Pilot WEBDL-720p.mkv F:\TV is the library folder. F:\TV\The Fosters (2013) is the subfolder with the show all the episodes are flat. nothing else is in the folder except the 104 mkv files: F:\TV\The Fosters (2013)\The Fosters (2013) - S01E01 - Pilot WEBDL-720p.mkv F:\TV\The Fosters (2013) - S01E02 - Consequently WEBDL-720p.mkv ... F:\TV\The Fosters (2013) - S05E22 - Where the Heart Is WEBDL-720p.mkv
Happy2Play 9782 Posted January 25, 2019 Posted January 25, 2019 (edited) What is the content type for this library Mixed or TV? Sorry your settings above shows TV. Edited January 25, 2019 by Happy2Play
markmon 0 Posted January 25, 2019 Author Posted January 25, 2019 What is the content type for this library Mixed or TV? Hi, content type is "TV". The scrapper is getting *all* the artwork and meta correctly for all the folders even the ones it still has empty. I suppose I could try adding the library a second time as a second library as "video" just to see if it even finds the files.
Happy2Play 9782 Posted January 25, 2019 Posted January 25, 2019 (edited) I replicated your settings and did not have a issue creating a library with those library setting. Series-Season-Episodes displayed properly. @@Luke The only issue I had was the link to Season from episode details screen was undefined until second library same. 2019-01-25 15:36:59.804 Info HttpServer: HTTP GET http://localhost:8096/emby/Users/da6664eb751e4cd89d68d39411f71ef2/Items/undefined. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36 2019-01-25 15:36:59.805 Info HttpServer: HTTP GET http://localhost:8096/emby/Users/da6664eb751e4cd89d68d39411f71ef2. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36 2019-01-25 15:36:59.806 Info HttpServer: HTTP Response 200 to ::1. Time: 1ms. http://localhost:8096/emby/Users/da6664eb751e4cd89d68d39411f71ef2 2019-01-25 15:36:59.807 Error HttpServer: Error processing request *** Error Report *** Version: 4.0.1.0 Command line: C:\Users\Media\Desktop\Stable\system\EmbyServer.dll -noautorunwebapp Operating system: Microsoft Windows NT 6.2.9200.0 64-Bit OS: True 64-Bit Process: True User Interactive: True Processor count: 4 Program data path: C:\Users\Media\Desktop\Stable\programdata Application directory: C:\Users\Media\Desktop\Stable\system System.FormatException: System.FormatException: Guid should contain 32 digits with 4 dashes (xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx). at System.Guid.GuidResult.SetFailure(ParseFailureKind failure, String failureMessageID, Object failureMessageFormatArgument, String failureArgumentName, Exception innerException) at System.Guid.TryParseGuidWithNoStyle(ReadOnlySpan`1 guidString, GuidResult& result) at System.Guid.TryParseGuid(ReadOnlySpan`1 guidString, GuidStyles flags, GuidResult& result) at System.Guid..ctor(String g) at MediaBrowser.Controller.Library.LibraryManagerExtensions.GetItemById(ILibraryManager manager, String id) at MediaBrowser.Api.UserLibrary.UserLibraryService.Get(GetItem request) at Emby.Server.Implementations.Services.ServiceExecGeneral.GetTaskResult(Task task) at Emby.Server.Implementations.Services.ServiceHandler.ProcessRequestAsync(HttpListenerHost appHost, IRequest httpReq, IResponse httpRes, ILogger logger, String operationName, CancellationToken cancellationToken) at Emby.Server.Implementations.HttpServer.HttpListenerHost.RequestHandler(IRequest httpReq, String urlString, String host, String localPath, CancellationToken cancellationToken) Source: System.Private.CoreLib TargetSite: Void SetFailure(ParseFailureKind, System.String, System.Object, System.String, System.Exception) at System.Guid.GuidResult.SetFailure(ParseFailureKind failure, String failureMessageID, Object failureMessageFormatArgument, String failureArgumentName, Exception innerException) at System.Guid.TryParseGuidWithNoStyle(ReadOnlySpan`1 guidString, GuidResult& result) at System.Guid.TryParseGuid(ReadOnlySpan`1 guidString, GuidStyles flags, GuidResult& result) at System.Guid..ctor(String g) at MediaBrowser.Controller.Library.LibraryManagerExtensions.GetItemById(ILibraryManager manager, String id) at MediaBrowser.Api.UserLibrary.UserLibraryService.Get(GetItem request) at Emby.Server.Implementations.Services.ServiceExecGeneral.GetTaskResult(Task task) at Emby.Server.Implementations.Services.ServiceHandler.ProcessRequestAsync(HttpListenerHost appHost, IRequest httpReq, IResponse httpRes, ILogger logger, String operationName, CancellationToken cancellationToken) at Emby.Server.Implementations.HttpServer.HttpListenerHost.RequestHandler(IRequest httpReq, String urlString, String host, String localPath, CancellationToken cancellationToken) 2019-01-25 15:36:59.807 Info HttpServer: HTTP Response 500 to ::1. Time: 3ms. http://localhost:8096/emby/Users/da6664eb751e4cd89d68d39411f71ef2/Items/undefined embyserver.txt Edited January 25, 2019 by Happy2Play
markmon 0 Posted January 26, 2019 Author Posted January 26, 2019 had the library scan completed? Yes, it's sitting completed for several days. I've repeated the scan several times to see if it would help. It didn't.
Luke 42080 Posted January 26, 2019 Posted January 26, 2019 As a test if you were to create a new series, does this happen with that?
markmon 0 Posted January 26, 2019 Author Posted January 26, 2019 Well it's hard to say. I have about 300 series. About 200 of them enumerated fine. About 100 didn't. (artwork there but no files). I have been a long time plex user. I installed Emby and pointed it at my existing library that already had 300+ files and this was the result. So it's not like it's totally broken. At this ratio, there's a 66% chance that a new series will enumerate. So it's not like if I add a new folder and put some dummy files in whether it gets enumerated or not probably won't tell us anything new. The other interesting point is that it never skips files if it decides the folder has files. So the folders that it did enumerate some files are complete. It's not like a few episodes are missing out of those. If it's helpful, I can do a dir /s of f:\tv and g:\archivedtv to a file. But that'll be big. ------- So I started to prepare this and started with a dir /s of f:\tv and went to start marking the folders that were empty. In doing that, I see that all the missing folders are on f:\tv. While some were enumerated, it seems it stopped at a certain point. I also see that at one point I had a very old version of XBMC in here that put a bunch of media files and folders in (jpgs, txt files containing meta). I removed f:\tv from the TV library and it's currently scanning the library without it. It looks like all G drive made it though. I'll remove all the extra folders and try adding F:\TV in again and report back. It'd be nice to root cause this.
markmon 0 Posted January 27, 2019 Author Posted January 27, 2019 hmm I posted this earlier but don't see any trace of it. So I'll post it again. Success! I added f:\tv back in last night and initiated a scan and went to bed. My steps were: -Remove f:\tv from TV library. -Initiate a library rescan (took forever). Open a cmd prompt and: F: cd f:\tv del /s *.jpg del /s *.txt del /s *.nfo del /s *.xml removed the "extra" folders appearing in some series folders. -Add f:\tv back to TV library -Initiate full scan Everything's there now. So it must have been some file(s) fowled up the old scanner. Based on how it failed (it got to a point in the directory structure and quit from there on), it feels like perhaps the file scanner crashed part way through the process. Could this have resulted in folders with artwork and meta and no files discovered? If so, it'd be nice to know what crashed it specifically and fix that bug.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now