teshiburu 5 Posted June 2, 2015 Posted June 2, 2015 (edited) Hi, First post here, I am new to EMBY long time Plex user and first time EMBY. I am using version 3.0.5621.4 I have been migrating my Library from Plex to EMBY over the last few days, and at the moment it seems that the library scan times are insanely long! it could be down to my large collection, but I thought that the first scan would take ages and then any subsequent scans wouldnt take long at all as they would only update the data that had changed? I am also getting this error message within the log files 2015-06-02 08:40:46.1440 Error - App: Error reading existing xml tags from F:\Kids TV\Spongebob Squarepants\Season 5\SpongeBob SquarePants - S05E36 - SpongeHenge - HDTV - 720P.nfo. *** Error Report *** Version: 3.0.5621.4 Command line: C:\Users\Administrator\AppData\Roaming\MediaBrowser-Server\System\MediaBrowser.ServerApplication.exe Operating system: Microsoft Windows NT 6.1.7601 Service Pack 1 Processor count: 2 64-Bit OS: True 64-Bit Process: False Program data path: C:\Users\Administrator\AppData\Roaming\MediaBrowser-Server Application Path: C:\Users\Administrator\AppData\Roaming\MediaBrowser-Server\System\MediaBrowser.ServerApplication.exe Root element is missing. System.Xml.XmlException at System.Xml.XmlTextReaderImpl.Throw(Exception e) at System.Xml.XmlTextReaderImpl.ParseDocumentContent() at System.Xml.XmlTextReaderImpl.Read() at System.Xml.XmlReader.MoveToContent() at MediaBrowser.XbmcMetadata.Savers.BaseNfoSaver.AddCustomTags(String path, List`1 xmlTagsUsed, XmlWriter writer, ILogger logger) I assume this is because i previously had Sonarr set to get meta data for XBMC - it is now set to get data for Media Browser (I assume this is EMBY?) only and the new .nfo files seem to have very little in comparison. Is the library scan creating all new nfo files? would this explain the long time it is taking to scan? or could it be due to incorrect data that EMBY cant process in the nfo? Do i need to delete all the nfo files and let EMBY create them going forward? Any help would be awesome server-63568800000.txt Edited June 2, 2015 by teshiburu
teshiburu 5 Posted June 2, 2015 Author Posted June 2, 2015 Further update on this - I have just run another scan after the initial one and it spent a good half hour to 45 minutes sitting between 23.9 and 24.9 % it seems to be hanging on that percentage there, I cant see anything in the log files at all - the one attached initially seems to have much the same as this one. In the time of typing this response it has jumped from 35% to complete in like 2 minutes?
ebr 16178 Posted June 2, 2015 Posted June 2, 2015 Turn off the metadata fetching in Sonarr completely and just let Emby do it. It looks like Sonarr is giving you incomplete or invalid xml (based on the error above). You will also have to delete any existing .nfo or .xml files that are there or they will still be read instead of us re-fetching.
teshiburu 5 Posted June 2, 2015 Author Posted June 2, 2015 Turn off the metadata fetching in Sonarr completely and just let Emby do it. It looks like Sonarr is giving you incomplete or invalid xml (based on the error above). You will also have to delete any existing .nfo or .xml files that are there or they will still be read instead of us re-fetching. OK - so disable all Sonarr metadata, and delete all existing nfo files, will do, I shall let you know if it improves Am i right in assuming that subsequent scans after the initial (and this) should be a lot faster?
ebr 16178 Posted June 2, 2015 Posted June 2, 2015 Yes - as long as we have actually been able to get valid metadata. Your's probably keeps trying due to the errors.
teshiburu 5 Posted June 2, 2015 Author Posted June 2, 2015 I am just running an update after deleting the nfo files, i have also disabled nfo within EMBY and told it go the route of XML files.... I think I will update shortly, are you on for a fair bit now?
teshiburu 5 Posted June 2, 2015 Author Posted June 2, 2015 Right, I removed all of the old nfo files, and asked EMBY to rescan, it did, taking 1 hour 20 minutes. I then made a small change to one series (added 6 episodes) and it is now scanning again as per my request and again is looking like it is going to take an hour or so again! Been sitting at 23.3% now for the last 10 minutes this is the same every time, what causes this? Most recent log file attached server-63568850427.txt
teshiburu 5 Posted June 2, 2015 Author Posted June 2, 2015 Ive just attached another log file as well after rebooting the EMBY server and then running a library update, This one took close to an hour and is like the 5th 6th scan i have run since my first scan. Any ideas log_file.txt
Luke 42078 Posted June 2, 2015 Posted June 2, 2015 for testing purposes, start by removing all plugins and then let's go from there
teshiburu 5 Posted June 3, 2015 Author Posted June 3, 2015 Right sorry for the delay Luke. Please find attached report, no plugins/addons freshly rebooted and scanned. server-63568911270.txt
Luke 42078 Posted June 3, 2015 Posted June 3, 2015 i don't know. you might just have a slow machine and/or slow storage. we are going to be improving the scan soon so that it doesn't have to run at server startup and i think that will help you a lot. just bare with it until then.
teshiburu 5 Posted June 3, 2015 Author Posted June 3, 2015 Hmm ok fair enough, will you also be working on how much it refreshes? It seems to do a whole check on every bit of media even though it already has meta data for that just seems a bit of a waste?
ebr 16178 Posted June 4, 2015 Posted June 4, 2015 We only refresh things that have changed since the last refresh of that item. In order to know if something has changed, however, you have to at least look at it.
teshiburu 5 Posted June 4, 2015 Author Posted June 4, 2015 @@ebr @Luke thanks guys - I will have to see if it improves, just got one more issue at the moment http://emby.media/community/index.php?/topic/22030-disappearing-content/
ginjaninja 605 Posted June 4, 2015 Posted June 4, 2015 we are going to be improving the scan soon so that it doesn't have to run at server startup not major,, but a good improvement none the less, would make the product/user experience feel better/more robust for sure
teshiburu 5 Posted June 9, 2015 Author Posted June 9, 2015 (edited) Any more ideas on this @@ebr @@Luke The system speeds are fine, when the scan is running it is utilizing 10-15% processor usage. and nothing else is being done on the system at the time? I run the BETA version (3.0.5621.4) but these scan times are just silly now latest one took 1 hour 20 minutes, no plugins, and only 2 new episodes! Is there a way to see what EMBY is actually doing during the scan? the log files show very little about what is actually being done. My Library has 1336 Movies, and 203 series with 15422 episodes Edited June 9, 2015 by teshiburu
teshiburu 5 Posted June 10, 2015 Author Posted June 10, 2015 (edited) Right, I've managed to narrow this down to an issue with my Movies directory, previously all of my films were just "loose" in the directory, does EMBY require them to be in their own folders? If so - what is the recommended structure and naming convention? @@ebr @@Luke Any ideas guys? When I remove Movies the scan times are a matter of minutes. Edited June 10, 2015 by teshiburu
Luke 42078 Posted June 10, 2015 Posted June 10, 2015 No, it doesn't. the naming guide is here: https://github.com/MediaBrowser/Wiki/wiki/Movie%20naming
geaves 13 Posted June 10, 2015 Posted June 10, 2015 Right, I've managed to narrow this down to an issue with my Movies directory, previously all of my films were just "loose" in the directory, does EMBY require them to be in their own folders? If so - what is the recommended structure and naming convention? @@ebr @@Luke Any ideas guys? When I remove Movies the scan times are a matter of minutes. I have my movies in folders of their own, so the parent in my instance is movies then each film is in it's own folder with the year in brackets.......so Avatar (2009), Harry Potter and the Deathly Hallows, Part 2 (2011) and so on.....this works as the metadata and images are stored in the folder the movie file is in.
teshiburu 5 Posted June 10, 2015 Author Posted June 10, 2015 (edited) Ok so either way should work @@Luke ? Any reason why movies would be slowing down my scan times? Edited June 10, 2015 by teshiburu
teshiburu 5 Posted June 10, 2015 Author Posted June 10, 2015 Latest log file, This is really upsetting me now I know there must be a bad file somewhere that is causing it to lock up but I cannot for the love of me find it! I wish the log files were more verbose as to what they were doing at the time, i.e. telling me what items it was scanning and what it was doing to them during the the scan server-63569542689.txt
teshiburu 5 Posted June 11, 2015 Author Posted June 11, 2015 I am really losing my patience with this now. Today I have done the following an an attempt to fix this issue, but first let me reiterate how my library is built up I have 2 arrays with the following contents Array 1 TV series ----2 Broke Girls --------extrafanart (is this an EMBY folder?) --------extrathumbs (is this an EMBY folder?) --------Season 1 ------------2.Broke.Girls.-.S01E01.-.Pilot.HDTV-720p.Proper.mkv ------------2.Broke.Girls.-.S01E01.-.Pilot.HDTV-720p.Proper-thumb.jpg ------------all other episodes like this --------Season 2 ------------same as season one ----12 Monkeys --------same as above Array 2 Anime ----Same as TV (setup as a TV library in EMBY) Kids TV ----Same as TV (setup as a TV library in EMBY) Movies ----Other Movies --------2 Fast 2 Furious (2003) [1080p] [tt0322259].mp4 --------3 Days to Kill (2014) [1080p] [tt2172934].mp4 -------- and so on - all movies follow the same naming convention MEBY is setup to hide all the meta data it downloads but there are about 10 items for each including an nfo and xml?? Actions taken today. Uninstalled EMBY Deleted the MediaBrowser folders from program data Reinstalled EMBY Added 1 library for movies selected F:\Movies\Other Movies as the directory for it Initiated Media scan - I expected this to take some time as it was a fresh scan with no meta data or images Scan completed in 161 minutes (line 582 to 23591 in the attached file) Started a 2nd scan after completion to see how quick it was The second scan (which should happen quickly) was started at 2015-06-11 11:49:03.5047 line 23772 in in the attachment that scan is still running now (66.0%) at 2015-06-11 12:39:00 and there are no errors and no log entries since 12:27. I am going to uninstall EMBY AGAIN and test this scan time for TV Series and such tomorrow - I know the system is more than capable of doing a decent speed scan, as I have spoke to people with larger libraries than me running this on less powerful machines. Please Please Please - give me some further insight into what it is actually scanning for? I donated to EMBY the minute I heard about it when looking for an alternative to PLEX and so far I am loving it! but this is just an annoying inconvenience! @@Luke @@ebr I appreciate you are both really busy guys, but this is a real issue and I am not the only person affected I have spoken to a few people on the unofficial irc with similar issues. server-63569609247.txt
teshiburu 5 Posted June 11, 2015 Author Posted June 11, 2015 I've also just spotted - that a Movie i was watching before the uninstall and deletion of the folders relating to EMBY seems to have remembered its progress.... How did that happen?
ebr 16178 Posted June 11, 2015 Posted June 11, 2015 I've also just spotted - that a Movie i was watching before the uninstall and deletion of the folders relating to EMBY seems to have remembered its progress.... How did that happen? That means you didn't actually remove the old installation information.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now