RedChili 1 Posted November 17, 2022 Share Posted November 17, 2022 Hello, I just switched over from plex to emby because I got fed up with photo libraries. I thought to give emby a shot for photos only. I'm just performing an initial scan of my library (4500 videos, 72k photos). I noticed that emby is rather slow on this initial scan and it's mostly performing sequential video scan via ffmpeg. Is there any reason why this is not done in multiple parallel threads to speed up things? My server has 6 cores but is rather bored CPU-wise and also not exhausted I/O-wise. I believe it could handle 2-4 more parallel ffmpeg calls. kr 1 Link to comment Share on other sites More sharing options...
RedChili 1 Posted November 17, 2022 Author Share Posted November 17, 2022 OK this has been discussed before (just didn't find it under library scan). Still think having multiple ffmpeg processes would be fine and make the initial setup nicer but this seems to not getting added: Link to comment Share on other sites More sharing options...
Luke 37099 Posted November 17, 2022 Share Posted November 17, 2022 Hi, the upcoming 4.8 server release will have improved initial library scan time. Link to comment Share on other sites More sharing options...
RedChili 1 Posted November 21, 2022 Author Share Posted November 21, 2022 Thanks, looking forward to it! Link to comment Share on other sites More sharing options...
jiggity 22 Posted March 15 Share Posted March 15 Given my feature request about the music library scanning got closed and I was told to post here, even though library scanning of music and FFMPEG multi thread usage are not the same issue, i will still reiterate the problem. When you have multiple libraries for music and you add files to one of them emby will scan all of them. This is unwieldy and not a good use of resources when you have a large music collection. The discogs API throws non-stop errors and that slows the scanning to a crawl. If there a a way to scan a singular library that was updated, or to scan multiple libraries in a parallel fashion, with a smart task control to time out the task that throw continuous error and not bog or prevent other scanning form occurring that would be just swell. The non stop errors on scanning means it takes over an hour to ingest a single album, and even then the embedded metadata is not ingested fully by emby. Also, as I pointed out @Happy2Playhad identified that if music libraries are not all configured the same that will cause discogs errors as well. So I was asking further questions about why separate libraries need to be config'd the same. And to what extent they must be similar, metadata setting, folder structure etc TL;DR - Library parallel scanning is not the same as FFMPEG multithreading Link to comment Share on other sites More sharing options...
Happy2Play 8296 Posted March 15 Share Posted March 15 2 minutes ago, jiggity said: Given my feature request about the music library scanning got closed and I was told to post here, even though library scanning of music and FFMPEG multi thread usage are not the same issue, i will still reiterate the problem. When you have multiple libraries for music and you add files to one of them emby will scan all of them. This is unwieldy and not a good use of resources when you have a large music collection. The discogs API throws non-stop errors and that slows the scanning to a crawl. If there a a way to scan a singular library that was updated, or to scan multiple libraries in a parallel fashion, with a smart task control to time out the task that throw continuous error and not bog or prevent other scanning form occurring that would be just swell. The non stop errors on scanning means it takes over an hour to ingest a single album, and even then the embedded metadata is not ingested fully by emby. Also, as I pointed out @Happy2Playhad identified that if music libraries are not all configured the same that will cause discogs errors as well. So I was asking further questions about why separate libraries need to be config'd the same. And to what extent they must be similar, metadata setting, folder structure etc TL;DR - Library parallel scanning is not the same as FFMPEG multithreading From a Music aspect Emby currently isn't designed for multiple libraries as things get sort of get merged behind the scenes if they happen to match like wanting say a Flac and mp3 libraries separate but same content. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now