macgyvertv 4 Posted March 28, 2023 Posted March 28, 2023 Running basic setup, no addons, nothing on a 24 core 10gps server. 1.2PB of tv and movies. 1 Folder for TV is 300TB and yet takes nearly a week to scan in, vs Jellyfin took 2 days and completed without missing a single folder. Please tell me how is this possible when one is free and other i have to pay for services that dosnt work. BTw files are local storage, NFO files are with the media and on a sep SSD. No errors in the logs, other then timeouts with these random metadata api's.
Luke 42077 Posted March 28, 2023 Posted March 28, 2023 Hi there, can we please see an example: How to Report a Problem Thanks.
macgyvertv 4 Posted March 28, 2023 Author Posted March 28, 2023 log didnt post but this is becoming a pain.
macgyvertv 4 Posted March 29, 2023 Author Posted March 29, 2023 it still has no finish any of the scanning and yet i manage to get 3 jellyfin servers up that has full scan this in.
macgyvertv 4 Posted March 29, 2023 Author Posted March 29, 2023 embyserver-63815644800.txt Here are the logs
macgyvertv 4 Posted March 29, 2023 Author Posted March 29, 2023 Log.txt Here is jellyfin. same content and folder
macgyvertv 4 Posted March 29, 2023 Author Posted March 29, 2023 @LukeHere are the logs.. its still not done but i can scan all day long in jelly.
woenk 62 Posted March 30, 2023 Posted March 30, 2023 Seriously ? 1.2PB ? And you are complaining about the peanuts of the licence for emby ? Are you trolling here ? Really would not know how Jellyfin could possibly handle this amount....the amount of info from the (free!) providers could almost be categorized as an DOS attack. And doesnt Jelllyfin also save the infos and pictures in the folders ?
Happy2Play 9780 Posted March 30, 2023 Posted March 30, 2023 Yes from a provider standpoint I do not see how they are not getting throttled by providers. But they do have a different scanning mechanism. Library scan fanout concurrency & Library metadata refresh concurrency - Feature Requests - Emby Community
Luke 42077 Posted March 30, 2023 Posted March 30, 2023 The 4.8 server has a lot of scanning optimizations that have been added, so stay tuned for the next release.
neik 873 Posted March 30, 2023 Posted March 30, 2023 3 hours ago, woenk said: And you are complaining about the peanuts of the licence for emby ? For the money he is making with all that the Emby license is even less than peanuts... 1
macgyvertv 4 Posted March 30, 2023 Author Posted March 30, 2023 10 hours ago, Luke said: The 4.8 server has a lot of scanning optimizations that have been added, so stay tuned for the next release. Thanks. This been going on for a long time.. just like to be able to scan in and be done, not wait weeks.
macgyvertv 4 Posted March 30, 2023 Author Posted March 30, 2023 10 hours ago, Happy2Play said: Yes from a provider standpoint I do not see how they are not getting throttled by providers. But they do have a different scanning mechanism. Library scan fanout concurrency & Library metadata refresh concurrency - Feature Requests - Emby Community whatever they are doing it works, and works nearly flawless and fast. Was able to scan in 4k movies in about a 20 min, vs 3 hours with emby. I want to go back to emby when i can but the months been pain the ass due to the issues on scanning. 1
Happy2Play 9780 Posted March 30, 2023 Posted March 30, 2023 We they can not be using the same providers as Emby gets blacklisted it it does not throttle the requests. Now if you already have metadata/images then that is totally different story. As disabling providers and importing existing metadata is 20X faster. But exact configuration is key here as there are to many options that can tune importing media from a one day proccess to a week process.
woenk 62 Posted March 30, 2023 Posted March 30, 2023 7 hours ago, macgyvertv said: whatever they are doing it works, and works nearly flawless and fast. Was able to scan in 4k movies in about a 20 min, vs 3 hours with emby. I want to go back to emby when i can but the months been pain the ass due to the issues on scanning. sorry...might get a ban for that... What kind of idiot are you that you think that asking for 1.2 PB of metadata is easy ? Thats prolly over a million of files asking for information...information that the rest of the world can get for free, but because of people like you will probably not be available without a fee in the future. I really wish that somebody knocks on your door and wants to see the license for every single file you have... 2
Luke 42077 Posted March 30, 2023 Posted March 30, 2023 HI guys, please just keep things polite without naming calling. Thanks.
macgyvertv 4 Posted March 31, 2023 Author Posted March 31, 2023 Not name calling anyone. I still use emby for few small stuff. That doesn't sound take weeks to scan. Just wanted a answer or solutions to this issue. Seriously it's that slow. Not sure if we can utilize the tvdb API and tmdb alternative API keys that we can get on our own. Throttle by providers is a huge problem. Got to be a work around because what ever the the other guys doing, it works flawless
Luke 42077 Posted March 31, 2023 Posted March 31, 2023 The scan should be much faster in the upcoming 4.8 server release. Thanks.
Darkseidd 59 Posted March 31, 2023 Posted March 31, 2023 2 minutes ago, Luke said: The scan should be much faster in the upcoming 4.8 server release. Thanks. OT abit. is this 4.8, for beta or stable? Ive been eager to jump to 4.8 stable for "Subs folder" support and "SxEP0x" support from 4.7.11
macgyvertv 4 Posted March 31, 2023 Author Posted March 31, 2023 Kinda makes me think as I have a server running beta and still slow can't really tell the difference between it and the stable as in scanning 1
macgyvertv 4 Posted April 2, 2023 Author Posted April 2, 2023 (edited) Here is a updated log on one server just doing movies. only has 2k videos in it and not even done yet. Been running since 3pm server time and here is 8pm.. and not close to being done. @Luke embyserver (1).txt embyserver-63815990400.txt Edited April 2, 2023 by macgyvertv
yyhemby 2 Posted April 2, 2023 Posted April 2, 2023 (edited) As shown in the figure, it would be better if a separate page can be opened like plex to display the current scanning situation. The current situation does not know how much content has been scanned, and the current scanning speed is also a little slow. Edited April 2, 2023 by yyhemby 1 1
macgyvertv 4 Posted April 2, 2023 Author Posted April 2, 2023 Here is the log file for same library on your beta and still isnt completed. Running for 2 days now. Seriously! @Luke embyserver (2).txt
Happy2Play 9780 Posted April 2, 2023 Posted April 2, 2023 (edited) All I see is a user that is hammering provider apis and will almost guarantee debug logging will show throttling required for TMDB. So is it about importing media or presenting it with metadata as you cannot have both having to get from online providers as they do impose request/speed limits. Edited April 2, 2023 by Happy2Play
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now