Jump to content

TV Library build seems _very_ slow


Recommended Posts

TheFreeMan
Posted

Somehow, I ended up with my TV Library type set to "Mixed Content". I think this may be causing me issues with Emby For Kodi, so I removed the TV library and recreated it with content type = "TV Shows".

It's now been running for more than 24 hours and it shows that it's 91% complete image.png.962f6784d9527bcf88d3e7f4dc46aa74.png 

but when I scroll through the library itself, significantly less than 90% of the shows have thumbnails visible.

When I created the library, I think the only changes from default I made was

* "Automatically refresh metadata for episodes with place holder titles..." to "Every 2 days"

* "Generate intro video markers" to "as a scheduled task and when media is added"

* turn on "Require a hash match" for Automatic Subtitle Download (setting language to "English").

 

The last several lines of the current log file are:

2026-01-02 12:39:55.966 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /usr/bin/ffmpeg-emby -i file:"/media/TV/How It's Made/Season 27/How It's Made S27E15 Pasta Dies; Blueberries; Composting Toilets; Surge Arresters.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/config/cache/temp/cf4782b7ee104b37952932955ebb4934"
2026-01-02 12:39:57.508 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E08 Glass Sculptures; Racing Pulley Systems; Inductors; Medicine Balls WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:52.1144278. Confidence: 0.9
2026-01-02 12:39:57.509 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E11 Rubber Balls; Motion Chairs; Montreal Smoked Meat; Motorized Scooters WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:00.288 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E11 Rubber Balls; Motion Chairs; Montreal Smoked Meat; Motorized Scooters WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:24.1393612. Confidence: 0.9
2026-01-02 12:40:00.290 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E12 Aerospace Fasteners; Cactus Pear Puree; Lab Reactors WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:01.603 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Process exited with code 0
2026-01-02 12:40:01.603 Info App: CreateTitleFingerprint completed for /media/TV/How It's Made/Season 27/How It's Made S27E15 Pasta Dies; Blueberries; Composting Toilets; Surge Arresters.mkv to /config/cache/temp/cf4782b7ee104b37952932955ebb4934
2026-01-02 12:40:01.603 Info App: Moving fingerprint file from /config/cache/temp/cf4782b7ee104b37952932955ebb4934 to /config/metadata/library/a4/a4bc4287dbe3f234750783122363325d/title_10_636081301070000000.fp
2026-01-02 12:40:01.608 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /usr/bin/ffmpeg-emby -i file:"/media/TV/How It's Made/Season 27/How It's Made S27E16 Angle Grinders, Berry Baskets; Omnidirectional Speakers.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/config/cache/temp/643f256e01b14b85949898ee79ac1101"
2026-01-02 12:40:03.730 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E12 Aerospace Fasteners; Cactus Pear Puree; Lab Reactors WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:51.7412935. Confidence: 0.9
2026-01-02 12:40:03.737 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E09 Fish Rubbings; Clay Shooting Machines; Almonds; High-End Motorcycles WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:06.960 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E09 Fish Rubbings; Clay Shooting Machines; Almonds; High-End Motorcycles WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:47.8855721. Confidence: 0.9
2026-01-02 12:40:06.962 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E07 Recycled Skateboard Guitars; Solar Street Lights; Dolls WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:08.104 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Process exited with code 0
2026-01-02 12:40:08.104 Info App: CreateTitleFingerprint completed for /media/TV/How It's Made/Season 27/How It's Made S27E16 Angle Grinders, Berry Baskets; Omnidirectional Speakers.mkv to /config/cache/temp/643f256e01b14b85949898ee79ac1101
2026-01-02 12:40:08.104 Info App: Moving fingerprint file from /config/cache/temp/643f256e01b14b85949898ee79ac1101 to /config/metadata/library/cc/cc70bc6699db9c875d7ce64966be9b87/title_10_636087269820000000.fp
2026-01-02 12:40:08.108 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /usr/bin/ffmpeg-emby -i file:"/media/TV/How It's Made/Season 27/How It's Made S27E17 Cartridge Blades; Chocolate Banana Loaves; Vending Machines; Dive Computers.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/config/cache/temp/cfc327cbfac24b6db356e4702ca9515a"
2026-01-02 12:40:09.884 Info LibraryStructureService-0HNI30KKPJBJH:00000001: http/1.1 POST http://host1:8096/emby/Library/VirtualFolders/LibraryOptions?X-Emby-Client=Emby Web&X-Emby-Device-Name=Firefox Windows&X-Emby-Device-Id=f27c45d6-b5b2-42bd-aff6-2023cf200698&X-Emby-Client-Version=4.9.1.90&X-Emby-Token=x_secret6_x&X-Emby-Language=en-us&reqformat=json. Source Ip: host4, UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:146.0) Gecko/20100101 Firefox/146.0
2026-01-02 12:40:09.895 Info LibraryStructureService-0HNI30KKPJBJH:00000001: http/1.1 Response 204 to host4. Time: 11ms. POST http://host1:8096/emby/Library/VirtualFolders/LibraryOptions?X-Emby-Client=Emby Web&X-Emby-Device-Name=Firefox Windows&X-Emby-Device-Id=f27c45d6-b5b2-42bd-aff6-2023cf200698&X-Emby-Client-Version=4.9.1.90&X-Emby-Token=x_secret6_x&X-Emby-Language=en-us&reqformat=json.
2026-01-02 12:40:10.196 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E07 Recycled Skateboard Guitars; Solar Street Lights; Dolls WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:50.6218905. Confidence: 0.9
2026-01-02 12:40:10.199 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E10 Throttle Bodies; Limestone Fireplace Mantels; Candied Fruit & Fruit Jellies; Linen Ukuleles WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:13.129 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E10 Throttle Bodies; Limestone Fireplace Mantels; Candied Fruit & Fruit Jellies; Linen Ukuleles WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:48.1343283. Confidence: 0.9
2026-01-02 12:40:13.131 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E06 Spiral Stairs; Pita Bread; Exhaust Headers; Molded Limestone Artwork WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:13.667 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Process exited with code 0
2026-01-02 12:40:13.667 Info App: CreateTitleFingerprint completed for /media/TV/How It's Made/Season 27/How It's Made S27E17 Cartridge Blades; Chocolate Banana Loaves; Vending Machines; Dive Computers.mkv to /config/cache/temp/cfc327cbfac24b6db356e4702ca9515a
2026-01-02 12:40:13.667 Info App: Moving fingerprint file from /config/cache/temp/cfc327cbfac24b6db356e4702ca9515a to /config/metadata/library/0c/0ca78cf4cde0942c916ca3ed88b91d74/title_10_636215911280000000.fp
2026-01-02 12:40:13.670 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /usr/bin/ffmpeg-emby -i file:"/media/TV/How It's Made/Season 27/How It's Made S27E18 Ultra-Thin Glass; Pallet Dismantlers; Cupcakes; Stainless Steel Tubes.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/config/cache/temp/e255853e94014838a942d5f9734ad83e"

 

Is this taking this long simply because it's running in a docker container on old hardware with other things going on the server, as well?

Have I added settings that have slowed things down?

I do have 452 TV shows - a couple of them with 20+ seasons, so I do expect it to take a while, but I didn't expect it to take this long - am I just being too impatient?

Happy2Play
Posted
16 minutes ago, TheFreeMan said:

Somehow, I ended up with my TV Library type set to "Mixed Content". I think this may be causing me issues with Emby For Kodi, so I removed the TV library and recreated it with content type = "TV Shows".

It's now been running for more than 24 hours and it shows that it's 91% complete image.png.962f6784d9527bcf88d3e7f4dc46aa74.png 

but when I scroll through the library itself, significantly less than 90% of the shows have thumbnails visible.

When I created the library, I think the only changes from default I made was

* "Automatically refresh metadata for episodes with place holder titles..." to "Every 2 days"

* "Generate intro video markers" to "as a scheduled task and when media is added"

* turn on "Require a hash match" for Automatic Subtitle Download (setting language to "English").

 

The last several lines of the current log file are:

2026-01-02 12:39:55.966 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /usr/bin/ffmpeg-emby -i file:"/media/TV/How It's Made/Season 27/How It's Made S27E15 Pasta Dies; Blueberries; Composting Toilets; Surge Arresters.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/config/cache/temp/cf4782b7ee104b37952932955ebb4934"
2026-01-02 12:39:57.508 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E08 Glass Sculptures; Racing Pulley Systems; Inductors; Medicine Balls WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:52.1144278. Confidence: 0.9
2026-01-02 12:39:57.509 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E11 Rubber Balls; Motion Chairs; Montreal Smoked Meat; Motorized Scooters WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:00.288 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E11 Rubber Balls; Motion Chairs; Montreal Smoked Meat; Motorized Scooters WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:24.1393612. Confidence: 0.9
2026-01-02 12:40:00.290 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E12 Aerospace Fasteners; Cactus Pear Puree; Lab Reactors WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:01.603 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Process exited with code 0
2026-01-02 12:40:01.603 Info App: CreateTitleFingerprint completed for /media/TV/How It's Made/Season 27/How It's Made S27E15 Pasta Dies; Blueberries; Composting Toilets; Surge Arresters.mkv to /config/cache/temp/cf4782b7ee104b37952932955ebb4934
2026-01-02 12:40:01.603 Info App: Moving fingerprint file from /config/cache/temp/cf4782b7ee104b37952932955ebb4934 to /config/metadata/library/a4/a4bc4287dbe3f234750783122363325d/title_10_636081301070000000.fp
2026-01-02 12:40:01.608 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /usr/bin/ffmpeg-emby -i file:"/media/TV/How It's Made/Season 27/How It's Made S27E16 Angle Grinders, Berry Baskets; Omnidirectional Speakers.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/config/cache/temp/643f256e01b14b85949898ee79ac1101"
2026-01-02 12:40:03.730 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E12 Aerospace Fasteners; Cactus Pear Puree; Lab Reactors WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:51.7412935. Confidence: 0.9
2026-01-02 12:40:03.737 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E09 Fish Rubbings; Clay Shooting Machines; Almonds; High-End Motorcycles WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:06.960 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E09 Fish Rubbings; Clay Shooting Machines; Almonds; High-End Motorcycles WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:47.8855721. Confidence: 0.9
2026-01-02 12:40:06.962 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E07 Recycled Skateboard Guitars; Solar Street Lights; Dolls WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:08.104 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Process exited with code 0
2026-01-02 12:40:08.104 Info App: CreateTitleFingerprint completed for /media/TV/How It's Made/Season 27/How It's Made S27E16 Angle Grinders, Berry Baskets; Omnidirectional Speakers.mkv to /config/cache/temp/643f256e01b14b85949898ee79ac1101
2026-01-02 12:40:08.104 Info App: Moving fingerprint file from /config/cache/temp/643f256e01b14b85949898ee79ac1101 to /config/metadata/library/cc/cc70bc6699db9c875d7ce64966be9b87/title_10_636087269820000000.fp
2026-01-02 12:40:08.108 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /usr/bin/ffmpeg-emby -i file:"/media/TV/How It's Made/Season 27/How It's Made S27E17 Cartridge Blades; Chocolate Banana Loaves; Vending Machines; Dive Computers.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/config/cache/temp/cfc327cbfac24b6db356e4702ca9515a"
2026-01-02 12:40:09.884 Info LibraryStructureService-0HNI30KKPJBJH:00000001: http/1.1 POST http://host1:8096/emby/Library/VirtualFolders/LibraryOptions?X-Emby-Client=Emby Web&X-Emby-Device-Name=Firefox Windows&X-Emby-Device-Id=f27c45d6-b5b2-42bd-aff6-2023cf200698&X-Emby-Client-Version=4.9.1.90&X-Emby-Token=x_secret6_x&X-Emby-Language=en-us&reqformat=json. Source Ip: host4, UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:146.0) Gecko/20100101 Firefox/146.0
2026-01-02 12:40:09.895 Info LibraryStructureService-0HNI30KKPJBJH:00000001: http/1.1 Response 204 to host4. Time: 11ms. POST http://host1:8096/emby/Library/VirtualFolders/LibraryOptions?X-Emby-Client=Emby Web&X-Emby-Device-Name=Firefox Windows&X-Emby-Device-Id=f27c45d6-b5b2-42bd-aff6-2023cf200698&X-Emby-Client-Version=4.9.1.90&X-Emby-Token=x_secret6_x&X-Emby-Language=en-us&reqformat=json.
2026-01-02 12:40:10.196 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E07 Recycled Skateboard Guitars; Solar Street Lights; Dolls WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:50.6218905. Confidence: 0.9
2026-01-02 12:40:10.199 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E10 Throttle Bodies; Limestone Fireplace Mantels; Candied Fruit & Fruit Jellies; Linen Ukuleles WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:13.129 Info App: Best title sequence for /media/TV/How It's Made/Season 30/How It's Made S30E10 Throttle Bodies; Limestone Fireplace Mantels; Candied Fruit & Fruit Jellies; Linen Ukuleles WEBDL-1080p h264 EAC3.mkv is 00:00:00 - 00:00:48.1343283. Confidence: 0.9
2026-01-02 12:40:13.131 Info App: Detecting markers for /media/TV/How It's Made/Season 30 - episode /media/TV/How It's Made/Season 30/How It's Made S30E06 Spiral Stairs; Pita Bread; Exhaust Headers; Molded Limestone Artwork WEBDL-1080p h264 EAC3.mkv
2026-01-02 12:40:13.667 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Process exited with code 0
2026-01-02 12:40:13.667 Info App: CreateTitleFingerprint completed for /media/TV/How It's Made/Season 27/How It's Made S27E17 Cartridge Blades; Chocolate Banana Loaves; Vending Machines; Dive Computers.mkv to /config/cache/temp/cfc327cbfac24b6db356e4702ca9515a
2026-01-02 12:40:13.667 Info App: Moving fingerprint file from /config/cache/temp/cfc327cbfac24b6db356e4702ca9515a to /config/metadata/library/0c/0ca78cf4cde0942c916ca3ed88b91d74/title_10_636215911280000000.fp
2026-01-02 12:40:13.670 Info FfmpegManager: ProcessRun 'CreateTitleFingerprint' Execute: /usr/bin/ffmpeg-emby -i file:"/media/TV/How It's Made/Season 27/How It's Made S27E18 Ultra-Thin Glass; Pallet Dismantlers; Cupcakes; Stainless Steel Tubes.mkv" -t 00:10:00.000 -ac 1 -acodec pcm_s16le -ar 16000 -vn -sn -f chromaprint -fp_format raw "/config/cache/temp/e255853e94014838a942d5f9734ad83e"

 

Is this taking this long simply because it's running in a docker container on old hardware with other things going on the server, as well?

Have I added settings that have slowed things down?

I do have 452 TV shows - a couple of them with 20+ seasons, so I do expect it to take a while, but I didn't expect it to take this long - am I just being too impatient?

In the end it will be about all the enabled library options as per that log snippet you are generating Intro Markers extending the scan time until said additional options are completed.  So from an initial import standpoint it could take days processing every episode.  Then once fully complete should take seconds to minutes for a scan.

 

  • Thanks 1
TheFreeMan
Posted
1 minute ago, Happy2Play said:

In the end it will be about all the enabled library options as per that log snippet you are generating Intro Markers extending the scan time until said additional options are completed.  So from an initial import standpoint it could take days processing every episode.  Then once fully complete should take seconds to minutes for a scan.

If I disable the intro markers scan, will that take effect immediately and allow it to complete more quickly, or would I have to drop/add it (again) for that to take effect. 

Don't think I've ever had the intro scan enabled before, but I've got a few videos that have it, and it's certainly a nice to have, but it's not a necessary to have.

Happy2Play
Posted
3 minutes ago, TheFreeMan said:

If I disable the intro markers scan, will that take effect immediately and allow it to complete more quickly, or would I have to drop/add it (again) for that to take effect. 

Don't think I've ever had the intro scan enabled before, but I've got a few videos that have it, and it's certainly a nice to have, but it's not a necessary to have.

You can stop the current task and disable the option then start the task again.  Then once everything is imported set the option to run on its own task during low/no use times with a time limit until all caught up then change to when content is added.

TheFreeMan
Posted
4 minutes ago, Happy2Play said:

You can stop the current task and disable the option then start the task again. 

This guy? image.png.4f2d33e9aafc0ef400e1f3375d68b92d.png

 

I disabled the intro detection in the library and, according to the log, things seem to be running more quickly. 

This is still running though

image.png.d92d7263da660361dae4d47bcbfb45f3.png

and is probably going to run for a while, I'd imagine.

Happy2Play
Posted
2 minutes ago, TheFreeMan said:

This guy? image.png.4f2d33e9aafc0ef400e1f3375d68b92d.png

 

I disabled the intro detection in the library and, according to the log, things seem to be running more quickly. 

This is still running though

image.png.d92d7263da660361dae4d47bcbfb45f3.png

and is probably going to run for a while, I'd imagine.

Yes if you click on Episode intro you will see the default trigger that you can modify if you like.

As for the library scan yes it could take awhile with just the normal probe of every episode if this is the first scan.

TheFreeMan
Posted
5 minutes ago, Happy2Play said:

Yes if you click on Episode intro you will see the default trigger that you can modify if you like.

That's set to daily, so it should be OK, so long as the initial scan finishes some time this week... :(

Thanks for the help! I guess the main takeaway is "be patient..."

  • Agree 1
  • Thanks 1
TheFreeMan
Posted

Just a follow up that it completed in another day or so. Don't remember exactly when...

  • Thanks 1

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...