rbjtech 5284 Posted August 25, 2021 Posted August 25, 2021 32 minutes ago, Sammy said: Is Process Monitor something to add in to a Win10 installation? It's from sys internals (Microsoft) - an essential tool if you want to know what is going on in your system in real time. It's a complex tool though, you'll need to apply filters - otherwise you will just be bombarded with information during the capture .. 1
Sammy 790 Posted August 25, 2021 Posted August 25, 2021 This is a 65Tb Drive Pool with most drives being harvested WD "White" Drives running on a Ryzen 3700x. Does this help? Fingerprinting CPU: Disk: Title Sequencing CPU: Disk: 2
rbjtech 5284 Posted August 25, 2021 Posted August 25, 2021 So you're not short on CPU threads then It's actually ffmpeg that does all the disk I/O - so if you could find the activity for that process when Fingerprinting is going on that that would be very useful. If Drivepool has spread the 'show/seasons' across all the physical disks (which I presume it has), then this may explain why you are not seeing performance I/O issues. 1
chef 3810 Posted August 25, 2021 Posted August 25, 2021 1 hour ago, Sammy said: Latest Results: embyserver 25082021(a).txt 19.76 MB · 1 download Okay, there is something happening here. I have to fix it. I know what it is.
chef 3810 Posted August 25, 2021 Posted August 25, 2021 (edited) @Sammy Try this, and then right after the server restart, when you can access the dashboard, can you send me the log? IntroSkip_v2.zip Edited August 25, 2021 by chef
chef 3810 Posted August 25, 2021 Posted August 25, 2021 1 hour ago, Sammy said: This process seems lengthy and there's no real way to know if it properly completed or not: Spinner spins and spins then stops but this dialog screen still shows. Yes this is currently not wired up. I'll do that next. I just want to make sure your db file is loading. It was not loading in the last log you posted.
Sammy 790 Posted August 25, 2021 Posted August 25, 2021 15 minutes ago, chef said: Yes this is currently not wired up. I'll do that next. I just want to make sure your db file is loading. It was not loading in the last log you posted. Should I manually delete it and try again?
Sammy 790 Posted August 25, 2021 Posted August 25, 2021 embyserver 25082021(b).txt @chef Hope this helps. I'm not sure if Emby was fully loaded yet or not.
chef 3810 Posted August 25, 2021 Posted August 25, 2021 (edited) 1 hour ago, Sammy said: embyserver 25082021(b).txt 117.05 kB · 0 downloads @chef Hope this helps. I'm not sure if Emby was fully loaded yet or not. Yes, it happened again. That is so strange. I need to figure this out. Sammy, in "plugins\configurations\IntroSkip.xml" do you have a node called "Version" ? @rbjtech do you notice anything weird in your log when the plugin loads. Is there an sqlite error? I'm not getting one, but Sammy is. Edited August 25, 2021 by chef
chef 3810 Posted August 25, 2021 Posted August 25, 2021 Welp! I have tried everything I know to get ffmpeg to output to stream. I can obtain the stream from ffmpeg by using "pipe:" Then I can get the pipped stream through the "process.StandardOutput.BaseStream" in c# However, I can't get that stream to "CopyTo" a memory stream. When I finally got it into a memory stream object, I wasn't able to read it back in a BinaryReader because my buffers seemed all messed up. I need to talk to someone with some background in ffmpeg, who knows how to collect the stream in c# properly. 1
Sammy 790 Posted August 25, 2021 Posted August 25, 2021 2 hours ago, chef said: Sammy, in "plugins\configurations\IntroSkip.xml" do you have a node called "Version" ? <?xml version="1.0"?> <PluginConfiguration xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <TitleSequenceLengthThreshold>10</TitleSequenceLengthThreshold> <EncodingLength>20</EncodingLength> <MaxDegreeOfParallelism>4</MaxDegreeOfParallelism> <FingerprintingMaxDegreeOfParallelism>4</FingerprintingMaxDegreeOfParallelism> <EnableItemAddedTaskAutoRun>true</EnableItemAddedTaskAutoRun> </PluginConfiguration>
chef 3810 Posted August 25, 2021 Posted August 25, 2021 16 minutes ago, Sammy said: <?xml version="1.0"?> <PluginConfiguration xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <TitleSequenceLengthThreshold>10</TitleSequenceLengthThreshold> <EncodingLength>20</EncodingLength> <MaxDegreeOfParallelism>4</MaxDegreeOfParallelism> <FingerprintingMaxDegreeOfParallelism>4</FingerprintingMaxDegreeOfParallelism> <EnableItemAddedTaskAutoRun>true</EnableItemAddedTaskAutoRun> </PluginConfiguration> Well that would explain it. It's okay now anyway. The version I posted, back a couple threads, doesn't look for that anymore.
rbjtech 5284 Posted August 25, 2021 Posted August 25, 2021 2 hours ago, chef said: Yes, it happened again. That is so strange. I need to figure this out. Sammy, in "plugins\configurations\IntroSkip.xml" do you have a node called "Version" ? @rbjtech do you notice anything weird in your log when the plugin loads. Is there an sqlite error? I'm not getting one, but Sammy is. Hi - My startup log file & IntroSkip.xml attached - I don't see any SQLlite errors ? Everything is working great tbh - i need to work around the performance issues, but I think that is a limitation of my test system not the s/w or config. I need to run on my main system tbh, just to get a much better indication of detection accuracy - as it's currently 100% .. Let me know if you need me to test anything else and I'll look into it tomorrow .. embyserver - 2021-08-26T005433.819.txt IntroSkip.xml
Sammy 790 Posted August 26, 2021 Posted August 26, 2021 Stopped Emby Server Dropped in the latest IntroSkip.dll Renamed titlesequence.db Restarted Emby Server Running Fingerprinting and it looks like it may give valid results this time since it isn't finishing in 3 seconds like before. @rbjtech 1
Micael456 45 Posted August 26, 2021 Posted August 26, 2021 10 hours ago, chef said: I need to talk to someone with some background in ffmpeg, who knows how to collect the stream in c# properly. Sorry chef, my c# knowledge is far too basic here- I came up through uni with Java and Perl mainly. My google-fu is still on point though, don't know if you've come across this stackoverflow post? It's using JPEGs instead of audio, but I imagine it's the same underlying structure to get from ffmpeg to c#. https://stackoverflow.com/questions/19634749/can-i-use-ffmpeg-to-output-jpegs-to-a-memory-stream-instead-of-a-file It comes with some example c# code which may as well be greek to me lol, but might make sense to you? https://github.com/nmaier/simpleDLNA/blob/060d602fd1606b0c18fea19eed6ed7f1ff12684c/thumbs/VideoThumbnailLoader.cs
Sammy 790 Posted August 26, 2021 Posted August 26, 2021 (edited) This has finally completed: But my results are still no bueno: embyserver 26082021(a).txt Edited August 26, 2021 by Sammy
chef 3810 Posted August 26, 2021 Posted August 26, 2021 (edited) 3 hours ago, Sammy said: This has finally completed: But my results are still no bueno: embyserver 26082021(a).txt 8.35 MB · 1 download Okay Sammy. Can you shut down the server, Delete the titleSequence.db, and restart? By the way, if the last.fm plug actually working for you? It looks broken in the logs. Edited August 26, 2021 by chef
Sammy 790 Posted August 26, 2021 Posted August 26, 2021 6 minutes ago, chef said: Okay Sammy. Can you shut down the server, Delete the titleSequence.db, and restart? By the way, if the last.fm plug actually working for you? It looks broken in the logs. That is the way I did it before this run with the last version you posted but I'll try again. Yes, Last.fm plugin is broken. I should uninstall it.
chef 3810 Posted August 26, 2021 Posted August 26, 2021 11 minutes ago, Sammy said: That is the way I did it before this run with the last version you posted but I'll try again. Yes, Last.fm plugin is broken. I should uninstall it. Okay, I need to read the logs a bit further.
Sammy 790 Posted August 26, 2021 Posted August 26, 2021 Not to go O.T. but my emby server log does show this: 2021-08-26 00:01:51.372 Info HttpClient: GET http://ws.audioscrobbler.com/2.0/?format=json&api_key=cb3bdcd415fcb40cd572b137b2b255f5&method=user.getArtistTracks&user=Sammys202&artist=Triumph&limit=200&page=1 2021-08-26 00:01:51.430 Error Last.fm: Deprecated - This type of request is no longer supported 2021-08-26 00:01:51.430 Info Last.fm: Ryzen has no tracks in last.fm library for Triumph 2021-08-26 00:01:51.430 Info HttpClient: GET http://ws.audioscrobbler.com/2.0/?format=json&api_key=cb3bdcd415fcb40cd572b137b2b255f5&method=user.getArtistTracks&user=Sammys202&artist=Deep%20Purple&limit=200&page=1 2021-08-26 00:01:51.499 Error Last.fm: Deprecated - This type of request is no longer supported 2021-08-26 00:01:51.499 Info Last.fm: Ryzen has no tracks in last.fm library for Deep Purple
chef 3810 Posted August 26, 2021 Posted August 26, 2021 1 hour ago, Luke said: The lastfm plugin works just fine. 1 hour ago, Sammy said: Not to go O.T. but my emby server log does show this: 2021-08-26 00:01:51.372 Info HttpClient: GET http://ws.audioscrobbler.com/2.0/?format=json&api_key=cb3bdcd415fcb40cd572b137b2b255f5&method=user.getArtistTracks&user=Sammys202&artist=Triumph&limit=200&page=1 2021-08-26 00:01:51.430 Error Last.fm: Deprecated - This type of request is no longer supported 2021-08-26 00:01:51.430 Info Last.fm: Ryzen has no tracks in last.fm library for Triumph 2021-08-26 00:01:51.430 Info HttpClient: GET http://ws.audioscrobbler.com/2.0/?format=json&api_key=cb3bdcd415fcb40cd572b137b2b255f5&method=user.getArtistTracks&user=Sammys202&artist=Deep%20Purple&limit=200&page=1 2021-08-26 00:01:51.499 Error Last.fm: Deprecated - This type of request is no longer supported 2021-08-26 00:01:51.499 Info Last.fm: Ryzen has no tracks in last.fm library for Deep Purple That is what I see in the logs. There are quite a few lines. I just wasn't sure if the unsupported request was breaking something later on.
chef 3810 Posted August 26, 2021 Posted August 26, 2021 @Sammy That log though... wow! What happened? Right after you accessed the configuration page it blew up! I'm running this again. I want to see if I can make sqlite do what it did in your logs, which is new to me.
chef 3810 Posted August 26, 2021 Posted August 26, 2021 (edited) Whoa! Check out what happens to the IntroSkip plugin schedule task data, when the library Manager decides to take control and scan the library, adding real episodes and removing virtual (upcoming) episodes. So the Library Manager stops watching the folder that contains the series Archer, this is also a series we are about to scan for title sequences.... So they are both running at the same time (this is completely inadvertently...) Next we start to scan the series which has just been ignored by the library manager, guess what happens? No episode index number! We can finger print the file okay, but we won't know it's index. Long story short, it's probably easiest to check for the library manager running it's task... what ever task that is... and we'll stop and wait. Seems like an insignificant issue... but, we do use the index number in the title sequence task. If it is NULL in the database, we might run into trouble, and it would take a while to figure out just what happened. Kind of lucky it happened now actually. Edited August 26, 2021 by chef 1
Recommended Posts