Plugin: Export VODS from .m3u - split m3u livetv, tvshows, movies (Going BETA!!)

[mickle026 650]

4 minutes ago, gillmacca01 said:

Sorry for the confusion. I thought because the scheduled task said it was finished, that it was done. Didn't realise it hadn't actually finished 

Not sure how I'm going to send you that file

you don't need to, just copy and past an area for the problem item

[gillmacca01 211]

Nothing written since 17:01, this is the last few lines of the log:

[mickle026 650]

Just so you guys know I am aware of misdetection in items named like this:
 

EN - Moana 2 4K  (2024)
EN - Star Trek: Section 31 4K (2025)
EN - Sonic The Hedgehog 3 4K (2024)

My TV Show detection is misinterpreting the numbers before the year as season, episode.

I know about it and will resolve it after the issues currently here

[gillmacca01 211]

I have just tried running again, and it is stopping at exactly the same point. Tried downloaded the m3u via browser, and downloaded without an issue

[mickle026 650]

I am debugging this as we speak.

It might be something I did when I converted the code from the old plugin code 
I am making progress.

 

16.Mar.2025 - 17:43:39 Keeping [channelName] [7]: EN| CHRISTMAS 1 4K :Filtered by: 'EN|'
16.Mar.2025 - 17:43:39 Include / Ignore checking passed succesfully.
16.Mar.2025 - 17:43:39 Detected and removed country code: Modified string is 'CHRISTMAS 1 4K'
16.Mar.2025 - 17:43:39 Sanitized Channelname: CHRISTMAK
16.Mar.2025 - 17:43:39 Type: Live TV - Did not detect file extension (most likely a continuous stream): 
16.Mar.2025 - 17:43:39 Type: Live TV - Detected a Stream Url: '978715'
16.Mar.2025 - 17:43:39 groupTitle Folder omitted due to IgnoreGroupTitleFolder setting.

 

[mickle026 650]

@gillmacca01
I hope this has resolved the main issue and we can get back to sorting out the minor ones

VODtoSTRMscheduledTask.dll

[gillmacca01 211]

11 minutes ago, mickle026 said:

@gillmacca01
I hope this has resolved the main issue and we can get back to sorting out the minor ones

VODtoSTRMscheduledTask.dll 681.5 kB · 1 download

We have lift off...now downloading the m3u

[mickle026 650]

I have altered some of the season /episode detection logic as per
EN - Moana 2 4K (2024)
EN - Star Trek: Section 31 4K (2025)
EN - Sonic The Hedgehog 3 4K (2024)

so now its misinterpreting some tv shows as movie.....ffs!  !!!!

back to the drawing board there then ... 

[mickle026 650]

Alteration to TV Show/Movie detection
Alteration to Country Codes, not to remove "MR."

I'm going to watch some TV now, giving it a rest for tonight.

here is the last build for today.

VODtoSTRMscheduledTask.dll

[gillmacca01 211]

I won't be able to update the dll on my NAS till Friday now (apart from the one just posted), but it has now been 45 mins since anything has written to the log, and I am still missing movies and prefix of EN still exists (option is ticked)

[mickle026 650]

Is it still stopping in the same place?

Can you check the embyserver.txt file for any errors relating to the VODtoSTRMscheduledTask.dll or M3U To STRM?

[gillmacca01 211]

No error in embyserver.log, just line saying it had completed.

m3utostrm log ends without completing:

Due to run again at midnight, so will post in the morning, but only if it is different

[mickle026 650]

so its not downloaded your m3u?

try triggering it manually from the button on the bottom of the plugin, then we will know if its the task handler in scheduled task ending it early.

[mickle026 650]

There is something odd, because your file on my machine completes successfully.

[BigIrn 10]

This second to newest release has been running a loooong time. Is that to be expected? I don't see a verbose log, which one should I look at?

[BigIrn 10]

It finished. It is murdering my CPU. I'm going to have to restart emby. Which log do you guys want?

[BigIrn 10]

I had a lot of media with "EN " at the start of the title. I went ahead and updated to the latest DLL and running the task now.

Is there a plan as to when this task triggers? It would be nice to turn off from running if it's going to have downtime and media appearing/disappearing. How would you frame this expectation to your users?

[mickle026 650]

1 hour ago, BigIrn said:

I had a lot of media with "EN " at the start of the title. I went ahead and updated to the latest DLL and running the task now.

Is there a plan as to when this task triggers? It would be nice to turn off from running if it's going to have downtime and media appearing/disappearing. How would you frame this expectation to your users?

I am not sure I understand the question here....

The task trigger is set by you, you can add or remove them and set what time you want it to tun.
You can remove the trigger altogether and manually trigger it occasionally if you like.

click on it (not the trigger arrow but the header text)

Click Add Trigger

Set a trigger interval, which day at what time
Leave the Time Limit blank and it'll run until it completes

 

Quote

and media appearing/disappearing

This bit is up to you , the is an option in the settings to remove obsolete entries, you don't have to remove entries that are no longer in your m3u file but if your provider remooved them they they probably don't work.

Anyway, here is a newer build
I think I have fixed episode detection when there is a year range "ShowName (2000-2008) s01 e06" <- like that
There are a few other tweaks too.

VODtoSTRMscheduledTask.dll

[BigIrn 10]

52 minutes ago, mickle026 said:

I am not sure I understand the question here....

The task trigger is set by you, you can add or remove them and set what time you want it to tun.
You can remove the trigger altogether and manually trigger it occasionally if you like.

click on it (not the trigger arrow but the header text)

Click Add Trigger

Set a trigger interval, which day at what time
Leave the Time Limit blank and it'll run until it completes

 

This bit is up to you , the is an option in the settings to remove obsolete entries, you don't have to remove entries that are no longer in your m3u file but if your provider remooved them they they probably don't work.

Anyway, here is a newer build
I think I have fixed episode detection when there is a year range "ShowName (2000-2008) s01 e06" <- like that
There are a few other tweaks too.

VODtoSTRMscheduledTask.dll 687.5 kB · 0 downloads

Yeah you nailed everything I was asking! Thanks for reading my mind

I do still worry why it’s using so much resources all of a sudden. This is an m4 16gb workhorse. I’ve played AAA games on it before lol

Edited March 17, 2025 by BigIrn

[gillmacca01 211]

I have left it running all night, and thought I would check this morning, before I set off to work in London for the week.

First, good news....it is starting to remove EN - looks like it will be a slow process, but in the right direction

Secondly, it looks like the missing movies have returned, but are shown as tv shows (I haven't updated to the latest dll yet, so that might fix it)

Now the bad news, under 'ignore words (contains)', I have the following: WWE,4K,BIBLICAL,TURKISH,FRENCH MOVIES,FOREIGN MOVIES,KOREAN,NORMAN WISDOM,SCHOOLING KIDS

4K is also in 'ignore words (starts with)', but I am seeing all the ones under 'contains' appearing in my VOD folder

I'm going to update to the newest dll now, and leave it running all day, and will report back this afternoon

 

Maybe another issue here, according to the logs, it has deleted an awful lot of content, but when I manually download the m3u and inspect, the content is in there. I have temporarily disabled the options for deleting, so unless you can see the issue, will leave that till everything else is sorted

 

Edited March 17, 2025 by gillmacca01

[BigIrn 10]

I am about to start refreshing the movies and TV Shows with the newest DLL but wanted to share this before I start. I let it run over night and emby was frozen again. I had to once again restart it. Getting a little more worried...

 

[mickle026 650]

6 hours ago, gillmacca01 said:

I have left it running all night, and thought I would check this morning, before I set off to work in London for the week.

First, good news....it is starting to remove EN - looks like it will be a slow process, but in the right direction

Secondly, it looks like the missing movies have returned, but are shown as tv shows (I haven't updated to the latest dll yet, so that might fix it)

Now the bad news, under 'ignore words (contains)', I have the following: WWE,4K,BIBLICAL,TURKISH,FRENCH MOVIES,FOREIGN MOVIES,KOREAN,NORMAN WISDOM,SCHOOLING KIDS

4K is also in 'ignore words (starts with)', but I am seeing all the ones under 'contains' appearing in my VOD folder

I'm going to update to the newest dll now, and leave it running all day, and will report back this afternoon

 

Maybe another issue here, according to the logs, it has deleted an awful lot of content, but when I manually download the m3u and inspect, the content is in there. I have temporarily disabled the options for deleting, so unless you can see the issue, will leave that till everything else is sorted

 

OK

This is probably by design at the moment

I explained that Includes are working in the way that they keep processing.
if you included EN| then it would just continue and 4K wouldn't even get looked for.

The idea was to get this running and outputting to the correct folders first.  Then I would circle back and look at this logic.
It seems that now is the time to do that.
 

40 minutes ago, BigIrn said:

I am about to start refreshing the movies and TV Shows with the newest DLL but wanted to share this before I start. I let it run over night and emby was frozen again. I had to once again restart it. Getting a little more worried...

 

Nothing has changed in the way the cpu is utilised.  The plugin should only use what its always been using, if emby is ramping up the cpu usage, please check if it doing something else as well in the background. Transcoding, Library Scan etc.....

Library Scan is the biggest use of resources on my system.  I have 3 machines running emby, 2 behave, but the one using win10 (oldest version) does this occasionally after restarting emby several times without restarting the system.

Just for my information what is your system, how many cpu cores etc?

[gillmacca01 211]

I have also completed restarted. Delete the VOD and m3u files, and in the config file the fields populated are 'include words (starts with)' and 'ignore words (starts with)'. All boxes are ticked except 'output vod grouping' and remove files.vm Verbose logging is on. Been running since 10:20 and no m3u files have been created yet

[mickle026 650]

10 minutes ago, gillmacca01 said:

I have also completed restarted. Delete the VOD and m3u files, and in the config file the fields populated are 'include words (starts with)' and 'ignore words (starts with)'. All boxes are ticked except 'output vod grouping' and remove files.vm Verbose logging is on. Been running since 10:20 and no m3u files have been created yet

Yeah, now is the time to amend the code to ensure that the ignore words are checked even if you chose to keep (include) an item.

This is the way it should work I think.
 

10 minutes ago, gillmacca01 said:

Been running since 10:20 and no m3u files have been created yet

The time taken is because of the logging, but I get it, without the logging how do you know what's going on...

Can anyone else program in c# lol  ?

 

I altered the include/ignore logic to process all of the items in these boxes

VODtoSTRMscheduledTask.dll

Edited March 17, 2025 by mickle026

[mickle026 650]

This was the previous logic

 

                    await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Checking [Include] Contains", config.chkLogVerbose).ConfigureAwait(false);

                    bool Keep = await ShouldKeepEntryContainsAsync(counter, metadata.GroupTitle, metadata.MovieName, config, currentlog, log).ConfigureAwait(false);
                    if (!Keep)
                    {
                        await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Checking [Include] StartsWith", config.chkLogVerbose).ConfigureAwait(false);

                        Keep = await ShouldKeepEntryStartsWithAsync(counter, metadata.GroupTitle, metadata.MovieName, config, currentlog, log).ConfigureAwait(false);
                    }

                    if (!Keep)
                    {
                        await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Checking [Ignore] Contains", config.chkLogVerbose).ConfigureAwait(false);
                        bool Ignore = await ShouldIgnoreEntryContainsAsync(counter, metadata.GroupTitle, metadata.MovieName, config, currentlog, log).ConfigureAwait(false);
                        if (Ignore)
                        {
                            continue;
                        }
                        if (!Ignore)
                        {
                            await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Checking [Ignore] StartsWith", config.chkLogVerbose).ConfigureAwait(false);
                            Ignore = await ShouldIgnoreEntryStartsWithAsync(counter, metadata.GroupTitle, metadata.MovieName, config, currentlog, log).ConfigureAwait(false);
                            {
                                continue;
                            }
                        }

                    }
                    await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Include / Ignore checking passed succesfully.", config.chkLogVerbose).ConfigureAwait(false);
                  

This is the logic now
 

                    // Include checking [contains]
                    await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Checking [Include] Contains", config.chkLogVerbose).ConfigureAwait(false);
                    await ShouldKeepEntryContainsAsync(counter, metadata.GroupTitle, metadata.MovieName, config, currentlog, log).ConfigureAwait(false);

                    // Include checking [startswith]
                    await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Checking [Include] StartsWith", config.chkLogVerbose).ConfigureAwait(false);
                    await ShouldKeepEntryStartsWithAsync(counter, metadata.GroupTitle, metadata.MovieName, config, currentlog, log).ConfigureAwait(false);

                    // Ignore checking [contains]
                    await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Checking [Ignore] Contains", config.chkLogVerbose).ConfigureAwait(false);
                    bool Ignore = await ShouldIgnoreEntryContainsAsync(counter, metadata.GroupTitle, metadata.MovieName, config, currentlog, log).ConfigureAwait(false);
                    if (Ignore)
                    {
                        continue;
                    }

                    // Ignore checking [startswith]
                    await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Checking [Ignore] StartsWith", config.chkLogVerbose).ConfigureAwait(false);
                    Ignore = await ShouldIgnoreEntryStartsWithAsync(counter, metadata.GroupTitle, metadata.MovieName, config, currentlog, log).ConfigureAwait(false);
                    if (Ignore)
                    {
                        continue;
                    }

                    // Include / Ignore checking passed
                    await log.LogToMyFile(currentlog, $"{DateTime.Now:dd.MMM.yyy - HH:mm:ss} Include / Ignore checking passed succesfully.", config.chkLogVerbose).ConfigureAwait(false);

This means skip this m3u entry and continue with the next
 

if (Ignore)
{
     continue;
}

If you can see anything wring with this logic let me know