Jump to content
TheKamakaZi

Odd XMLTV behaviour

Recommended Posts

TheKamakaZi

Hi guys,

I'm using RapidIPTV, and have realised that my XMLTV data isn't being handled as usual. For one, it no longer loads, and when I went to the scheduler, it completes a refresh in 6 seconds! Knowing that not even my server is this efficient, I dug deeper.

I eventually made it into the cache/xmltv directory, where I tried to view the cached xml files to see what's in there, only to be met with "this is a binary file" from `less`. After renaming it to xml.gz from xml, and then gunzip'ing them, I was able to view the files as normal.

This raises two questions:

1. Was something altered in the XMLTV file extension behaviour recently?

2. Are xml files stored in cache/xmltv supposed to be in xml or xml.gz format?

 

Share this post


Link to post
Share on other sites
TheKamakaZi

The plot thickens... Even when using the uncompressed URLs, it's still downloading as normal, but no mapping is taking place. I'm not even able to manually map channels. All it does is darken the screen when I try to map any channel from any data providers.

Share this post


Link to post
Share on other sites
Luke

Hi there, please attach the emby server log. thanks.

Share this post


Link to post
Share on other sites
TheKamakaZi
Posted (edited)

Hi Luke,

Below is the complete log from pushing 'Refresh Guide Data' to the end of the progress bar:

2020-08-12 20:38:47.116 Info HttpServer: HTTP POST http://<DELETED>:8096/ScheduledTasks/Running/9492d30c70f7f1bec3757c9d0a4feb45. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.105 Safari/537.36
2020-08-12 20:38:47.116 Info HttpServer: HTTP POST http://<DELETED>:8096/ScheduledTasks/Running/9492d30c70f7f1bec3757c9d0a4feb45. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.105 Safari/537.36
2020-08-12 20:38:47.120 Info HttpServer: HTTP Response 204 to <DELETED>. Time: 4ms. http://emby.lnb.za.net:8096/ScheduledTasks/Running/9492d30c70f7f1bec3757c9d0a4feb45
2020-08-12 20:38:47.120 Info HttpServer: HTTP Response 204 to <DELETED>. Time: 4ms. http://emby.lnb.za.net:8096/ScheduledTasks/Running/9492d30c70f7f1bec3757c9d0a4feb45
2020-08-12 20:38:47.161 Info HttpServer: HTTP GET http://<DELETED>:8096/ScheduledTasks?IsEnabled=true. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.105 Safari/537.36
2020-08-12 20:38:47.164 Info HttpServer: HTTP Response 200 to <DELETED>. Time: 2ms. http://<DELETED>:8096/ScheduledTasks?IsEnabled=true
2020-08-12 20:38:47.167 Info HttpServer: HTTP GET http://<DELETED>:8096/ScheduledTasks?IsEnabled=true. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.105 Safari/537.36
2020-08-12 20:38:47.168 Info HttpServer: HTTP Response 200 to <DELETED>. Time: 2ms. http://<DELETED>:8096/ScheduledTasks?IsEnabled=true
2020-08-12 20:38:50.449 Info HttpClient: GetTempFileResponse url: https://rapidiptv.tvip.xyz/epg_temp_dl/output-epgs/african-countries.xml
2020-08-12 20:38:53.244 Info HttpClient: GetTempFileResponse url: https://rapidiptv.tvip.xyz/epg_temp_dl/output-epgs/usa-canada.xml
2020-08-12 20:38:55.885 Info HttpClient: GetTempFileResponse url: https://rapidiptv.tvip.xyz/epg_temp_dl/output-epgs/united-kingdom.xml
2020-08-12 20:39:01.104 Info LiveTvManager: Refreshing guide with 7 days of guide data
2020-08-12 20:39:04.841 Info LiveTV: Loading live tv data from /config/data/livetv/seriestimers

Weird, right?

Edited by TheKamakaZi

Share this post


Link to post
Share on other sites
cayars
Posted (edited)

Hi,

He likely needs the actual server log attached.

Edited by cayars

Share this post


Link to post
Share on other sites
TheKamakaZi

My bad :) Here you go. From server startup to progress bar completed.

embyserver.log

Share this post


Link to post
Share on other sites
TheKamakaZi
Posted (edited)

So it seems to be an encoding issue in the xml files themselves. I tried another provider, and it was able to parse the data, albeit not line up with my streams providers' channels.

There may need to be further investigation into what makes these sources special.

Edited by TheKamakaZi

Share this post


Link to post
Share on other sites
kanipek
15 minutes ago, TheKamakaZi said:

So it seems to be an encoding issue in the xml files themselves. I tried another provider, and it was able to parse the data, albeit not line up with my streams providers' channels.

There may need to be further investigation into what makes these sources special.

If you can post the problematic file - in a sanitized version we might be able to figure out what the format issue is.

Share this post


Link to post
Share on other sites
TheKamakaZi
1 hour ago, kanipek said:

If you can post the problematic file - in a sanitized version we might be able to figure out what the format issue is.

I've included a copy of one of the feeds for your perusal. The provider chops them up by region.

usa-canada.xml.gz

Share this post


Link to post
Share on other sites
kanipek
2 hours ago, TheKamakaZi said:

I've included a copy of one of the feeds for your perusal. The provider chops them up by region.

usa-canada.xml.gz 1.37 MB · 2 downloads

Is this a complete copy of one of the regional files? If so then it has formatting problems. If not can you post a complete one?

Share this post


Link to post
Share on other sites
TheKamakaZi

Yep, that's the complete file. What formatting errors are you picking up? I'm currently parsing it through XTeVe, and it's working perfectly through it.

Share this post


Link to post
Share on other sites
kanipek
3 hours ago, TheKamakaZi said:

Yep, that's the complete file. What formatting errors are you picking up? I'm currently parsing it through XTeVe, and it's working perfectly through it.

I attached an example of an xmltv formatted file. This is what I have always used. All of the fields are not required and most of them are not used by the various providers. I think yours contains all of the required info it is just formatted differently. Mine has all of the channel information at the top followed by all of the program data.

example .xml

Share this post


Link to post
Share on other sites
Luke

@TheKamakaZi does this help?

Share this post


Link to post
Share on other sites
TheKamakaZi

Sorry, @Luke. My notifications stay disabled for some reason. 

I actually swapped over to using xTeVe, which was given the same URLs to consume, and works like a bomb! Although, a new issue has cropped up now. Every now and then, seemingly daily, the entire EPG seems to either disappear or corrupt itself. A whole bunch of fiddling later and it comes back to proper working order.

I'm still trying to find a pattern and/or root cause, and will update you when I have.

Share this post


Link to post
Share on other sites
Luke

It could be that xteve or your tuner was unreachable at the time. It's hard to say. We'd have to go over an example. Thanks.

Share this post


Link to post
Share on other sites
TheKamakaZi

I completely forgot to provide feedback on this. Sorry guys.

It turns out that the XTeVe docker image doesn't adjust its timezone based on the TZ environment variable. This resulted in Emby attempting to pull XMLTV info after the pool was dry. Seems my IPTV provider only supplies 24 hours at a time.

I adjusted the frequencies to pull XMLTV in both XTeVe and Emby, and it's been working like a charm.

 

  • Like 1

Share this post


Link to post
Share on other sites
Luke

Thanks for the feedback.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×
×
  • Create New...