XmlTv Guide Data Provider - Call for Testers

[Chubby Arse 23]

I'm developing some middleware that will allow Emby to read an XmlTv file to populate it's guide data.

 

If you generate XmlTv files, I would appreciate some help in validating the output of the middleware against your data. If you are willing to help, I'll need your current XmlTv file.

 

What I will do, is run the Xml file through a test harness, that produces a verbose output file that lists the channels and all of the data it's read out in a readable format. What I would then like you to do, is to take 5-10 programme entries in the list and check the data in the file against your PVR software to check that all the data is correct:

• Timings
• Channel
• Title
• Description
• Series Information
• Everything else.

So, if you are willing to help me out, post your most current XmlTv file to this topic and the following information:

1. The software you use to generate the Xml file
2. The date you generated it
3. The region you are in (UK / AUS)
4. The software you currently consume the xml data with
5. Anything else you think I should know

We've already done this with a couple of AUS guys with good results, so I'm looking forward to hearing from you guys and proving the middleware ready for Emby to consume.

[rikiwi 32]

Hi Chubby Arse

 

Here's my Xmltv file (find attached) that ran an a schedule, an hour ago and was produced by EPG Collector.

I have set up EPG Collector to run at 10am and send the file to - C:\Users\Public\NPVR\Scripts\TVGuide.xml,  then NPVR to update EPG at 10.15am, and finally Emby to update at 10.30am.  

I'm in New Zealand - Wellington, Wharite transmitter - Terestrial signal/tuners - MHEG5

Format for channel ID = Service ID

Format for episode tag = Valid season and episode numbers only

I'm not doing any TV and Movie lookups in EPGCollector

I'm currently only collecting for 10 TV channels.

 

 

Let me know if you need anything else.

 

 

 

 

 

 

[Chubby Arse 23]

Hi Chubby Arse

 

Here's my Xmltv file (find attached) that ran an a schedule, an hour ago and was produced by EPG Collector.

I have set up EPG Collector to run at 10am and send the file to - C:\Users\Public\NPVR\Scripts\TVGuide.xml,  then NPVR to update EPG at 10.15am, and finally Emby to update at 10.30am.  

I'm in New Zealand - Wellington, Wharite transmitter - Terestrial signal/tuners - MHEG5

Format for channel ID = Service ID

Format for episode tag = Valid season and episode numbers only

I'm not doing any TV and Movie lookups in EPGCollector

I'm currently only collecting for 10 TV channels.

 

 

Let me know if you need anything else.

 

Hi, please find attached a zipped up text file with the data from you xml file. Could you please check it over - in particular the start / end date and the series information (where specified).

 

Thanks

NZ-TVGuide_Results_151941.zip

[rikiwi 32]

Reporting back:

 

I have checked several programs on different channels and the data looks good compared the EPG in NPVR..

However - Every program is repeated 16 times. I found this by selecting a program on the 1st date then using "Find Next" to locate the next instance until I arrived at the last date. (I'm collecting 7 days of data at a time)

 

I hope this helps.

Please let me know if you need more testing or info.

[Chubby Arse 23]

Thanks @@rikiwi

 

There seems to be 4 times duplication in your source file, for both channel data and programme data - which would lead to a 16 times duplication in the result file as it takes each channel listed and then reads out the programmes for that channel.

 

I'll need to talk to Luke about how or whether we would even handle duplication in a source file. Can you consult how you produce this file and determine if it should be duplicating?

[rikiwi 32]

Sorry for late reply, the community server was down for maintenance when I went to post.

 

I spent hours changing settings in EPG Collector to try and reduce the duplication's but to no avail, as every time I eliminated any of the 4 TSID entries for each channel, I got no data for that channel. So I have reverted to my original EPG Collector settings.

Maybe I'm not fully understanding your question.

 

Unfortunately I'm about to be travelling for the next 5 days. I will try to continue testing by remote desktop but I cant guarantee this. 

Edited February 11, 2016 by rikiwi

[Chubby Arse 23]

Sorry for late reply, the community server was down for maintenance when I went to post.

 

I spent hours changing settings in EPG Collector to try and reduce the duplication's but to no avail, as every time I eliminated any of the 4 TSID entries for each channel, I got no data for that channel. So I have reverted to my original EPG Collector settings.

Maybe I'm not fully understanding your question.

 

Unfortunately I'm about to be travelling for the next 5 days. I will try to continue testing by remote desktop but I cant guarantee this. 

 

It's OK - we will handle the duplicates in the implementation. If you can't determine why your XML tool produces duplicate data, then we wouldn't want you to be unable to use the service if there is something we can do about it.

[Chubby Arse 23]

@rikiwi

 

I've made some changes to ignore duplicates - would you please look over this results file to ensure everything is included and the dups are gone. The file is a lot smaller, but needs checking. I can run for a more recent file if you'd rather. Let me know.

 

 

NZ-TVGuide_Results_161453.zip

[rikiwi 32]

Sorry about the very slow response, I'm just catching up with things at home after being away.

 

Please find attached my latest XMLTV file. (collected this morning) Note: onchannel has been deleted as I never used it (National Radio)

 

I have checked your file and it all looks very good. all channels and program times are good.

I noticed that some programs e.g. Six O' Clock News, Channel TV One, gets marked as a Repeat, so this must be how EPG Collector sees it. This is not important to me anyway.

 

Let me know if you need anything else.

[Mayankel 2]

Hi,

 

i use Webgrab to create my own xmltv file. I use this file in DVBLink and is full of metadata, take a look and if you need anything else, let me know.

 

This is just an example, my file is about 60 Mb an more than 120 channels.

 

Regards

guidexmltv.xml

Edited February 17, 2016 by Mayankel

[Chubby Arse 23]

Hi,

 

i use Webgrab to create my own xmltv file. I use this file in DVBLink and is full of metadata, take a look and if you need anything else, let me know.

 

This is just an example, my file is about 60 Mb an more than 120 channels.

 

Regards

 

If you can zip up the full xml file and post it to a share (or here if the limits allow), that would be a good test too.

 

I've attached the results file for your data - would you check it over for accuracy. Checking:

• All channels / programmes are present
• Start / End dates are correct
• Episode details etc are correct

Mayankel_guidexmltv_Results_083147.zip

[Chubby Arse 23]

Sorry about the very slow response, I'm just catching up with things at home after being away.

 

Please find attached my latest XMLTV file. (collected this morning) Note: onchannel has been deleted as I never used it (National Radio)

 

I have checked your file and it all looks very good. all channels and program times are good.

I noticed that some programs e.g. Six O' Clock News, Channel TV One, gets marked as a Repeat, so this must be how EPG Collector sees it. This is not important to me anyway.

 

Let me know if you need anything else.

 

Interestingly - this file doesn't contain the duplicate channels / programmes like before. I've run the file through and attached the results.

 

I couldn't find either "Six O' Clock News" or "Channel TV One" in the source or result of this file or the previous file. However, I can see why IsRepeat is being set to true - it's because some programmes have the <previously-shown> date set. Take this programme for example:

  <programme start="20160218005500 +1300" stop="20160218012500 +1300" channel="1201">
    <title>Shortland Street</title>
    <desc>Mo breaks Victoria’s heart. Bella’s caught in the crossfire. Lucy’s white knight steps out of the shadows.</desc>
    <category>Drama</category>
    <rating>
      <value>PGR</value>
    </rating>
    <video>
      <quality>HDTV</quality>
    </video>
    <audio>
      <stereo>dolby digital</stereo>
    </audio>
    <subtitles type="teletext" />
    <episode-num system="crid">1022173A . 10389949 . </episode-num>
    <previously-shown start="20000101000000 +1300" />
  </programme>

This is saying that the programme was previously show on New Year's Day 2000!! For some reason - your XML provider is including this, which based purely on the data is indicating that the programme is a repeat.

rikiwi_TVGuide_Results_084718.zip

Edited February 18, 2016 by Chubby Arse

[Mayankel 2]

 

If you can zip up the full xml file and post it to a share (or here if the limits allow), that would be a good test too.

 

I've attached the results file for your data - would you check it over for accuracy. Checking:

• All channels / programmes are present
• Start / End dates are correct
• Episode details etc are correct

 

 

Hi Chubby, i looked the file you atached and bassically all the channels and programs are ok, but there are some tags that you didn't import:

 

In all the programs:

 

-<programme channel="C+ Series HD" stop="20160217060400 +0100" start="20160217052500 +0100">
<title lang="es">Helix</title>
<title lang="en">Helix</title>
<sub-title lang="es">Vástago</sub-title>
<desc lang="es">Temporada 2 Episodio 3 - Peter y Jordan abandonan la seguridad de la abadía para recuperar algunos especímenes y dar con lo que habita en el bosque, mientras la hermana Amy hurde un plan para hacer que se marchen para siempre. Temporada 2 Episodio 3 - Segunda temporada de "Helix", serie de ciencia ficción creada por Cameron Porsandeh que sigue a un grupo de científicos del Centro de Control de Enfermedades, desplazados a una base de investigación de alta tecnología en el Ártico para investigar lo que parece un peligroso brote de un virus mortal. Enseguida acaban envueltos en algo mucho más serio y que tiene el potencial de acabar con toda la raza humana. Temporada 2 Episodio 3 - Está protagonizada por el nominado a un Globo de Oro Billy Campbell ("The Killing", "Once and Again", "Los 4400"), Steven Weber ("The Kennedys of Massachusetts"), Matt Long ("Mad Men", "The Newsroom", "Ghost Rider. El motorista fantasma"), Kyra Zagorsky ("Stargate: Atlantis", "Supernatural", "Motive") y Jordan Hayes ("La casa al final de la calle", "Amigos de más"), entre otros</desc>
-<credits>
<director>Cameron Porsandeh</director>
<actor>Billy Campbell</actor>
<actor>Kyra Zagorsky</actor>
<actor>Mark Ghanimé</actor>
</credits>
<date>2015</date>
<category lang="es">Series</category>
<category lang="es">Ciencia Ficción</category>
<icon src="http://www.plus.es/recorte/n/caratula4/F3038919"/>
<country>Canadá</country>
<country>EE.UU</country>
<episode-num system="xmltv_ns">1.2.0/1</episode-num>
<subtitles type="onscreen"/>
-<rating system="MPAA">
<value>TV-14</value>
</rating>
-<star-rating>
<value>4/5</value>
</star-rating>
</programme>

Your file:

 

Channel:           C+ Series HD - C+ Series HD 
StartDate:         17/02/2016 05:25:00
EndDate:           17/02/2016 06:04:00
Name:              Helix
Episode Detail:    Series 2, Episode 3, Part 1 of 1
Episode Title:     Vástago
Short Overview:    Temporada 2 Episodio 3 - Peter y Jordan abandonan la seguridad de la abadía para recuperar algunos especímenes y dar con lo que habita en el bosque, mientras la hermana Amy hurde un plan para hacer que se marchen para siempre. Temporada 2 Episodio 3 - Segunda temporada de "Helix", serie de ciencia ficción creada por Cameron Porsandeh que sigue a un grupo de científicos del Centro de Control de Enfermedades, desplazados a una base de investigación de alta tecnología en el Ártico para investigar lo que parece un peligroso brote de un virus mortal. Enseguida acaban envueltos en algo mucho más serio y que tiene el potencial de acabar con toda la raza humana. Temporada 2 Episodio 3 - Está protagonizada por el nominado a un Globo de Oro Billy Campbell ("The Killing", "Once and Again", "Los 4400"), Steven Weber ("The Kennedys of Massachusetts"), Matt Long ("Mad Men", "The Newsroom", "Ghost Rider. El motorista fantasma"), Kyra Zagorsky ("Stargate: Atlantis", "Supernatural", "Motive") y Jordan Hayes ("La casa al final de la calle", "Amigos de más"), entre otros
Categories:        Series, Ciencia Ficción
Credits:           Cameron Porsandeh - (Director), Billy Campbell - (Actor), Kyra Zagorsky - (Actor), Mark Ghanimé - (Actor)
PreviouslyShown:   
CopyrightDate:     01/01/2015 00:00:00
IsRepeat:          False

Where there's no "Country", "icon", "rating" and "star-rating", maybe because Emby can take this from internet but not for all the programs, 

 

 

Other problem is related with the title in the movies. I use two fields, the first one (title lang="es") is for the title in Spanish (my language) and the second one (title lang="en") is for the title in original language:

 

-<programme channel="C+ Estrenos HD" stop="20160218234500 +0100" start="20160218220000 +0100">
<title lang="es">Mi familia italiana</title>
<title lang="en">Latin Lover</title>
<desc lang="es">En un pueblo de la región de Puglia (al sur de Italia) se celebra el décimo aniversario de la muerte de Saverio Crispo, gran galán del cine italiano. A la ceremonia llegan sus cinco hijas, desperdigadas por el mundo, y dos ex mujeres, una italiana y la otra española. En el evento irrumpe Pedro del Río, el actor especialista que parece conocer al actor mejor que nadie. Entre ruedas de prensa, proyecciones y nocturnas revelaciones de secretos, las mujeres del gran divo se enfrentan en un torbellino de emociones y situaciones tragicómicas</desc>
-<credits>
<director>Cristina Comencini</director>
<actor>Virna Lisi</actor>
<actor>Marisa Paredes</actor>
<actor>Angela Finocchiaro</actor>
<actor>Valeria Bruni Tedeschi</actor>
<actor>Candela Peña</actor>
</credits>
<date>2015</date>
<category lang="es">Cine</category>
<category lang="es">Comedia</category>
<icon src="http://www.plus.es/recorte/n/caratula4/F3107369"/>
<country>Italia</country>
<subtitles type="onscreen"/>
-<rating system="MPAA">
<value>PG</value>
</rating>
-<star-rating>
<value>0/5</value>
</star-rating>
</programme>

And when you do the import, you just use the second title:

 

Channel:           C+ Estrenos HD - C+ Estrenos HD 
StartDate:         18/02/2016 22:00:00
EndDate:           18/02/2016 23:45:00
Name:              Latin Lover
Episode Detail:    
Episode Title:     
Short Overview:    En un pueblo de la región de Puglia (al sur de Italia) se celebra el décimo aniversario de la muerte de Saverio Crispo, gran galán del cine italiano. A la ceremonia llegan sus cinco hijas, desperdigadas por el mundo, y dos ex mujeres, una italiana y la otra española. En el evento irrumpe Pedro del Río, el actor especialista que parece conocer al actor mejor que nadie. Entre ruedas de prensa, proyecciones y nocturnas revelaciones de secretos, las mujeres del gran divo se enfrentan en un torbellino de emociones y situaciones tragicómicas
Categories:        Cine, Comedia
Credits:           Cristina Comencini - (Director), Virna Lisi - (Actor), Marisa Paredes - (Actor), Angela Finocchiaro - (Actor), Valeria Bruni Tedeschi - (Actor), Candela Peña - (Actor)
PreviouslyShown:   
CopyrightDate:     01/01/2015 00:00:00
IsRepeat:          False

And that's all, i've attached the full file with all the channels and 14 days of programs.

 

Thanks and best regards

xmltv.zip

[rikiwi 32]

Thanks

I've checked your file and all looking good.

 

For my repeat problem, I'm not sure at the moment how to fix this but will do more research.

 

Let me know if you need more files from me.

[Chubby Arse 23]

 

Where there's no "Country", "icon", "rating" and "star-rating", maybe because Emby can take this from internet but not for all the programs, 

 

I'm not sure that Country has a use in Emby - however, I will add the others as they are handled by Emby. It may not be in the first release, but I'll try to get it in.

[Chubby Arse 23]

 

Other problem is related with the title in the movies. I use two fields, the first one (title lang="es") is for the title in Spanish (my language) and the second one (title lang="en") is for the title in original language:

 

-<programme channel="C+ Estrenos HD" stop="20160218234500 +0100" start="20160218220000 +0100">
<title lang="es">Mi familia italiana</title>
<title lang="en">Latin Lover</title>
<desc lang="es">En un pueblo de la región de Puglia (al sur de Italia) se celebra el décimo aniversario de la muerte de Saverio Crispo, gran galán del cine italiano. A la ceremonia llegan sus cinco hijas, desperdigadas por el mundo, y dos ex mujeres, una italiana y la otra española. En el evento irrumpe Pedro del Río, el actor especialista que parece conocer al actor mejor que nadie. Entre ruedas de prensa, proyecciones y nocturnas revelaciones de secretos, las mujeres del gran divo se enfrentan en un torbellino de emociones y situaciones tragicómicas</desc>
-<credits>
<director>Cristina Comencini</director>
<actor>Virna Lisi</actor>
<actor>Marisa Paredes</actor>
<actor>Angela Finocchiaro</actor>
<actor>Valeria Bruni Tedeschi</actor>
<actor>Candela Peña</actor>
</credits>
<date>2015</date>
<category lang="es">Cine</category>
<category lang="es">Comedia</category>
<icon src="http://www.plus.es/recorte/n/caratula4/F3107369"/>
<country>Italia</country>
<subtitles type="onscreen"/>
-<rating system="MPAA">
<value>PG</value>
</rating>
-<star-rating>
<value>0/5</value>
</star-rating>
</programme>

And when you do the import, you just use the second title:

 

Channel:           C+ Estrenos HD - C+ Estrenos HD 
StartDate:         18/02/2016 22:00:00
EndDate:           18/02/2016 23:45:00
Name:              Latin Lover
Episode Detail:    
Episode Title:     
Short Overview:    En un pueblo de la región de Puglia (al sur de Italia) se celebra el décimo aniversario de la muerte de Saverio Crispo, gran galán del cine italiano. A la ceremonia llegan sus cinco hijas, desperdigadas por el mundo, y dos ex mujeres, una italiana y la otra española. En el evento irrumpe Pedro del Río, el actor especialista que parece conocer al actor mejor que nadie. Entre ruedas de prensa, proyecciones y nocturnas revelaciones de secretos, las mujeres del gran divo se enfrentan en un torbellino de emociones y situaciones tragicómicas
Categories:        Cine, Comedia
Credits:           Cristina Comencini - (Director), Virna Lisi - (Actor), Marisa Paredes - (Actor), Angela Finocchiaro - (Actor), Valeria Bruni Tedeschi - (Actor), Candela Peña - (Actor)
PreviouslyShown:   
CopyrightDate:     01/01/2015 00:00:00
IsRepeat:          False

And that's all, i've attached the full file with all the channels and 14 days of programs.

 

Thanks and best regards

 

 

Missed this bit - looks like we need to support selection of a language when there are multiple languages - and where there isn't a match (or the xml file doesn't have an lang="" attributes set, it returns the default. I'll have a think about how to do it and repost a results file.

[Alen 0]

Here is mine.

guide.xml.zip

[Luke 37008]

Ready for testing:

 

http://emby.media/community/index.php?/topic/35644-3111-xml-tv/

[phoenixaus 3]

*** Also posted here, sorry for duplicating http://emby.media/community/index.php?/topic/35557-xml-tv-guide/ ***

 

Hi Guys,

 

I'm trying to do something similar, however am starting to hit a dead end. I have had a search around, but not able to see where there is a fix to my issue. Current version is 3.1.78.0

 

I have moved completely away from WMC and am now using Emby for all my media needs (great software by the way). I also utilise DVBlink server to support 2 TV capture cards)

 

I'm based in Queensland, Australia and am using EPG Collector to gather EPG data from the various services. I am using this software to update DVBLink Server (automatically via its on plug-in system), and also run a separate collection for emby to consume. 

 

My issue is that I am not getting TV images into the Emby Live TV module. I appear to be getting some Movie information, but I am not 100% sure of where this is coming from. 

 

Current steps are:

1. EPG collector scans for EPG on each frequency then downloads the Poster data. The output of this is a TVguide.xml file similar to attached and poster images downloaded to an images\Tv series and images\Movies folders. This is updated by a Scheduled task to run every 12 Hours
   
2. In emby, I have added the TVGuide.xml as a Guide Provider, however I cannot Map channels (I get a completely clear page, which I suspect is something to do with using the DVBlink as opposed to the HDrun tuners)
   

How / Where do I configure emby to use the images in the XML file, or is it done automatically

 

Sample of TV show XML:

-<programme channel="578" stop="20160726162500 +1000" start="20160726161300 +1000">

<title>Ready, Steady, Wiggle!</title>

<sub-title>The Mango Walk</sub-title>

<desc>Professor Simon gives Emma a fun science lesson using a glass of orange juice while Anthony and Dorothy the Dinosaur learn about the alphabet using an apple, but all that learning makes Anthony hungry!</desc>

<category>Series - Children</category>

-<rating system="ACMA">

<value>G</value>

</rating>

<subtitles type="teletext"/>

<episode-num system="xmltv_ns">0 . 21 . 0/1</episode-num>

<date>2013</date>

<icon src="file://C:\ProgramData\Geekzone\EPG Collector\Images\TV Series\577e2f55-897a-450f-b656-7e30eea1090e.jpg"/>

</programme>

 

Any ideas? Or am I trying to do the impossible? I think Emby might be downloading the Movie images itself, but I cannot see where to configure it to download the TV series images,

TVGuide.xml

log.txt

[Luke 37008]

Hi, you can't mix DVBLink + XmlTV. XmlTV  is only for use with the built-in live tv services, which support HDHomerun. So in this scenario, the data and images from DVBLink are what is being utilized.

[phoenixaus 3]

Thanks Luke, so i'll look at a way of getting the images into DVBlink Server, then the theory is that Emby will be able to display these?

[Luke 37008]

Yes