DVR and metadata question

[saturnaqua 4]

I switched from using serverwmc/wmc with emby to pure emby for recording OTA shows. Seems to be working great, but I noticed that sometimes the shows it records are showing up wierd when I see the latest recordings. For instance, tonight, it recorded the sitcom "Schooled". Normally it would show a series banner, but tonight it did not. When I checked, it turns out before it was putting the recordings into a folder "Schooled (2019)\Season 1", but tonight it decided to put it into "Schooled\Season 1". I saw a similar issue last night with "The Flash" where it put it into a folder as if it was the 90's version of the show, not the one starting in 2014.

 

I ended up moving the shows to the correct folders with the correct years and then the display shows properly and I checked the logs but I'm not sure why it decides to place the recordings in the wrong spot initially.

 

I attached the log, but I guess the interesting part is:

2019-05-01 20:27:00.008 Info App: Recording timer fired for Schooled.
2019-05-01 20:27:00.010 Info HttpClient: GET https://www.thetvdb.com/api/GetSeriesByRemoteID.php?zap2it=EP02970576&language=en
2019-05-01 20:27:00.813 Info HttpClient: GET https://www.thetvdb.com/api/GetSeries.php?seriesname=Schooled&language=en
2019-05-01 20:27:01.430 Info HttpClient: GET https://www.thetvdb.com/api/B89CE93890E9419B/series/352016/all/en.zip
2019-05-01 20:27:01.974 Info App: MovieDbProvider: Finding id for item: Schooled
2019-05-01 20:27:01.974 Info HttpClient: GET https://api.themoviedb.org/3/search/tv?api_key=f6bd687ffa63cd282b6ff2c6877f2669&query=Schooled&language=en
2019-05-01 20:27:02.333 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&plot=full&r=json&s=Schooled&type=series
2019-05-01 20:27:02.597 Info App: Getting media sources for recording from channel 135823 135823
2019-05-01 20:27:02.598 Info App: Opening live stream for recording from channel 135823 135823
2019-05-01 20:27:02.599 Info App: Opening channel stream from Emby, external channel Id: hauppauge_9
2019-05-01 20:27:02.599 Info App: Streaming Channel hauppauge_9
2019-05-01 20:27:02.599 Info App: Live stream native_998ad3d028988bf113943887d48ba6c0_a7690f6963dcb6b3464cd97ea5565b10 consumer count is now 2
2019-05-01 20:27:02.638 Info MediaSourceManager: Live tv media info probe took 0.039013 seconds
2019-05-01 20:27:02.638 Info MediaSourceManager: Live stream opened: {"Protocol":"Http","Id":"native_998ad3d028988bf113943887d48ba6c0_a7690f6963dcb6b3464cd97ea5565b10","Path":"http://127.0.0.1:8096/LiveTv/LiveStreamFiles/f888247956704645a954556e97ad8e7b/stream.ts","Type":"Default","Container":"mpegts","IsRemote":false,"SupportsTranscoding":true,"SupportsDirectStream":true,"SupportsDirectPlay":false,"IsInfiniteStream":true,"RequiresOpening":true,"RequiresClosing":true,"LiveStreamId":"06044cf0e6f93cdae5f285c9ecfaaeb4_01413a525b3a9622ce6fdf19f7dde354_native_998ad3d028988bf113943887d48ba6c0_a7690f6963dcb6b3464cd97ea5565b10","RequiresLooping":false,"SupportsProbing":false,"MediaStreams":[{"Codec":"mpeg2video","TimeBase":"1/90000","CodecTimeBase":"1001/60000","VideoRange":"SDR","DisplayTitle":"720p MPEG2VIDEO","IsInterlaced":false,"BitRate":8000000,"RefFrames":1,"IsDefault":false,"IsForced":false,"Height":720,"Width":1280,"AverageFrameRate":59.94006,"RealFrameRate":59.94006,"Profile":"Main","Type":"Video","AspectRatio":"16:9","Index":-1,"IsExternal":false,"IsTextSubtitleStream":false,"SupportsExternalStream":false,"PixelFormat":"yuv420p","Level":4,"IsAnamorphic":false},{"Codec":"ac3","CodecTag":"AC-3","TimeBase":"1/90000","CodecTimeBase":"1/48000","DisplayTitle":"Dolby Digital 5.1","IsInterlaced":false,"ChannelLayout":"5.1","BitRate":384000,"Channels":6,"SampleRate":48000,"IsDefault":false,"IsForced":false,"Type":"Audio","Index":-1,"IsExternal":false,"IsTextSubtitleStream":false,"SupportsExternalStream":false,"Level":0}],"Formats":[],"Bitrate":8384000,"RequiredHttpHeaders":{},"ReadAtNativeFramerate":false}
2019-05-01 20:27:02.639 Info App: Will record to D:\Recorded TV\Schooled\Season 1\Schooled S01E12 CB Likes Lainey.ts for 35.956010645 minutes.

And here's a snippet from The Flash where it decided it was the 1990's version:

2019-04-30 19:57:00.000 Info App: Recording timer fired for The Flash.
2019-04-30 19:57:00.070 Info HttpClient: GET https://www.thetvdb.com/api/GetSeriesByRemoteID.php?zap2it=EP01922936&language=en
2019-04-30 19:57:00.438 Info HttpClient: GET https://www.thetvdb.com/api/GetSeries.php?seriesname=The+Flash&language=en
2019-04-30 19:57:00.525 Info HttpClient: GET https://www.thetvdb.com/api/B89CE93890E9419B/series/78650/all/en.zip
2019-04-30 19:57:01.011 Info App: MovieDbProvider: Finding id for item: The Flash
2019-04-30 19:57:01.011 Info HttpClient: GET https://api.themoviedb.org/3/search/tv?api_key=f6bd687ffa63cd282b6ff2c6877f2669&query=The+Flash&language=en
2019-04-30 19:57:01.428 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&plot=full&r=json&s=The+Flash&type=series
2019-04-30 19:57:01.890 Info App: Getting media sources for recording from channel 135832 135832
2019-04-30 19:57:01.976 Info App: Opening live stream for recording from channel 135832 135832
2019-04-30 19:57:01.986 Info App: Opening channel stream from Emby, external channel Id: hauppauge_1
2019-04-30 19:57:01.989 Info App: Streaming Channel hauppauge_1
2019-04-30 19:57:01.995 Info App: GetChannelStream: channel id: hauppauge_1. stream id: native_5fd6aeea2c161c9d1298e151521ac18c_a7690f6963dcb6b3464cd97ea5565b10
2019-04-30 19:57:01.996 Info App: Hauppauge GetChannelStream args "GetChannelStream" "1" "1" "native_5fd6aeea2c161c9d1298e151521ac18c_a7690f6963dcb6b3464cd97ea5565b10"
2019-04-30 19:57:03.769 Info App: Live stream opened after 2.5105ms
2019-04-30 19:57:03.770 Info App: Returning mediasource streamId native_5fd6aeea2c161c9d1298e151521ac18c_a7690f6963dcb6b3464cd97ea5565b10, mediaSource.Id native_5fd6aeea2c161c9d1298e151521ac18c_a7690f6963dcb6b3464cd97ea5565b10, mediaSource.LiveStreamId null
2019-04-30 19:57:03.872 Info MediaSourceManager: Live tv media info probe took 0.0604939 seconds
2019-04-30 19:57:03.873 Info MediaSourceManager: Live stream opened: {"Protocol":"Http","Id":"native_5fd6aeea2c161c9d1298e151521ac18c_a7690f6963dcb6b3464cd97ea5565b10","Path":"http://127.0.0.1:8096/LiveTv/LiveStreamFiles/49575c103d5247ccb5b8bb9f8cf3b509/stream.ts","Type":"Default","Container":"mpegts","IsRemote":false,"SupportsTranscoding":true,"SupportsDirectStream":true,"SupportsDirectPlay":false,"IsInfiniteStream":true,"RequiresOpening":true,"RequiresClosing":true,"LiveStreamId":"06044cf0e6f93cdae5f285c9ecfaaeb4_01413a525b3a9622ce6fdf19f7dde354_native_5fd6aeea2c161c9d1298e151521ac18c_a7690f6963dcb6b3464cd97ea5565b10","RequiresLooping":false,"SupportsProbing":false,"MediaStreams":[{"Codec":"mpeg2video","TimeBase":"1/90000","CodecTimeBase":"1001/60000","VideoRange":"SDR","DisplayTitle":"720p MPEG2VIDEO","IsInterlaced":false,"BitRate":8000000,"RefFrames":1,"IsDefault":false,"IsForced":false,"Height":720,"Width":1280,"AverageFrameRate":59.94006,"RealFrameRate":59.94006,"Profile":"Main","Type":"Video","AspectRatio":"16:9","Index":-1,"IsExternal":false,"IsTextSubtitleStream":false,"SupportsExternalStream":false,"PixelFormat":"yuv420p","Level":4,"IsAnamorphic":false},{"Codec":"ac3","CodecTag":"AC-3","TimeBase":"1/90000","CodecTimeBase":"1/48000","DisplayTitle":"Dolby Digital 5.1","IsInterlaced":false,"ChannelLayout":"5.1","BitRate":384000,"Channels":6,"SampleRate":48000,"IsDefault":false,"IsForced":false,"Type":"Audio","Index":-1,"IsExternal":false,"IsTextSubtitleStream":false,"SupportsExternalStream":false,"Level":0}],"Formats":[],"Bitrate":8384000,"RequiredHttpHeaders":{},"ReadAtNativeFramerate":false}
2019-04-30 19:57:03.878 Info App: Will record to D:\Recorded TV\The Flash (1990)\Season 5\The Flash S05E20 Gone Rogue.ts for 65.9353640233333 minutes.

I also attached a snip of the directory structure that got created.

 

Do I need to change some setting on the recorded tv library it automatically added or is there some other option I need to tweak somewhere for this? Or is there some source data not providing the right data upstream causing this issue?

Log.txt

[Luke 37099]

 

 

tonight it decided to put it into "Schooled\Season 1"

 

Hi, this is probably because there wasn't sufficient guide data to determine the series year. I have seen this with some of my test recordings and will be looking for possible improvements soon.

[saturnaqua 4]

Hi, this is probably because there wasn't sufficient guide data to determine the series year. I have seen this with some of my test recordings and will be looking for possible improvements soon.

Thanks Luke for this info. I'm kind of surprised the upstream provider for the guide data doesn't give that info every time, as it usually worked, but just a few random episodes must be falling through the cracks. At least I know I'm not crazy and there isn't something wrong with my setup.

[saturnaqua 4]

Just as an update, I think I figured out why it's not working, assuming the info you pull is based on thetvdb.com. For "Schooled", it looks like some info is missing (the ID and first air date) so when you search with the zap2it id EP02970576 then it doesn't find anything, however there is only one entry when it searches based on the name, so it placed it into the series name without a year.

 

Regarding "The Flash", EP01922936, however, when I manually pulled this up on thetvdb.com, it says the Schedules Direct/zap2it id starts with SH, not EP. So when it does the name lookup, three entries come back and the first one up is the 1990 version.

 

So I'm not sure which is right, since I look at the tvlistings.zap2it.com site and if I check on different shows, they all show the show id as starting with SH and the episode id starts with EP (here is "Schooled" from last night):

 

https://tvlistings.zap2it.com/overview.html?programSeriesId=SH02970576&tmsId=EP029705760012&aid=gapzap

 

SH02970576 <- Show ID

EP029705760012 <- Episode ID (looks like they take the show number and add 4 digit episode number to it)

 

So I guess the problem is thetvdb.com is not consistent (I checked like 6 shows) as some pages use EP and some use SH and in the case of Schooled, it's missing entirely. Maybe if EP doesn't work, Emby should try SH before falling back to general name search?

[Luke 37099]

That's great investigation, thanks for doing that. I'll take a look at this.

[Luke 37099]

I'm pushing an update to the tvdb plugin to start checking it both ways. Thanks !

[Carlo 4330]

Thanks Luke, that was quick.

[Luke 37099]

@@cayars i couldn't find the other topic from yesterday about the series year, but this might impact that as well.

[Carlo 4330]

@@cayars i couldn't find the other topic from yesterday about the series year, but this might impact that as well.

We'll know, soon enough if it helps with that as well.

[Luke 37099]

Where is that other topic?

[Carlo 4330]

Where is that other topic?

Is this the one you're thinking about?

https://emby.media/community/index.php?/topic/73072-dvr-creating-duplicates/?hl=cayars&do=findComment&comment=737221

[saturnaqua 4]

@@cayars i couldn't find the other topic from yesterday about the series year, but this might impact that as well.

The year missing might also be a thetvdb.com issue. When I looked at Schooled it is now missing the first air date. Looking in their forums seems to be a known issue shows added after a certain point aren't showing first air date anymore as it's supposed to automatically determine that from the first episode sure date. It's no longer a field that people can edit. If I remember later I'll edit the post with the link to their forums post.

 

Edit:

Per this post looks like it's a known problems some shows added more recently are not showing a first air date, hence no year when Emby queries for the show.

 

https://forums.thetvdb.com/viewtopic.php?f=116&t=47540&hilit=first+aired&start=10#p143227

 

That's not the reason they don't have a first aired date. All show added after the launch of the new site don't have a first aired date. It's a known bug and we don't know when it will be fixed.

Edited May 4, 2019 by saturnaqua

[Luke 37099]

Well yea that's where we're getting the value from.