Server not reading local metadata

[tired dad 28]

hi,

 

the latest beta says this:

 

Local metadata is king. If we see local metadata for an item, we will not go out to the internet. Period. This means as new features are added you may have to manually re-scan, but having predictability is better for everyone involved.

 

I have the server set up to leave the metadata alone as it tends to rename to sort titles I don't like.  However, I see movies popping up with no description, even though meta<browser/> has all of the movies.xml files already downloaded.  Pressing "refresh" fromt he media library web page has worked on some movies, but not all.

 

On top of that, I'm still having the issue of the library randomly growing and shrinking in size; but I'd like to at least solve this missing metadata issue.

 

 

[Luke 37094]

Probably going to need some concrete examples, with sample xml files, screenshots of the editor, screenshots of the file system, steps to reproduce the problem, etc.

[tired dad 28]

Probably going to need some concrete examples, with sample xml files, screenshots of the editor, screenshots of the file system, steps to reproduce the problem, etc.

 

Sure thing, here you go:

 

File called "sidebyside" is the screengrab showing both meta<browser/> with the data and MB Server without.  File "two" shows the metadata after pressing refresh and the option to refresh all metadata is selected, while "three" shows that the movie.xml file does indeed exist.  The movie.xml file is attached for your review.

 

Step taken:

 

max_anger=10

For x =1 to "max_anger"

Press "refresh"

next x

 

(sorry, a little basic humour...)

 

Anyway, pressing refresh had no effect.  I tried refreshing the library a few times (that's when movies started disappearing and re-appearing,at one point 50% were missing) as well as starting the servers as both a Windows service and just as the program.   No effect.

 

I deleted the XML file so that meta<browser/> would re-do it, which it did, but the server still doesn't see the data.  The refresh option via the client machine does nothing either.  This is on the latest build of both client and server.

 

I tried a second example with a brand new file and folder where once again, I used meta<browser/> to find the data first to make sure the xml file existed.  I then went to the media library, where I saw what you see in "ballet1"; after pressing "edit", I got to the standards screen and then pressed "refresh", but nothing happened.  Both files are on the same server, but different drives.  For fun, I rescanned the library (again losing half the movies in the database, but no error messages), and the second movie showed up (file "four"), but the first did not (file "five").

 

Most of the missing data is from movies on the second server.  I used to have the first server run MB as a service, which used to work fine until one of the later server builds and then I started getting "access to path denied" errors, so I switched to the application loading at startup as per one of the suggestions.  Seems odd that this has started to happen.

 

movie.zip

Edited March 11, 2014 by tired dad

[Luke 37094]

did you check the server log for errors?

[ebr 14921]

Am I inferring correctly that you have two MB servers accessing the same data at the same time?

[Hedwig 1]

Re my topic :

Scan Media Library is no longer correct

 

Indeed refreshing does not help.

 

According to me MB3 is not reading the movie.xml file as was before. The fields Name, Sort Name, Overview, Release date, Year are not filled up with data (these are the ones I use).

Tab PEOPLE also remains compeltely empty (although the actors are know in the db).

 

It would help if the Refrech button reads in the the data from the movie.xml but even better would be if a rescan of all media library would accomplish this (or both).

[JAJ 11]

I am also having the same issue as described above.... Did not happen till last server update. Previously all metadata showed up fine. I have the issue when viewing my content threw MBC.

[Hedwig 1]

I did a new test ... and result is exactly the same.
 
This is what I did:
 
1. Made a new folder on different PC > D:\Video
2. Add subfolder Twistys (D:\Video\Twistys) >> refers to a collection
3. Add subfolder : Housesitter Surprise (D:\Video\Twistys\Housesitter Surprise).
4. Add movie to this folder (exactly the same name (Housesitter Surprise.mp4) + Folder.jpg + Backdrop.jpg (pictures).
 
5. Started MCM to produce movie.xml in same folder.
 
6. Started MB3.

 

Copy of movie.xml :

 

<?xml version="1.0" encoding="utf-8"?>
<Title>
    <Added>6/12/2013 17:09:15</Added>
    <LocalTitle>Housesitter Surprise</LocalTitle>
    <OriginalTitle>Housesitter Surprise</OriginalTitle>
    <SortTitle>Housesitter Surprise</SortTitle>
    <Persons></Persons>
    <ForcedTitle></ForcedTitle>
    <ProductionYear>2013</ProductionYear>
    <RunningTime>32</RunningTime>
    <IMDBrating></IMDBrating>
    <IMDbId></IMDbId>
    <IMDB></IMDB>
    <MPAARating>Unrated</MPAARating>
    <Revenue>0</Revenue>
    <Budget>0</Budget>
    <Description>No Data</Description>
    <TMDbId></TMDbId>
    <Collection>Capri Cavanni</Collection>
    <Studios>
        <Studio>Twistys</Studio>
    </Studios>
    <Genres>
        <Genre>Test</Genre>
    </Genres>
    <VideoAspect>1.778:1</VideoAspect>
    <VideoBitrate>10000000</VideoBitrate>
    <VideoCodec>x264</VideoCodec>
    <VideoCodecType>H.264</VideoCodecType>
    <VideoCodecRaw>AVC</VideoCodecRaw>
    <VideoFileSize>2553605418</VideoFileSize>
    <VideoHeight>720</VideoHeight>
    <VideoLength>32</VideoLength>
    <VideoLengthSeconds>1938</VideoLengthSeconds>
    <VideoQuality>Great (720p HD)</VideoQuality>
    <VideoWidth>1280</VideoWidth>
    <AudioBitrate>128000</AudioBitrate>
    <AudioChannels>2</AudioChannels>
    <AudioCodec>AAC</AudioCodec>
    <AudioCodecRaw>AAC</AudioCodecRaw>
    <AudioFrequency>48000</AudioFrequency>
    <AspectRatio>1,78:1</AspectRatio>
    <MediaInfo>
        <Video>
            <Codec>x264</Codec>
            <FFCodec>H.264</FFCodec>
            <BitRate>10000000</BitRate>
            <Height>720</Height>
            <Width>1280</Width>
            <FrameRate>29.970</FrameRate>
            <Duration>32</Duration>
            <DurationSeconds>1938</DurationSeconds>
            <ScanType>Progressive</ScanType>
        </Video>
        <Audio>
            <Codec>AAC</Codec>
            <FFCodec>AAC</FFCodec>
            <Channels>2</Channels>
            <BitRate>128000</BitRate>
            <Language></Language>
        </Audio>
    </MediaInfo>
    <VideoHasSubtitles>False</VideoHasSubtitles>
    <Type></Type>
</Title>

 

Server log : server-63530068888.log

 

 

 

There is now 1 movie in the db.

 

As you can see most fields are empty ...

 

Tab People is also empty.

 

 

[ebr 14921]

I don't see much in the xml file.

 

There is no overview and there are no actors or other people defined...

[Luke 37094]

Re my topic :

Scan Media Library is no longer correct

 

Indeed refreshing does not help.

 

According to me MB3 is not reading the movie.xml file as was before. The fields Name, Sort Name, Overview, Release date, Year are not filled up with data (these are the ones I use).

Tab PEOPLE also remains compeltely empty (although the actors are know in the db).

 

It would help if the Refrech button reads in the the data from the movie.xml but even better would be if a rescan of all media library would accomplish this (or both).

 

That's exactly what it does. can you do it again and post a log? the one from the other thread doesn't indicate any obvious problem.

[tired dad 28]

Am I inferring correctly that you have two MB servers accessing the same data at the same time?

Nope... one server install, two machines with media on them.  I like to keep certain things separate and I had spare hardware lying around, so why not.   Never had an issue under MB2

[tired dad 28]

Re my topic :

Scan Media Library is no longer correct

 

Indeed refreshing does not help.

 

According to me MB3 is not reading the movie.xml file as was before. The fields Name, Sort Name, Overview, Release date, Year are not filled up with data (these are the ones I use).

Tab PEOPLE also remains compeltely empty (although the actors are know in the db).

 

It would help if the Refrech button reads in the the data from the movie.xml but even better would be if a rescan of all media library would accomplish this (or both).

 

That's exactly what it does. can you do it again and post a log? the one from the other thread doesn't indicate any obvious problem.

 

Same thing here... refreshing does nothing for some files, and works on others.  I am going to rebuild my library and do a refresh once the kids go to bed.  Also forgot to mention, I did try removing the library.db file but that didn't help either.

[Luke 37094]

removing the library.db file is not a documented procedure, so until we have that kind of reset button in the dashboard, it's going to be problematic if you try and do it yourself. as it turns out, if you're going to do that, you also need to delete refreshinfo.db. But that procedure is subject to change at anytime without any notice.

[Luke 37094]

@@Hedwig

 

what is the folder type you picked when adding D:\Video\Twistys to the library?

[tired dad 28]

removing the library.db file is not a documented procedure, so until we have that kind of reset button in the dashboard, it's going to be problematic if you try and do it yourself. as it turns out, if you're going to do that, you also need to delete refreshinfo.db. But that procedure is subject to change at anytime without any notice.

Yeah, I did remove both after reading another thread and thinking it would solve my problems.  It was just another attempt at troubleshooting.  For the record, I have also removed some folders that contain movies with "unreadable" xml files from the MB server media library and added them again, to no effect.

Edited March 11, 2014 by tired dad

[tired dad 28]

Interesting, the log says this ...

2014-03-10 22:44:25.8296 Info - LibraryMonitor: Stopping directory watching for path \\kentaurus\kids new
2014-03-10 22:44:39.8374 Error - LibraryMonitor: Error in Directory watcher for: \\kentaurus\Kochab new
    Too many changes at once in directory:\\kentaurus\Kochab new.
    System.IO.InternalBufferOverflowException
    No Stack Trace Available
 

For almost all drives on the one PC.

Edited March 11, 2014 by tired dad

[tired dad 28]

I did a new test ... and result is exactly the same.

 

This is what I did:

 

1. Made a new folder on different PC > D:\Video

2. Add subfolder Twistys (D:\Video\Twistys) >> refers to a collection

3. Add subfolder : Housesitter Surprise (D:\Video\Twistys\Housesitter Surprise).

4. Add movie to this folder (exactly the same name (Housesitter Surprise.mp4) + Folder.jpg + Backdrop.jpg (pictures).

 

5. Started MCM to produce movie.xml in same folder.

 

6. Started MB3.

 

I did something similar... took a dummy file and called it "manhunter.mkv", added it to the drive that doesn't seem to be getting read.  I ran meta<browser/> and got the XML file.  This time, after a library refresh: success!

 

 

So... I went to update the metadata on the other files that are in the same folder, but no luck.  I created a new fake movie on another parent folder on the same drive and did a refresh, but nothing happened. 

 

Next step: reboot the server and another refresh.  Now I'm only missing ~38% of my movies and the new file added still doesn't show.

 

I went back to my original problem file and pressed refresh and nothing happened.  Then, a little pop up said "new movie added", but it was still missing its metadata, so I refreshed again.  The log for this is:

 

2014-03-10 23:23:38.4937 Debug - HttpServer: HTTP POST http://kore:8096/mediabrowser/Items/06542ea56490e0d8940d3064a260cf11/Refresh?forced=true&recursive=true

2014-03-10 23:23:38.5197 Debug - App: Running FolderXmlProvider for \\kentaurus\eltamin new\(500) Days of Summer (2009)

2014-03-10 23:23:38.5267 Debug - App: FolderXmlProvider returned no metadata for \\kentaurus\eltamin new\(500) Days of Summer (2009)

2014-03-10 23:23:38.5267 Debug - App: Saving \\kentaurus\eltamin new\(500) Days of Summer (2009) to database.

2014-03-10 23:23:39.5268 Debug - App: Running MovieXmlProvider for \\kentaurus\eltamin new\(500) Days of Summer (2009)\(500) Days of Summer.mkv

2014-03-10 23:23:39.5378 Debug - App: MovieXmlProvider returned no metadata for \\kentaurus\eltamin new\(500) Days of Summer (2009)\(500) Days of Summer.mkv

2014-03-10 23:23:39.5378 Debug - App: Running BaseGenreCleaner for \\kentaurus\eltamin new\(500) Days of Summer (2009)\(500) Days of Summer.mkv

2014-03-10 23:23:39.5518 Debug - App: Running FFProbeProvider for \\kentaurus\eltamin new\(500) Days of Summer (2009)\(500) Days of Summer.mkv

2014-03-10 23:23:39.6268 Debug - App: Running VideoImageProvider for \\kentaurus\eltamin new\(500) Days of Summer (2009)\(500) Days of Summer.mkv

2014-03-10 23:23:44.1141 Debug - ProviderManager: Saving image to \\kentaurus\eltamin new\(500) Days of Summer (2009)\(500) Days of Summer-poster.jpg

2014-03-10 23:23:44.3031 Debug - App: Saving \\kentaurus\eltamin new\(500) Days of Summer (2009)\(500) Days of Summer.mkv to database.

2014-03-10 23:23:44.3781 Debug - HttpServer: HTTP Response 204 to [fe80::6d6c:1580:a03:9cd%11]:53556. Response time: 5884.3366 ms

    Url: http://kore:8096/mediabrowser/Items/06542ea56490e0d8940d3064a260cf11/Refresh?forced=true&recursive=true

2014-03-10 23:23:45.1621 Debug - HttpServer: HTTP GET http://kore:8096/mediabrowser/Users/1b1b258053f41dbb750d7bbce69e2216/Items/06542ea56490e0d8940d3064a260cf11

2014-03-10 23:23:45.1621 Debug - HttpServer: HTTP Response 200 to [fe80::6d6c:1580:a03:9cd%11]:53556. Response time: 724.0415 ms

    Url: http://kore:8096/mediabrowser/Users/1b1b258053f41dbb750d7bbce69e2216/Items/06542ea56490e0d8940d3064a260cf11

2014-03-10 23:23:45.4161 Debug - HttpServer: HTTP GET http://kore:8096/mediabrowser/Items/06542ea56490e0d8940d3064a260cf11/ExternalIdInfos

2014-03-10 23:23:45.4221 Debug - HttpServer: HTTP Response 200 to [fe80::6d6c:1580:a03:9cd%11]:53556. Response time: 7.0004 ms

    Url: http://kore:8096/mediabrowser/Items/06542ea56490e0d8940d3064a260cf11/ExternalIdInfos

2014-03-10 23:23:45.4221 Debug - HttpServer: HTTP GET http://kore:8096/mediabrowser/Localization/ParentalRatings

2014-03-10 23:23:45.4361 Debug - HttpServer: HTTP Response 200 to [fe80::6d6c:1580:a03:9cd%11]:53557. Response time: 21.0012 ms

    Url: http://kore:8096/mediabrowser/Localization/ParentalRatings

2014-03-10 23:24:04.3562 Debug - HttpServer: HTTP GET http://kore:8096/mediabrowser/Users/1b1b258053f41dbb750d7bbce69e2216/Items?Recursive=true&Limit=3&Filters=IsNotFolder&SortBy=DateCreated&SortOrder=Descending&ImageTypes=Primary&Ids=ca04efcf1e08ca1a283059ad7c40f607

2014-03-10 23:24:04.3852 Debug - HttpServer: HTTP Response 200 to [fe80::6d6c:1580:a03:9cd%11]:53556. Response time: 29.0016 ms

    Url: http://kore:8096/mediabrowser/Users/1b1b258053f41dbb750d7bbce69e2216/Items?Recursive=true&Limit=3&Filters=IsNotFolder&SortBy=DateCreated&SortOrder=Descending&ImageTypes=Primary&Ids=ca04efcf1e08ca1a283059ad7c40f607

2014-03-10 23:24:04.4092 Debug - HttpServer: HTTP GET http://kore:8096/mediabrowser/Items/ca04efcf1e08ca1a283059ad7c40f607/Images/Primary?width=100&tag=5f13cc9696874e5f675a3a3620cb3361

2014-03-10 23:24:04.6462 Debug - HttpServer: HTTP Response 200 to [fe80::6d6c:1580:a03:9cd%11]:53556. Response time: 237.0136 ms

    Url: http://kore:8096/mediabrowser/Items/ca04efcf1e08ca1a283059ad7c40f607/Images/Primary?width=100&tag=5f13cc9696874e5f675a3a3620cb3361

 

 

I've highlighted what I think is a problem line; the xml file exists and is readable, so I have no idea why the program can't load it.

 

Edited March 11, 2014 by tired dad

[tired dad 28]

did you check the server log for errors?

Yes, see some of my responses above.

[Hedwig 1]

To Administrators :

 

You are wright about the actors ... I made a mistake there with the dummy file.

 

So I just did the test over again...

 

There are now 4 actors (Actor1, Actor2, etc.).

 

The Overview is 'This file is a dummy ... just meant for test reasons.'

 

Result is still the same... no data filled in.

 

As i can read in serval posts in this community i am not the only one with this problem, which started immediately after the big release of end february...

Something is really going wrong here...i mean when it concerns movies that cannot be fetched on the internet, and it doesn't matter if the folder type is  Movies, Home Movies or Adult Movies...

 

This is the new movie.xml file (produced by MCM)

 

<?xml version="1.0" encoding="utf-8"?>
<Title>
    <Added>11/03/2014 12:20:42</Added>
    <LocalTitle>Housesitter Surprise</LocalTitle>
    <OriginalTitle>Housesitter Surprise</OriginalTitle>
    <SortTitle>Housesitter Surprise</SortTitle>
    <Description>This file is a dummy ... just meant for test reasons.</Description>
    <Genres>
        <Genre>Mystery</Genre>
    </Genres>
    <ProductionYear>2014</ProductionYear>
    <Persons>
        <Person>
            <Name>Actor1</Name>
            <Type>actor</Type>
            <Role>unknown</Role>
        </Person>
        <Person>
            <Name>Actor2</Name>
            <Type>actor</Type>
            <Role>unknown</Role>
        </Person>
        <Person>
            <Name>Actor3</Name>
            <Type>actor</Type>
            <Role>unknown</Role>
        </Person>
        <Person>
            <Name>Actor4</Name>
            <Type>actor</Type>
            <Role>unknown</Role>
        </Person>
    </Persons>
    <ForcedTitle></ForcedTitle>
    <RunningTime>30</RunningTime>
    <IMDBrating></IMDBrating>
    <IMDbId></IMDbId>
    <IMDB></IMDB>
    <MPAARating>X-Rated</MPAARating>
    <Revenue>0</Revenue>
    <Budget>0</Budget>
    <TMDbId></TMDbId>
    <Collection>Twistys</Collection>
    <Studios>
        <Studio>Twistys</Studio>
    </Studios>
    <VideoAspect>1.778:1</VideoAspect>
    <VideoBitrate>10000000</VideoBitrate>
    <VideoCodec>x264</VideoCodec>
    <VideoCodecType>H.264</VideoCodecType>
    <VideoCodecRaw>AVC</VideoCodecRaw>
    <VideoFileSize>2553605418</VideoFileSize>
    <VideoHeight>720</VideoHeight>
    <VideoLength>32</VideoLength>
    <VideoLengthSeconds>1938</VideoLengthSeconds>
    <VideoQuality>Great (720p HD)</VideoQuality>
    <VideoWidth>1280</VideoWidth>
    <AudioBitrate>128000</AudioBitrate>
    <AudioChannels>2</AudioChannels>
    <AudioCodec>AAC</AudioCodec>
    <AudioCodecRaw>AAC</AudioCodecRaw>
    <AudioFrequency>48000</AudioFrequency>
    <AspectRatio>1,78:1</AspectRatio>
    <MediaInfo>
        <Video>
            <Codec>x264</Codec>
            <FFCodec>H.264</FFCodec>
            <BitRate>10000000</BitRate>
            <Height>720</Height>
            <Width>1280</Width>
            <FrameRate>29.970</FrameRate>
            <Duration>32</Duration>
            <DurationSeconds>1938</DurationSeconds>
            <ScanType>Progressive</ScanType>
        </Video>
        <Audio>
            <Codec>AAC</Codec>
            <FFCodec>AAC</FFCodec>
            <Channels>2</Channels>
            <BitRate>128000</BitRate>
            <Language></Language>
        </Audio>
    </MediaInfo>
    <VideoHasSubtitles>False</VideoHasSubtitles>
    <Type></Type>
</Title>

[Luke 37094]

i still need my folder type question answered

[Hedwig 1]

As i said in previous post ... there is no difference

 

Previous test was Adult Movie (no fetchers)

 

Last Test was Movies.

 

I tried several times with a changed folder type ... didn't help...

 

I even tried with a changed folder type in the main db with complete rescan ... no change what so ever...

[ebr 14921]

What version of MetaBrowser are you guys using?

 

Is it possible that MetaBrowser is creating some new (or old) format that we cannot read?

[Hedwig 1]

MB3 = Version 3.0.5171.19958

 

Media Center Master = Version 3.0.5171.19958

 

I noticed an error today in the logfile when starting up MB3:

 

What can cause Invalid local metadata ??

[ebr 14921]

I'm assuming that MCM version number is a typo since it is identical to ours...

[Hedwig 1]

Sorry ... Media Center Master v 2.10 (build 6514.56)

 

To Luke : do you need the movie.xml file ? I will send as message....