Jump to content


Photo

Lost all Genres

After one of the latest updat when I go to the metadata ed genre

Best Answer ronvp , 29 December 2013 - 08:42 AM

I found the issue. It repeats each and every time on each movie.  I use mostly MP4 files all complete with full Metadata, including the Genres. When I delete the Genres from the MP4 metadata, it all works perfectly. So somehow, when you have the Genres inside the MP4 metadata, it is pulled by the manual refresh and then it is not parsed causing the Genres to show as a single line. Anyway this can be fixed?

Go to the full post


  • Please log in to reply
58 replies to this topic

#41 ronvp OFFLINE  

ronvp

    Advanced Member

  • Members
  • 483 posts
  • Local time: 08:08 AM

Posted 25 December 2013 - 05:06 PM

I cannot find any leftover dll's or scrapers. but did notice that if I uninstall MB server, delete the cache as part of the uninstall and then re-install MB server, the genres show up correctly, but as soon as I hit a manual refresh, it is all messed up again..



#42 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 145887 posts
  • Local time: 09:08 AM

Posted 25 December 2013 - 09:07 PM

no



#43 WWWestern OFFLINE  

WWWestern

    Advanced Member

  • Members
  • 595 posts
  • Local time: 07:08 PM
  • LocationAtyrau, KZ

Posted 25 December 2013 - 07:37 PM

Is there some other cache that I may need to delete?

Get the tmdb id of the film, then find folder /data/tmdb-movies/%tmdb_id% where %tmdb_id% is tmdb id of the film. Anayze *.jason file(s). 

Normally there should be substring like this (exemple for tmdb id 64686):

"genres":[{"id":28,"name":"Action"},{"id":12,"name":"Adventure"},{"id":18,"name":"Drama"},{"id":14,"name":"Fantasy"}],

Share with us their content. 

 

If you delete them, refresh meta for movie.


Edited by WWWestern, 25 December 2013 - 01:45 PM.


#44 ronvp OFFLINE  

ronvp

    Advanced Member

  • Members
  • 483 posts
  • Local time: 08:08 AM

Posted 26 December 2013 - 04:06 PM

This is for movie ID:1271.

There are 2 files:  "eng.json" and "default.json".  Both have the following Genre strings:

 

"genres":[{"id":28,"name":"Action"},{"id":18,"name":"Drama"},{"id":36,"name":"History"},{"id":10752,"name":"War"}

 

These are different from what is pulled if I manually refresh the same movie. it actually pulls in a single genre string "Action,Fantasy,War" and deletes the others from the movie.xml file

 

I deleted both files and then did a refresh on just the single movie. Same issue is back..and it is only happening if I manually refresh a single movie in the metadata manager. And it is for every single movie.

 

Yesterday I visited my brother, and he has exactly the same problem. The genres are messed up in the movie.xml file as soon as you refresh a single movie manually from the metadata editor and it is for each and every movie.


Edited by ronvp, 26 December 2013 - 10:09 AM.


#45 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 145887 posts
  • Local time: 09:08 AM

Posted 26 December 2013 - 08:11 PM

the bad data likely came from when you had another scraper in use.

 

however, i just looked at the code and the refresh isn't replacing genres that are already there. so that's why the refresh isn't fixing them. it's just keeping your bad data as it is. this will be fixed for the next release. in the meantime you can manually fix by first removing all genres using the editor, saving, and then refreshing from the edit page.



#46 ronvp OFFLINE  

ronvp

    Advanced Member

  • Members
  • 483 posts
  • Local time: 08:08 AM

Posted 26 December 2013 - 07:23 PM

Luke, thanks, I note that even if I completely remove the movie.xml file for that movie and do a manual refresh, the bad genres keep coming back. is this coming from a cached file?  I note that I have most my movies in mp4 files with the genres in the metadata inside the mp4. is the data pulling from mp4 files or only from the web?

 

This morning I decided to bite the bullet and go through each file and make sure the genres are good and then lock the genre for that file. Is there any way to lock/unlock all genres at once?



#47 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 145887 posts
  • Local time: 09:08 AM

Posted 26 December 2013 - 09:38 PM

the xml file is just an output from our internal database. it's also an input if you change the contents of the file. but deleting the file has no effect. just use the web interface and you won't have to worry about it.

 

no bulk editing yet.



#48 ronvp OFFLINE  

ronvp

    Advanced Member

  • Members
  • 483 posts
  • Local time: 08:08 AM

Posted 26 December 2013 - 08:03 PM

Luke, I tried doing what you suggested (use the editor, deleted all genres, click save and then added the genres back in using the editor), no luck. I am now begining to think that my Raid drive's cache is causing some issues..but that really should not happen.

 

Also 2 more things;

 

1 - when I manually add a Genre using the editor, It sometimes it is inserted alphabetically, and sometimes it is not and just added on the bottom. Could this signal some misaligned data?

 

2 - I noticed duplication of Genres in the clients. I then started digging and found a few movies that had the same genre listed twice. Not sure if that really needs fixing, since it should normally not happen..but it does create some very strange effects..



#49 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 145887 posts
  • Local time: 09:08 AM

Posted 26 December 2013 - 08:08 PM

we don't do anything with genre order. if some were alphabetical, it's purely coincidental.



#50 ronvp OFFLINE  

ronvp

    Advanced Member

  • Members
  • 483 posts
  • Local time: 08:08 AM

Posted 26 December 2013 - 09:09 PM

Strange,, adding a Genre in the Web client editor will order them alphabetically, maybe it is ".net" doing it..  Anyway, I found the issue with the genres not updating and keep reverting back.. I deleted all "MBMovie.Json" files in the individual movie folders and now the problem is gone all is back to normal. Just out of curiosity, where did they come from? left over from a older version?



#51 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 145887 posts
  • Local time: 09:08 AM

Posted 26 December 2013 - 09:15 PM

those are from mb2 and/or the very early days of mb3 and deleting them will no have no impact. but you can certainly delete them to keep your folders clean.



#52 ronvp OFFLINE  

ronvp

    Advanced Member

  • Members
  • 483 posts
  • Local time: 08:08 AM

Posted 28 December 2013 - 09:31 AM

Here is what I found:

 

  1. After I fixed and manually locked the Genre metadata for each movie and then re-installed Genre Cleaner. The Genre cleaner was non functional. So I unlocked the genre metadata for a few movies and then the Genre Cleaner work as designed.
  2. With the Genre cleaner installed I did a manual refresh in the web client metadata editor on a few movies and all genres are wiped from the movie.xml file. I assume this is because the manual refresh pulls the genres unparsed as a single group and I do not have the genre cleaner configured with a un-parsed genre (like "Action,Adventure,War") and because the genre cleaner works by modifying the movie.xml file, it just causes the genres to be wiped completely.
  3. I uninstalled the Genre Cleaner and did a manual refresh from the webclient metadata editor and it pulls the genres as a single un-parsed group (Action, Adventure, War).
  4. I then proceeded to do the above on my brothers machine and he has exactly the same issues.

 

Conclusion:

  • If the Genres are locked in the web client metadata editor then the Genre Cleaner does not work because it can not modify the movie.xml
  • If the Genres are not locked then one can not use the manual refresh for that specific movie or the genres will be inserted in the movie.xml file as a single group.
  • Since this last issue appears on several server machines, there appears to be a bug with pulling/parsing Genre metadata if you do a manual refresh.
  • If you use the Genre Cleaner, you can not lock the Genre metadata for the movies that you like to see the Genre Cleaner to work on. The ability to manually disable the genre cleaner for a specific movie can either regarded as a feature.

Edited by ronvp, 28 December 2013 - 09:39 AM.


#53 ebr OFFLINE  

ebr

    Chief Bottle Washer

  • Administrators
  • 48929 posts
  • Local time: 09:08 AM

Posted 28 December 2013 - 04:22 PM

 

 

  • If the Genres are locked in the web client metadata editor then the Genre Cleaner does not work because it can not modify the movie.xml

 

This is by design.  If you lock a metadata field, that means we are not supposed to modify it - from anywhere.



#54 cylon OFFLINE  

cylon

    Advanced Member

  • Members
  • 94 posts
  • Local time: 12:08 AM
  • LocationBrisbane, Australia

Posted 28 December 2013 - 05:48 PM

I just deleted my genres for 300 (2007) in Metadata Manager and saved it. Here is the TMDB ID as a source reference:

http://www.themoviedb.org/movie/1271

 

Then I checked the movie.xml and they were removed as expected.

Then I clicked Refesh Metadata and the genres are back as follows for movie.xml:

<Genres>
    <Genre>Action</Genre>
    <Genre>Drama</Genre>
    <Genre>History</Genre>
    <Genre>War</Genre>
 </Genres>
 <Genre>Action|Drama|History|War</Genre>

Note how the genres are grouped on the last line with the pipe "|" delimiter. This must be something that MBS is scripted to do as it is not in the source.

Here is the "300 (2007).nfo" (I am also using the "Xbmc metadata saver" plugin):

 <genre>Action</genre>
 <genre>Drama</genre>
 <genre>History</genre>
 <genre>War</genre>

I have Genre Cleaner installed although it is not configured to manipulate any movie genres and none of the MBS metadata settings are disabled.

 

Lets start with the basics, what is the TMDB id you have for 300?


Edited by cylon, 28 December 2013 - 06:02 PM.


#55 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 145887 posts
  • Local time: 09:08 AM

Posted 28 December 2013 - 05:52 PM

everything looks normal there. we save genres in two different xml nodes, the piped one is for mb2 compatibility, but i'll remove that eventually.



#56 ronvp OFFLINE  

ronvp

    Advanced Member

  • Members
  • 483 posts
  • Local time: 08:08 AM

Posted 29 December 2013 - 08:42 AM   Best Answer

I found the issue. It repeats each and every time on each movie.  I use mostly MP4 files all complete with full Metadata, including the Genres. When I delete the Genres from the MP4 metadata, it all works perfectly. So somehow, when you have the Genres inside the MP4 metadata, it is pulled by the manual refresh and then it is not parsed causing the Genres to show as a single line. Anyway this can be fixed?



#57 ebr OFFLINE  

ebr

    Chief Bottle Washer

  • Administrators
  • 48929 posts
  • Local time: 09:08 AM

Posted 29 December 2013 - 10:57 AM

Ah, so it is reading that info from tags....



#58 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 145887 posts
  • Local time: 09:08 AM

Posted 29 December 2013 - 11:08 AM

yes that can be improved.



#59 ronvp OFFLINE  

ronvp

    Advanced Member

  • Members
  • 483 posts
  • Local time: 08:08 AM

Posted 29 December 2013 - 03:48 PM

Thanks.. that way I do not have to wade through all my movies removing the genres from the tags..







Also tagged with one or more of these keywords: After one of the latest updat, when I go to the metadata ed, genre

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users