Collections not rebuilding on new server

[Hoochee 12]

emby beta v 4.7.0.11 was previously hosted on a Thecus NAS, I've moved to a Win10 Pro NUC8 and downloaded stable version 4.6.4.0. I have Premiere so restored the Win server from a Thecus back-up. I checked all boxes for what to restore. Library paths changed because the emby was on the NAS with all the data, now it's not - Collections did not rebuild. I've run the restore from back up a couple more times. 

On my Thecus install they were all in programdata/data/collections although it was v 4.7. Maybe that's because it was originally a pre-4.6 server and retained the older structure?

I've searched for instructions other than these, which don't apply to servers 4.6 and later. Do I need to manually rebuild all the Collections?

[Carlo 4561]

Hi, have you checked the settings of the libraries to make sure it's set to create collections?
Have you run a full library scan since doing the restore after changing the paths of each library to point to the media?

[Happy2Play 9783]

You will see issues like this as it is a new database.  The old system has legacy collections linked to the old path /data/collection which is obsolete in a new install as there are created in /metadata/collections.

So a new database build will rely entirely on item metadata to create your collection.

We would need to go over a specific example to include item metadata.

[Hoochee 12]

1 hour ago, cayars said:

Hi, have you checked the settings of the libraries to make sure it's set to create collections?
Have you run a full library scan since doing the restore after changing the paths of each library to point to the media?

I have never seen a Library setting for that. There's one that allows importing from metadata downloaders but I've never enabled that.

I have done a couple of full scans.

31 minutes ago, Happy2Play said:

You will see issues like this as it is a new database.  The old system has legacy collections linked to the old path /data/collection which is obsolete in a new install as there are created in /metadata/collections.

So a new database build will rely entirely on item metadata to create your collection.

We would need to go over a specific example to include item metadata.

I had seen the new, manually created Collections folders were created in metadata/collections but only an image is placed there with no special metadata. What are asking for in an example?

[Happy2Play 9783]

3 minutes ago, Hoochee said:

I have never seen a Library setting for that. There's one that allows importing from metadata downloaders but I've never enabled that.

If you don't enable it then only items that have the <set> node in their nfo file will create a collection.  Or collections have to made manually.

Edited September 16, 2021 by Happy2Play

[Luke 42083]

That new option was part of the 4.6 announcement.

[Carlo 4561]

Go into a Library and turn on show advanced options. Then look for this:
 

[Hoochee 12]

39 minutes ago, Happy2Play said:

If you don't enable it then only items that have the <set> node in their nfo file will create a collection.  Or collections have to made manually.

I’m not averse to manually creating my Collections. I enabled the setting just now and then remembered why I don’t use it - it was causing creation of Collections where I had already created them manually. I’m guessing the duplication has something to do with how I Identified those I manually created.

Many of the collections have moved through two other server changes prior to 4.6. One of those required a path update in the .xml files, I did that, scanned, and they showed up. Some of the ones I want to move now were created after 4.6. 

Library full scan now complete and the old Collections didn’t populate.

 

@LukeThanks  I found and read the release notes.

 

Any other suggestions? Or do my comments indicate I didn’t do something already suggested?

If I let emby create the Collections will that mean they will import correctly in a future restore

 

[Happy2Play 9783]

As of 4.6 the item nfo has to have the <set> node to make a collection.  Or using the servers import option to match other node data to create the collection.

Example

Spoiler

<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<movie>
  <plot><![CDATA[It's a major double-cross when former police officer Brian O'Conner teams up with his ex-con buddy Roman Pearce to transport a shipment of "dirty" money for shady Miami-based import-export dealer Carter Verone. But the guys are actually working with undercover agent Monica Fuentes to bring Verone down.]]></plot>
  <outline><![CDATA[How Fast Do You Want It?]]></outline>
  <lockdata>false</lockdata>
  <lockedfields>Genres</lockedfields>
  <dateadded>2021-02-20 17:59:03</dateadded>
  <title>2 Fast 2 Furious</title>
  <originaltitle>2 Fast 2 Furious</originaltitle>
  <actor>
    <name>Paul Walker</name>
    <role>Brian O'Conner</role>
    <type>Actor</type>
    <tmdbid>8167</tmdbid>
    <imdbid>nm0908094</imdbid>
  </actor>
  <actor>
    <name>Tyrese Gibson</name>
    <role>Roman Pearce</role>
    <type>Actor</type>
    <tmdbid>8169</tmdbid>
    <imdbid>nm0879085</imdbid>
  </actor>
  <actor>
    <name>Eva Mendes</name>
    <role>Monica Fuentes</role>
    <type>Actor</type>
    <tmdbid>8170</tmdbid>
  </actor>
  <actor>
    <name>Ludacris</name>
    <role>Tej Parker</role>
    <type>Actor</type>
    <tmdbid>8171</tmdbid>
  </actor>
  <actor>
    <name>Cole Hauser</name>
    <role>Carter Verone</role>
    <type>Actor</type>
    <tmdbid>6614</tmdbid>
  </actor>
  <actor>
    <name>James Remar</name>
    <role>Agent Markham</role>
    <type>Actor</type>
    <tmdbid>1736</tmdbid>
  </actor>
  <actor>
    <name>Devon Aoki</name>
    <role>Suki</role>
    <type>Actor</type>
    <tmdbid>6278</tmdbid>
  </actor>
  <actor>
    <name>Thom Barry</name>
    <role>Agent Bilkins</role>
    <type>Actor</type>
    <tmdbid>8175</tmdbid>
  </actor>
  <actor>
    <name>Amaury Nolasco</name>
    <role>Orange Julius</role>
    <type>Actor</type>
    <tmdbid>17341</tmdbid>
  </actor>
  <actor>
    <name>Michael Ealy</name>
    <role>Slap Jack</role>
    <type>Actor</type>
    <tmdbid>8177</tmdbid>
  </actor>
  <actor>
    <name>Jin Au-Yeung</name>
    <role>Jimmy</role>
    <type>Actor</type>
    <tmdbid>8178</tmdbid>
  </actor>
  <actor>
    <name>Mark Boone Junior</name>
    <role>Detective Whitworth</role>
    <type>Actor</type>
    <tmdbid>534</tmdbid>
  </actor>
  <actor>
    <name>Mo Gallini</name>
    <role>Enrique</role>
    <type>Actor</type>
    <tmdbid>8180</tmdbid>
  </actor>
  <actor>
    <name>Roberto 'Sanz' Sanchez</name>
    <role>Roberto</role>
    <type>Actor</type>
    <tmdbid>928812</tmdbid>
  </actor>
  <actor>
    <name>John Cenatiempo</name>
    <role>Korpi</role>
    <type>Actor</type>
    <tmdbid>206398</tmdbid>
  </actor>
  <actor>
    <name>Eric Etebari</name>
    <role>Darden</role>
    <type>Actor</type>
    <tmdbid>1015836</tmdbid>
  </actor>
  <actor>
    <name>Neal H. Moritz</name>
    <role>Swerving Cop</role>
    <type>Actor</type>
    <tmdbid>11874</tmdbid>
  </actor>
  <actor>
    <name>Edward Finlay</name>
    <role>Agent Dunn</role>
    <type>Actor</type>
    <tmdbid>8179</tmdbid>
  </actor>
  <actor>
    <name>Troy Brown</name>
    <role>Paul Hackett</role>
    <type>Actor</type>
    <tmdbid>122294</tmdbid>
  </actor>
  <actor>
    <name>Corey Michael Eubanks</name>
    <role>Max Campisi</role>
    <type>Actor</type>
    <tmdbid>147207</tmdbid>
  </actor>
  <actor>
    <name>Sammy Maloof</name>
    <role>Joe Osborne</role>
    <type>Actor</type>
    <tmdbid>1614417</tmdbid>
  </actor>
  <actor>
    <name>Troy Robinson</name>
    <role>Feliz Vispone</role>
    <type>Actor</type>
    <tmdbid>1367499</tmdbid>
  </actor>
  <actor>
    <name>Sincerely A. Ward</name>
    <role>Slap Jack's Girlfriend</role>
    <type>Actor</type>
    <tmdbid>1614425</tmdbid>
  </actor>
  <actor>
    <name>Nievecita Dubuque</name>
    <role>Suki's Girl</role>
    <type>Actor</type>
    <tmdbid>1614441</tmdbid>
  </actor>
  <actor>
    <name>Mateo Herreros</name>
    <role>Detective</role>
    <type>Actor</type>
    <tmdbid>1614462</tmdbid>
  </actor>
  <actor>
    <name>Kerry Rossall</name>
    <role>Police Chase Cop</role>
    <type>Actor</type>
    <tmdbid>1402117</tmdbid>
  </actor>
  <actor>
    <name>Marc Macaulay</name>
    <role>Agent</role>
    <type>Actor</type>
    <tmdbid>6908</tmdbid>
  </actor>
  <actor>
    <name>Tony Bolano</name>
    <role>Gardener</role>
    <type>Actor</type>
    <tmdbid>321432</tmdbid>
  </actor>
  <actor>
    <name>Marianne M. Arreaga</name>
    <role>Police Chopper Pilot</role>
    <type>Actor</type>
    <tmdbid>1614452</tmdbid>
  </actor>
  <actor>
    <name>Tara Carroll</name>
    <role>Seductress</role>
    <type>Actor</type>
    <tmdbid>43449</tmdbid>
  </actor>
  <actor>
    <name>Tamara Jones</name>
    <role>Customs Technician</role>
    <type>Actor</type>
    <tmdbid>1536505</tmdbid>
  </actor>
  <director tmdbid="6482">John Singleton</director>
  <trailer>plugin://plugin.video.youtube/?action=play_video&amp;videoid=ZZGkV_xWGw4</trailer>
  <rating>5.9</rating>
  <year>2003</year>
  <sorttitle>2 Fast 2 Furious</sorttitle>
  <mpaa>PG-13</mpaa>
  <imdbid>tt0322259</imdbid>
  <tmdbid>584</tmdbid>
  <language>fr</language>
  <countrycode>FR</countrycode>
  <premiered>2003-06-05</premiered>
  <releasedate>2003-06-05</releasedate>
  <criticrating>36</criticrating>
  <tagline>How Fast Do You Want It?</tagline>
  <country>Germany</country>
  <country>United States of America</country>
  <genre>Action</genre>
  <genre>Crime</genre>
  <genre>Thriller</genre>
  <studio>Ardustry Entertainment</studio>
  <studio>Mikona Productions GmbH &amp; Co. KG</studio>
  <studio>Original Film</studio>
  <studio>Universal Pictures</studio>
  <set tmdbcolid="9485">
    <name>The Fast and the Furious Collection</name>
  </set>
  <uniqueid type="TmdbCollection">9485</uniqueid>
  <tmdbcollectionid>9485</tmdbcollectionid>
  <uniqueid type="Imdb">tt0322259</uniqueid>
  <uniqueid type="Tmdb">584</uniqueid>
  <id>tt0322259</id>
  <fileinfo>
    <streamdetails />
  </fileinfo>
</movie>

Does not have to be exactly like this as <set>anyname</set> will create a collection with that item in it also.  Also a item can be in multiple collections, a set node for each collection.

7 minutes ago, Hoochee said:

If I let emby create the Collections will that mean they will import correctly in a future restore

Theoretically yes as Emby would write the <set> node in the nfo file assuming you are writing nfo files.

[Hoochee 12]

I am writing nfo files. I’ll let emby create of them this time. 
 

thanks to all. 

[Happy2Play 9783]

2 minutes ago, Hoochee said:

I am writing nfo files. I’ll let emby create of them this time. 
 

thanks to all. 

Emby will only write the set node if you have the import option enabled on the library.

So if you do a one time then turn it off all future items have to be manually added to existing collections.

[Luke 42083]

Have your questions been answered?

[Hoochee 12]

@Luke  Yes, although no Collections have been created since I enabled "Import Collection information..." about 20 hours ago, and run a complete scan. I'm not going to be concerned with it more at the moment because on the new NUC8i5, Win 10 keeps freezing every few hours, the cooling fan runs at high speed, and I usually need to unplug the NUC8 to get it to power down. So when I get the replacement in a few days I'll be doing another server install, and will see how the Collections go with it. 

[Luke 42083]

Because you've already imported the library. As mentioned at the top of the library options dialog, changing library options at this point will require metadata refreshes of existing content if you want it to apply to them.

[Hoochee 12]

Got it. Won’t make that mistake on the next server install.