Custom collections not showing up

[levander 97]

Custom collections (created on identical basis of existing ones) are not picked up by emby anymore when put in .../data/collections folder. I did metadata refresh, collection scan and scan all libraries but nothing happens. Is this temporary interuption or something new decided by design? I remember this used to work just fine... 

*I have autobox plugin installed as well

[PenkethBoy 2068]

How were the missing ones created.? Did you copy them over from somewhere else? Were the folder names the same? 

One trick that works for missing playlists is to edit the xml file - just open and save in text editor so timestamp changes. Then if you have rtm on for collections emby will see the change. 

Unless you have the dB problem with collection items not being shown. 

Basically could be a number of things - need more details

[levander 97]

19 minutes ago, PenkethBoy said:

How were the missing ones created.? Did you copy them over from somewhere else? Were the folder names the same? 

One trick that works for missing playlists is to edit the xml file - just open and save in text editor so timestamp changes. Then if you have rtm on for collections emby will see the change. 

Unless you have the dB problem with collection items not being shown. 

Basically could be a number of things - need more details

Thanks for the answer. From what you wrote I assume that it should be working. 

I duplicated existing folder with xml, renamed the folder and edited xml in text editor changing only variables like names and paths. (on Mac btw)

Not sure I understood ‘the playlist trick’ you mentioned. 
How to be sure it’s not DB problem?

What details do you need?

 

Edited October 2, 2020 by levander

[PenkethBoy 2068]

If you make a test collection via Web gui called something you have never used before and add a couple of each item - ones that don't show and ones that do - what do you get. 

Also as you copied some across did you check permissions - check the debug log for when you did or do another - any errors? 

Let's stick to easy stuff first as dB errors are complex to fix

[levander 97]

I created collections via Webgui without problems. Showing items I put when created and items I added after creation. Everything works as it should. 
 

What do you mean by “...couple of each item - ones that don't show and ones that do...”?

[levander 97]

This is what I get in log when trying to manually add collection to the data folder...

Quote

2020-10-02 13:18:17.189 Error App: Error in Emby Xml
    *** Error Report ***
    Version: 4.5.0.50
    Command line: /Applications/EmbyServer.app/Contents/MacOS/EmbyServer.dll -psn_0_2785960 -noautorunwebapp
    Operating system: Darwin 18.7.0 Darwin Kernel Version 18.7.0: Mon Apr 27 20:09:39 PDT 2020; root:xnu-4903.278.35~1/RELEASE_X86_64
    Framework: .NET Core 3.1.8
    OS/Process: x64/x64
    Runtime: Applications/EmbyServer.app/Contents/MacOS/System.Private.CoreLib.dll
    Processor count: 4
    Data path: /Users/ik/.config/emby-server
    Application path: /Applications/EmbyServer.app/Contents/MacOS
    System.Xml.XmlException: System.Xml.XmlException: An error occurred while parsing EntityName. Line 24, position 97.
       at System.Xml.XmlTextReaderImpl.Throw(Exception e)
       at System.Xml.XmlTextReaderImpl.Throw(String res, Int32 lineNo, Int32 linePos)
       at System.Xml.XmlTextReaderImpl.HandleEntityReferenceAsync(Boolean isInAttributeValue, EntityExpandType expandType)
       at System.Xml.XmlTextReaderImpl.ParseTextAsync_ParseEntity(Int32 outOrChars, Char[] chars, Int32 pos, Int32 rcount, Int32 rpos, Int32 orChars, Char c)
       at System.Xml.XmlTextReaderImpl.ParseTextAsync_AsyncFunc(Task`1 task)
       at System.Xml.XmlTextReaderImpl.FinishPartialValueAsync()
       at System.Xml.XmlTextReaderImpl._GetValueAsync()
       at System.Xml.XmlReader.InternalReadContentAsStringAsync()
       at System.Xml.XmlSubtreeReader.ReadContentAsStringAsync()
       at System.Xml.XmlSubtreeReader.ReadContentAsStringAsync()
       at System.Xml.XmlReader.ReadElementContentAsStringAsync()
       at MediaBrowser.LocalMetadata.Parsers.BaseItemXmlParser`1.GetLinkedChild(XmlReader reader)
       at MediaBrowser.LocalMetadata.Parsers.BoxSetXmlParser.FetchFromCollectionItemsNode(XmlReader reader, MetadataResult`1 item)
       at MediaBrowser.LocalMetadata.Parsers.BoxSetXmlParser.FetchDataFromXmlNode(XmlReader reader, MetadataResult`1 item)
       at MediaBrowser.LocalMetadata.Parsers.BaseItemXmlParser`1.Fetch(MetadataResult`1 item, String metadataFile, XmlReaderSettings settings, Encoding encoding, CancellationToken cancellationToken)
       at MediaBrowser.LocalMetadata.BaseXmlProvider`1.GetMetadata(ItemInfo info, IDirectoryService directoryService, CancellationToken cancellationToken)
       at MediaBrowser.Providers.Manager.MetadataService`2.RefreshWithProviders(MetadataResult`1 metadata, TIdType id, MetadataRefreshOptions options, List`1 providers, ItemImageProvider imageService, CancellationToken cancellationToken)
    Source: System.Private.Xml
    TargetSite: Void Throw(System.Exception)

I don’t have a clue what does itmean except it does have to do something with emby and xml

Edited October 2, 2020 by levander

[levander 97]

Interestingly when I duplicated the test collection I made in web gui log generated the same (looks like) error after scanning but the collection DID show up unlike the one I created manually. 
 

Quote

2020-10-02 13:18:17.189 Error App: Error in Emby Xml
    *** Error Report ***
    Version: 4.5.0.50
    Command line: /Applications/EmbyServer.app/Contents/MacOS/EmbyServer.dll -psn_0_2785960 -noautorunwebapp
    Operating system: Darwin 18.7.0 Darwin Kernel Version 18.7.0: Mon Apr 27 20:09:39 PDT 2020; root:xnu-4903.278.35~1/RELEASE_X86_64
    Framework: .NET Core 3.1.8
    OS/Process: x64/x64
    Runtime: Applications/EmbyServer.app/Contents/MacOS/System.Private.CoreLib.dll
    Processor count: 4
    Data path: /Users/ik/.config/emby-server
    Application path: /Applications/EmbyServer.app/Contents/MacOS
    System.Xml.XmlException: System.Xml.XmlException: An error occurred while parsing EntityName. Line 24, position 97.
       at System.Xml.XmlTextReaderImpl.Throw(Exception e)
       at System.Xml.XmlTextReaderImpl.Throw(String res, Int32 lineNo, Int32 linePos)
       at System.Xml.XmlTextReaderImpl.HandleEntityReferenceAsync(Boolean isInAttributeValue, EntityExpandType expandType)
       at System.Xml.XmlTextReaderImpl.ParseTextAsync_ParseEntity(Int32 outOrChars, Char[] chars, Int32 pos, Int32 rcount, Int32 rpos, Int32 orChars, Char c)
       at System.Xml.XmlTextReaderImpl.ParseTextAsync_AsyncFunc(Task`1 task)
       at System.Xml.XmlTextReaderImpl.FinishPartialValueAsync()
       at System.Xml.XmlTextReaderImpl._GetValueAsync()
       at System.Xml.XmlReader.InternalReadContentAsStringAsync()
       at System.Xml.XmlSubtreeReader.ReadContentAsStringAsync()
       at System.Xml.XmlSubtreeReader.ReadContentAsStringAsync()
       at System.Xml.XmlReader.ReadElementContentAsStringAsync()
       at MediaBrowser.LocalMetadata.Parsers.BaseItemXmlParser`1.GetLinkedChild(XmlReader reader)
       at MediaBrowser.LocalMetadata.Parsers.BoxSetXmlParser.FetchFromCollectionItemsNode(XmlReader reader, MetadataResult`1 item)
       at MediaBrowser.LocalMetadata.Parsers.BoxSetXmlParser.FetchDataFromXmlNode(XmlReader reader, MetadataResult`1 item)
       at MediaBrowser.LocalMetadata.Parsers.BaseItemXmlParser`1.Fetch(MetadataResult`1 item, String metadataFile, XmlReaderSettings settings, Encoding encoding, CancellationToken cancellationToken)
       at MediaBrowser.LocalMetadata.BaseXmlProvider`1.GetMetadata(ItemInfo info, IDirectoryService directoryService, CancellationToken cancellationToken)
       at MediaBrowser.Providers.Manager.MetadataService`2.RefreshWithProviders(MetadataResult`1 metadata, TIdType id, MetadataRefreshOptions options, List`1 providers, ItemImageProvider imageService, CancellationToken cancellationToken)
    Source: System.Private.Xml
    TargetSite: Void Throw(System.Exception)

 

[PenkethBoy 2068]

that error looks like a problem with the xml file format - where were they created?

as for a coupole of each - two from a collectionthat does not work and two from a collection that does work - i.e. test if they ALL appear in a manually created one

[levander 97]

4 minutes ago, PenkethBoy said:

that error looks like a problem with the xml file format - where were they created?

as for a coupole of each - two from a collectionthat does not work and two from a collection that does work - i.e. test if they ALL appear in a manually created one

As I said I created them by duplicating existing ones that do work and those were created by autobox plugin. 

[PenkethBoy 2068]

so sounds like you may have messed up the edit of the xml files - have you compared them?

[Happy2Play 9780]

Would need to see the xml to see what is at "Line 24, position 97."

[levander 97]

2 hours ago, Happy2Play said:

Would need to see the xml to see what is at "Line 24, position 97."

That xml have only 16 lines...

[levander 97]

Is there a way to reset collections? I only have those generated by auto box plugin. 

[Happy2Play 9780]

35 minutes ago, levander said:

Is there a way to reset collections? I only have those generated by auto box plugin. 

What do you mean by reset?  If you mean delete, delete every collection via the ui or empty the /Users/ik/.config/emby-server/data/collection folder and do a scan on the Collection Library.  A full scan would trigger the plugin to regenerate the boxsets again.

[PenkethBoy 2068]

3 hours ago, Happy2Play said:

Would need to see the xml to see what is at "Line 24, position 97."

those are code lines and position not the xml file

[levander 97]

21 minutes ago, Happy2Play said:

What do you mean by reset?  If you mean delete, delete every collection via the ui or empty the /Users/ik/.config/emby-server/data/collection folder and do a scan on the Collection Library.  A full scan would trigger the plugin to regenerate the boxsets again.

I will try to delete collection folder, disable auto box plugin, scan libraries and then see what happens. 

[levander 97]

So I deleted collection folder under data folder, I uninstalled AutoBox Plugin and scanned the libraries. The result is : 232 collections named "Father of The Bride" and each one containing 2 same items. In data/collection folder there is folder named Father of The Bride [boxset] containing poster and fanart but no xml. Go figure.

[Happy2Play 9780]

Not sure what is going on with the duplication, if you delete "Father of The Bride [boxset]" from the folder and only scan the Collections Library do they disappear?

 

But as for original problem I has no issue copying a existing [boxset] folder renaming folder, editing xml to my needs and putting it back in data\collections folder and scanning collections or wait on RTM if you have it enable on Collection library.

I am on Windows and used Notepad++ to edit xml.

[levander 97]

33 minutes ago, Happy2Play said:

Not sure what is going on with the duplication, if you delete "Father of The Bride [boxset]" from the folder and only scan the Collections Library do they disappear?

 

But as for original problem I has no issue copying a existing [boxset] folder renaming folder, editing xml to my needs and putting it back in data\collections folder and scanning collections or wait on RTM if you have it enable on Collection library.

I am on Windows and used Notepad++ to edit xml.

Thanks Happy2Play

I had to manually delete each collection from web gui and now it looks clean. 

I also have no issues copying existing boxset folder and make it work but why I cannot create one without copying? It seems it worked just fine as I remember and as it is reported here: 

I would like to be able to generate collections to my needs like this but I am not even able to make it work by creating xml file with textedit. So what do you think is the catch?

[Happy2Play 9780]

1 hour ago, levander said:

but I am not even able to make it work by creating xml file with textedit

Could we see an example.

I copied the example with minor changes and had not issues with that template for Custom [boxset\]collection.xml.

<?xml version="1.0" encoding="UTF-8"?>
<Item>

  <LockData>false</LockData>

  <LocalTitle>Collection Title</LocalTitle>

  <DisplayOrder>PremiereDate</DisplayOrder>

  <CollectionItems>
    <CollectionItem>
      <Path>path to movie</Path>
    </CollectionItem>
  </CollectionItems>
 
</Item>

 

Edited October 3, 2020 by Happy2Play

[levander 97]

12 hours ago, Happy2Play said:

Could we see an example.

I copied the example with minor changes and had not issues with that template for Custom [boxset\]collection.xml.

<?xml version="1.0" encoding="UTF-8"?>
<Item>

  <LockData>false</LockData>

  <LocalTitle>Collection Title</LocalTitle>

  <DisplayOrder>PremiereDate</DisplayOrder>

  <CollectionItems>
    <CollectionItem>
      <Path>path to movie</Path>
    </CollectionItem>
  </CollectionItems>
 
</Item>

 

I copied this text in txt file I created with textedit, added path of random item and renamed file to collection.xml and it works for me too now. But why exactly the same text which is generated with that program from the link won’t work? In addition the author of that post confirmed that it works. I don’t see the difference, do you?

[PenkethBoy 2068]

give us copies (of the files not cut and paste here)

 of one that works and one that does not

[levander 97]

I think I solved all the problems (for now).

1. Creating collections manually now works (I'm not sure if deleting all those duplicated/corrupted(?) collections helped or not)

2. Collections created with the script from the post I sent you now also works because I found the problem and fixed it:

Original script:

<CollectionItem>
${foreach movie.mediaFiles mediaFile} ${if first_mediaFile}<Path>${mediaFile.path}\\${mediaFile.filename}</Path>${end} ${end}
</CollectionItem>

Fixed:

<CollectionItem>
${foreach movie.mediaFiles mediaFile} ${if first_mediaFile}<Path>${mediaFile.path}/${mediaFile.filename}</Path>${end} ${end}
</CollectionItem>

 

[levander 97]

Thanks @PenkethBoy@Happy2Play

[Happy2Play 9780]

Was just going to say I had no issue with that template using TMM, but will assume some minor space errors when pasted on forum.  Must be a OS specific issue with the code ( \\ vs / ), but glad you figured it out.