Sort titles have been "reset" and had to manually scan my files again

[wollabille 17]

Dear Emby team

Yesterday I just added Bad boys Ride or Die. And normally my movies / episodes are being synced within a fair amount of time. But after 24+ hours it still hadn't shown up in my Emby overview.
This is when I also noticed that my movies where out of order, thinking I might had sorted them wrong, but they were alphabetical. 

So all the titles starting with "The" I always put the, "the" in the sort title. But this has been reset.
I for example also sort my movies so they are sorted by the same movie. For example Star Wars is not star wars - The sort title is for example return of the Jedi or what ever. 
And I like to keep these together. I think you get the idea. 

But as mentioned I just noticed yesterday evening that this was reset. 
My emby server is running and has been running on a NUC for like 4-5 years with Windows 10. I rarely go into the server because its running by it self without issues. 
I checked that I was running which it was 
I have added the latest Log file.

Also can you say/see in the logs why also it wasn't finding the new movie I added?
The server was ofc restarted. 
There is loads of space on my drive so its not a cache or anything issue. 
Hope you can help, thx.

From a Premium User.

embyserver.txt

[GrimReaper 4740]

16 minutes ago, wollabille said:

Yesterday I just added Bad boys Ride or Die. And normally my movies / episodes are being synced within a fair amount of time. But after 24+ hours it still hadn't shown up in my Emby overview.

Not sure why it wouldn't show, as it was both seen and identified:

Quote

2024-09-13 19:09:23.135 Info TheMovieDb: MovieDbProvider: Finding id for item: Bad Boys Ride or Die
2024-09-13 19:09:23.228 Info HttpClient: GET https://api.themoviedb.org/3/search/movie?api_key=x_secret3_x&query=Bad Boys Ride or Die&language=en-US&year=2024
2024-09-13 19:09:23.338 Info HttpClient: GET https://api.themoviedb.org/3/movie/573435?api_key=x_secret3_x&append_to_response=alternative_titles,reviews,casts,releases,images,keywords,trailers&language=en-US&include_image_language=en-US,null
2024-09-13 19:09:23.423 Info HttpClient: GET https://private.omdbapi.com?apikey=x_secret4_x&i=tt4919268&plot=short&r=json
2024-09-13 19:09:23.503 Info HttpClient: GET https://api.themoviedb.org/3/movie/573435?api_key=x_secret3_x&append_to_response=alternative_titles,reviews,casts,releases,images,keywords,trailers
2024-09-13 19:09:23.538 Info HttpClient: GET https://webservice.fanart.tv/v3/movies/573435?api_key=x_secret5_x

But your screenshot only shows "A" items so it wouldn't be shown there anyway, I think I can glimpse 4 Bad Boys posters in that last row where only top portion of posters is visible - you might scroll down a bit or sort library by Date Added. 

[wollabille 17]

52 minutes ago, GrimReaper said:

But your screenshot only shows "A" items so it wouldn't be shown there anyway, I think I can glimpse 4 Bad Boys posters in that last row where only top portion of posters is visible - you might scroll down a bit or sort library by Date Added. 

Correct, but im guessing i might not have made my self clear then, The movies with "The" in the title, i want these to be shown under The... 
And i see these titles here in the screenshot.
The accountant
The Addams family
The angry birds movie 1+2
The Avengers
The Avengers age of ultron - i know it doesnt say The in this title on the screenshot, but i have it sorted under The avengers normally. 

So again my question is why was this reset for all my movies? These were shown under The xxxx

 

Edited September 13, 2024 by wollabille

[GrimReaper 4740]

I was replying to Bad Boys part of your query, as already quoted:

1 hour ago, wollabille said:

Yesterday I just added Bad boys Ride or Die. And normally my movies / episodes are being synced within a fair amount of time. But after 24+ hours it still hadn't shown up in my Emby overview.

 

1 hour ago, wollabille said:

Also can you say/see in the logs why also it wasn't finding the new movie I added?

The server was ofc restarted. 
There is loads of space on my drive so its not a cache or anything issue. 

As for why your sort titles were reset/are not honored, I can't see anything in that log but maybe some fellow user or a Dev might. 

Edit: Do you have "After the initial import, automatically refresh metadata from the internet" library option enabled? If yes and sort titles were not locked, that might've resulted in them being overwritten. 

Edited September 13, 2024 by GrimReaper
Append

[wollabille 17]

27 minutes ago, GrimReaper said:

Do you have "After the initial import, automatically refresh metadata from the internet" library option enabled? If yes and sort titles were not locked, that might've resulted in them being overwritten. 

Where do I find this option?
But again I have clarify I have been a premium member for ages, and I have always since the start when I got emby the first time, been editing the meta data line "Sort title" was set to my liking.
And as stated in my first post, I have set it up once, never touched it since
So if an option like this that you ask for has snuck in. Then please do tell. 
My manual scanning the library was only to try to force the Bad Boys title to be shown in Emby.
 

[GrimReaper 4740]

2 minutes ago, wollabille said:

Where do I find this option?

In your library settings (Settings>Library tab>edit desired library). 

3 minutes ago, wollabille said:

So if an option like this that you ask for has snuck in. Then please do tell

No, it's been there for ages. 

3 minutes ago, wollabille said:

But again I have clarify I have been a premium member for ages, and I have always since the start when I got emby the first time, been editing the meta data line "Sort title" was set to my liking.
And as stated in my first post, I have set it up once, never touched it since

Then it is impossible to say when did this change occur, it might've been at any point in the past (and you've just noticed it now) during either manual or automatic metadata refresh, since it appears your custom sort title edits are not locked (notice the lock icon at the end of the input field) hence open for overwrite. 

6 minutes ago, wollabille said:

 

 

[Happy2Play 9781]

All sort titles are affected by the system.xml <SortRemoveWords> (not new).  So if they are all being removed your system.xml was reset.  If you never removed them there then you would have has to manually apply sort titles and locked them.

  <SortRemoveWords>
    <string>the</string>
    <string>a</string>
    <string>an</string>
  </SortRemoveWords>

 

But only way to fix sort titles is clear the sortremovewords string from xml restart Emby and Refresh metadata to redo them all again adding the words back.

Or manually hack on the database copy Name to SortTitle but still need to confirm xml is correct.

 

Dev really should move these to be accessible via the UI.

Edited September 14, 2024 by Happy2Play

[wollabille 17]

15 hours ago, Happy2Play said:

All sort titles are affected by the system.xml <SortRemoveWords> (not new).  So if they are all being removed your system.xml was reset.  If you never removed them there then you would have has to manually apply sort titles and locked them.

As mentioned, I have not been on my server for ages, because it has just been running flawlessly  
Where do I lock them? Is it the little lock at the end of the Sort title bar?

So do I delete all of this that I marked? Save and restart the server and then redo everything  

[Happy2Play 9781]

2 hours ago, wollabille said:

Where do I lock them? Is it the little lock at the end of the Sort title bar?

Yes if you are going to do this manually.

2 hours ago, wollabille said:

So do I delete all of this that I marked? Save and restart the server and then redo everything

  Sort of, edit your system.xml, restart and refresh your libraries.  A Refresh is needed to correct the SortTitle in the database automatically.

[wollabille 17]

1 hour ago, Happy2Play said:

Yes if you are going to do this manually.

  Sort of, edit your system.xml, restart and refresh your libraries.  A Refresh is needed to correct the SortTitle in the database automatically.

Thank for your taking your time. But im sorry if i might come out as stupid,  
If i understand it correctly i have 2 choices.
1: Redo the renaming manually and lock it. This should prevent it to reset again?
2: Edit my system.xml, this part i dont get 100% in regards to your answer, what do i need to edit? The screenshot i provided was from my system.xml where you wrote "is clear the sortremovewords string"  and i ask if i have to delete these lines marked in yellow? where you answer is sort off  sorry but this part confuses me.
Also as i wrote before in for example Start wars. I add the word star wars at the beginning of a the movie title : example 
Star wars 01 - The Phantom Menace
Star wars 02 - Attack of the clones
Star wars 03 - Clone wars
... etc you get it. So in this regard i will have to manually redo these again anyways? correct?

again thx for your patience, im not a hardcore coder, so these xml files and reading into these things is not my forte. 

[Happy2Play 9781]

4 hours ago, wollabille said:

1: Redo the renaming manually and lock it. This should prevent it to reset again?

Correct

4 hours ago, wollabille said:

2: Edit my system.xml, this part i dont get 100% in regards to your answer, what do i need to edit? The screenshot i provided was from my system.xml where you wrote "is clear the sortremovewords string"  and i ask if i have to delete these lines marked in yellow? where you answer is sort off  sorry but this part confuses me.
Also as i wrote before in for example Start wars. I add the word star wars at the beginning of a the movie title : example 
Star wars 01 - The Phantom Menace
Star wars 02 - Attack of the clones
Star wars 03 - Clone wars
... etc you get it. So in this regard i will have to manually redo these again anyways? correct?

I just remove the strings but believe you can remove the entire node as you highlighted.  Then a Library Refresh is needed for the server to rewrite all the SortTitles in the database.

<SortRemoveWords />

As for Star Wars yes you would have to manually correct these unless they are already locked as Refresh metadata will not touch locked items.

[wollabille 17]

Ok cool, well annoying that it was reset and we dont know the cause. But i will redo them and lock em  thx