Update casued 1/3 of library to dissapear, Next Up is gone, what is going on?

[halo00 2]

I've been looking through posts here and it seems I may be alone in experiencing these issues? I rebooted my Windows 2019 server due to updates from Microsoft and Emby is now all messed up. It seems Emby had an update as well?

My biggest problem is 1/3 of my library is gone, the files are (thankfully, given what I just read about the last library issue deleting actual files!) my files are all still there. However, despite repeated attempts to rescan all my libraries, and then use the Server Configuration Backup plugin to restore old backups, I cannot get the missing files to re-added to Emby's library.

As an example this show in Emby after repeated attempts to re scan the library and restore form backups.

The files on my hard drive.

Additionally, Next Up was removed on all platforms! My web front for my server, all Android clients (AndroidTV, phone, tablets), and Windows 10. It is listed as "Next Up (Legacy)" and can be re-added (pretty annoying) but what the heck? If its "legacy" what did you replace it with? I can't stay on this platform if it doesn't have "Next Up".

Next Up (Legacy) wth?

I can't wait the intrinsic delay in forum-style tech support, so I am uninstalling and re-installing Emby now in the hopes that will fix it. I will be back after that is done, but I really hope you guys have some help for me if this doesn't work, as I am lost otherwise.

Thank you

Edited May 21, 2021 by halo00

[Happy2Play 9780]

29 minutes ago, halo00 said:

My biggest problem is 1/3 of my library is gone, the files are (thankfully, given what I just read about the last library issue deleting actual files!) my files are all still there. However, despite repeated attempts to rescan all my libraries, and then use the Server Configuration Backup plugin to restore old backups, I cannot get the missing files to re-added to Emby's library.

As an example this show in Emby after repeated attempts to re scan the library and restore form backups.

The files on my hard drive.

Not sure why all library items are not appearing, but many need to see a server log.

26 minutes ago, halo00 said:

Additionally, Next Up was removed on all platforms! My web front for my server, all Android clients (AndroidTV, phone, tablets), and Windows 10. It is listed as "Next Up (Legacy)" and can be re-added (pretty annoying) but what the heck? If its "legacy" what did you replace it with? I can't stay on this platform if it doesn't have "Next Up".

Next Up (Legacy) wth?

Continue Watching and Next Up were combined.  That is why the update dropped the legacy option, but still gives users the choice to re-add it.

4.6.0.9 - Merging continue watching & next up

[Luke 42078]

Yes see my response here about continue watching:

 

Now regarding missing content, what exactly is missing?

[halo00 2]

2 hours ago, Happy2Play said:

Not sure why all library items are not appearing, but many need to see a server log.

Can I ask, what should I look for if there are no errors? I am still installing/reinstalling so I will pick this up when its done.

 

2 hours ago, Happy2Play said:

Continue Watching and Next Up were combined.  That is why the update dropped the legacy option, but still gives users the choice to re-add it.

4.6.0.9 - Merging continue watching & next up

Ah, ok. I haven't used it yet, the install/reinstall process is still ongoing, so I will play with it. Just in case, is there a way to go back to the old behavior of "Continue watching" as well as re-adding "Next Up (Legacy)"?

 

2 hours ago, Luke said:

Now regarding missing content, what exactly is missing?

 

For example this show, Emby only has 3 episodes of Season 1

 

 But see the actual files on disk:

I noticed this trying to play an episode of Lucifer (Season 2) after rebooting my server, and the entire season was gone. I then did a quick check of episodes in my TV library and thousands of episodes are missing. Before posting here and the reinstall I am doing now, I spent the morning trying to rescan my libraries and then even used "Server Configuration Backup plugin" to restore 3 backups going backwards from yesterday.

None of these brought back the missing files. I haven't even checked my Movie libraries yet.

Can I also ask, will I lose all my watched flags for these missing episodes?

Edited May 21, 2021 by halo00
Typos

[Happy2Play 9780]

2 minutes ago, halo00 said:

None of these brought back the missing files. I haven't even checked my Movie libraries.

Can I also ask, will I lose all my watched flags for these missing episodes?

Can you check those three episodes and see if Emby is multi-versioning on any of them.  You will see a version drop down, or scroll to the bottom (Media Info) and see if multiple files are listed.

As for Watched/Played flag, Emby uses providerid to track this status so no you should not lose them.

[halo00 2]

Ok uninstall and reinstall did not fix it, sadly.

3 hours ago, Happy2Play said:

Can you check those three episodes and see if Emby is multi-versioning on any of them.  You will see a version drop down, or scroll to the bottom (Media Info) and see if multiple files are listed.

Sadly no multi-versioning on any of the shows with missing episodes I checked.

3 hours ago, Happy2Play said:

As for Watched/Played flag, Emby uses providerid to track this status so no you should not lose them.

Perfect thanks!

 

What is the process here for submitting logs? Any info I need to redact for webcrawler protection/privacy? So far I can't find any errors that would be related to this but my work day started so I only got a brief glance. I'll take a deeper look when I'm off.

Thank you!

[Happy2Play 9780]

9 minutes ago, halo00 said:

What is the process here for submitting logs? Any info I need to redact for webcrawler protection/privacy? So far I can't find any errors that would be related to this but my work day started so I only got a brief glance. I'll take a deeper look when I'm off.

You can post or pm them (additional staff will be added depending on who you pm).  If you post you will want to remove any public ips and or personal domain name.

[gberg 6]

For me all lirary items are gone after upgrading from my Ubuntu Emby installation from version 4.5.4.0 to 4.6.0.50, and then rebooted the server, no Movies, no TV Shows, and no Music.

But the libraries themselves are still there.

 

Any ideas what to do, other than roling back the Ubuntu VM, or maybe I should first try restore last Emby backub file?

[Happy2Play 9780]

1 minute ago, gberg said:

For me all lirary items are gone after upgrading from my Ubuntu Emby installation from version 4.5.4.0 to 4.6.0.50, and then rebooted the server, no Movies, no TV Shows, and no Music.

But the libraries themselves are still there.

 

Any ideas what to do, other than roling back the Ubuntu VM, or maybe I should first try restore last Emby backub file?

Staff will need to see the server log from the time of the upgrade when these went missing.

 

[halo00 2]

7 minutes ago, Happy2Play said:

You can post or pm them (additional staff will be added depending on who you pm).  If you post you will want to remove any public ips and or personal domain name.

Can I PM it to you?

[halo00 2]

8 minutes ago, gberg said:

For me all lirary items are gone after upgrading from my Ubuntu Emby installation from version 4.5.4.0 to 4.6.0.50, and then rebooted the server, no Movies, no TV Shows, and no Music.

But the libraries themselves are still there.

 

Any ideas what to do, other than roling back the Ubuntu VM, or maybe I should first try restore last Emby backub file?

Ouch, can I ask, when you re-scan no items are reloaded?

[Happy2Play 9780]

3 minutes ago, halo00 said:

Can I PM it to you?

Yes and I may add Luke if anything stands out.

[gberg 6]

5 minutes ago, Happy2Play said:

Staff will need to see the server log from the time of the upgrade when these went missing.

 

Ok, but since I rebooted the serve right after the upgrade I guess the logs won't be of much help?

[Happy2Play 9780]

1 minute ago, gberg said:

Ok, but since I rebooted the serve right after the upgrade I guess the logs won't be of much help?

You could provide both logs.

[gberg 6]

3 minutes ago, Happy2Play said:

You could provide both logs.

Ok, I'll have a look, but I'm not really sure what log-files to provide.

Do you think it would be a good idea to restore a prvevious version of a Server Configuration Backup?

[gberg 6]

14 minutes ago, halo00 said:

Ouch, can I ask, when you re-scan no items are reloaded?

I haven't yet done any library scans since the upgrade.

[Happy2Play 9780]

1 minute ago, gberg said:

Ok, I'll have a look, but I'm not really sure what log-files to provide.

Do you think it would be a good idea to restore a prvevious version of a Server Configuration Backup?

The embysever-xxxxxxxxxxxxxxx.txt and current embyserver.txt

Nothing in the update should have removed libraries, but with out logs it just a guess so doing a restore could be a waste of time.

Just now, gberg said:

I haven't yet done any library scans since the upgrade.

A scan couldn't hurt.

 

[gberg 6]

8 minutes ago, Happy2Play said:

The embysever-xxxxxxxxxxxxxxx.txt and current embyserver.txt

Nothing in the update should have removed libraries, but with out logs it just a guess so doing a restore could be a waste of time.

A scan couldn't hurt.

 

I think I got the two log files, one sterting at midnight right up to the upgrade, and then the first logfile after the upgrade, should I send it via PM or just attach them here?

 

I would like to not re-scan all the libraries, and then needing to edit the meta data language for all Swedish Movies and TV Shows.

[Happy2Play 9780]

2 minutes ago, gberg said:

I think I got the two log files, one sterting at midnight right up to the upgrade, and then the first logfile after the upgrade, should I send it via PM or just attach them here?

 

I would like to not re-scan all the libraries, and then needing to edit the meta data language for all Swedish Movies and TV Shows.

It is your choice to attach logs here or send them via pm.

[gberg 6]

3 minutes ago, Happy2Play said:

It is your choice to attach logs here or send them via pm.

Ok, I attach them here

embyserver-63757188556_after upgrade.txt embyserver-63757188391_before upgrad.txt

[Happy2Play 9780]

4 minutes ago, gberg said:

Ok, I attach them here

embyserver-63757188556_after upgrade.txt 26.68 kB · 0 downloads embyserver-63757188391_before upgrad.txt 87.47 MB · 0 downloads

Well your old 4.5.4 log shows you need the inotify patch.

The configured user limit (8192) on the number of inotify watches has been reached, or the operating system failed to allocate a required 

But your upgrade log shows your paths don't exist.

2021-05-21 10:08:47.512 Info LibraryMonitor: Skipping realtime monitor for /media/gr021nas/Filmer because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/gr021nas/Musik because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/gr021nas/TV because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/va041nas01/Movies because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/va041nas01/Music because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/va041nas01/TV because the path does not exist

But this is all related to Real Time Monitoring.

 

[gberg 6]

6 minutes ago, Happy2Play said:

Well your old 4.5.4 log shows you need the inotify patch.

The configured user limit (8192) on the number of inotify watches has been reached, or the operating system failed to allocate a required 

But your upgrade log shows your paths don't exist.

2021-05-21 10:08:47.512 Info LibraryMonitor: Skipping realtime monitor for /media/gr021nas/Filmer because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/gr021nas/Musik because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/gr021nas/TV because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/va041nas01/Movies because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/va041nas01/Music because the path does not exist
2021-05-21 10:08:47.513 Info LibraryMonitor: Skipping realtime monitor for /media/va041nas01/TV because the path does not exist

But this is all related to Real Time Monitoring.

 

What is " the inotify patch"?

 

I saw the messages about baths not existing, but i reallity I can reach them both directly from the server using midnight commander, and also when editig the library folders from the Emby web interface.

[Happy2Play 9780]

6 minutes ago, gberg said:

What is " the inotify patch"?

 

I saw the messages about baths not existing, but i reallity I can reach them both directly from the server using midnight commander, and also when editig the library folders from the Emby web interface.

I would do a search your platform forum section for inotify.  But Emby uses it to get updates from the filesystem.

I honestly don't know about why your getting "path does not exist".

[gberg 6]

Oh, WOW!

Now I restored the last copy of Server Configuration Backup, and now all library items seems to be back again, I wonder wat went broke during the upgrade?

[blade005 185]

7 hours ago, halo00 said:

For example this show, Emby only has 3 episodes of Season 1

I noticed this trying to play an episode of Lucifer (Season 2) after rebooting my server, and the entire season was gone. I then did a quick check of episodes in my TV library and thousands of episodes are missing. Before posting here and the reinstall I am doing now, I spent the morning trying to rescan my libraries and then even used "Server Configuration Backup plugin" to restore 3 backups going backwards from yesterday.

FYI. I have come across some TV Series that didn't seem to re-populate all episodes even after a full and completed library scan after the update to 4.6. I found a few while browsing and I'm sure I will find more as I stumble across them. For the ones that I did find, doing a REFRESH METADATA and selecting SEARCH FOR MISSING METADATA at either the Series Level or Season Level refreshed all episodes that previously were not displaying. Not sure why a full SCAN LIBRARY didn't pick these up, but as long as you can REFRESH at the Series or Season level it is manageable. You could also try doing the same REFRESH METADATA -- SEARCH FOR MISSING METADATA for the LIBRARY entry that points to all of your TV series. But, if thousands of episodes are missing that make take awhile to refresh and show up in the UI. I would first try at the series level, like for the LUCIFER series you mentioned in previous post.