Backup / Restore Actors - Beta with local or web based restore.

[Qowy 0]

Yes exactly the same File.

The path exists up until

D:\Emby\metadata\library\9e\

The Folder

9e158806cb4d4935b5a930482cb20107

is missing.

 

As I said without knowing your code are you possibly only catching FileNotFoundExceptions? Instead of DirectoryNotFound?

 

I am C# developer myself albeit not for emby and have access to Visual Studio. So if this issue continues to behave strangely I could have a look at it and test myself, in case you are comfortable sharing your VS Project with me.

 

Edited February 26, 2022 by Qowy

[mickle026 401]

9 hours ago, Qowy said:

As I said without knowing your code are you possibly only catching FileNotFoundExceptions? Instead of DirectoryNotFound?

 

The joys of being am amateur, not really a c# dev, still learning c# on the fly

Try this, added directory check and put it all in a try catch block to log the error and continue instead of stopping.

 

Edited February 26, 2022 by mickle026
Remove download

[Qowy 0]

ok this time It ran to completion, however it says:

Finished, Removed/Repaired (0) Person(s) - You might need to restart Emby Server.

And nothing changed.

 

Let's take a concrete example:

Sonequa Martin-Green

 

Your tool logs: 26.Feb.2022  -  13.45.44 Person (22760) Sonequa Martin-Green,D:\Emby\metadata\library\0d\0d8f330efca145eaa5f93033fd7070d4\folder.jpg

But that file does not exist.

What would I run to fix this?

 

[mickle026 401]

Ok, so this is fixed now in my testing.  Please be sure to confirm it it is now working for you or not

It is now detecting empty folders/invalid folder paths/missing files/bad urls/bad files .

Earlier build missed something crucial as I was in a hurry, sorry.  Removed the restart server message as you dont need to do that.

Now logging detected image link before attempt to fix, and after fix applied as a visual validation.

I would like to thank you for the feedback, it has helped me understand the issue your were having and allowed me to incorporate extra measures to allow for this, which in turn will help others, and it has made me take another look and address issues that crash the function.  So thank you @Qowy.

The top log is all the actors with their associated file paths or urls
 

The bottom log is a report of actions taken by the plugin

 

 

I deleted the folder.jpg but left the path in this example which was the last error you had thrown.

 

 

Edited March 28, 2022 by mickle026

[Qowy 0]

Looks good now "Finished, Removed/Repaired (4724) Person(s)."

 

Thank you very much

[mickle026 401]

So the actor cards are back to normal?

And metadata refresh will replace the missing that it can find.

 

[Qowy 0]

They are back to the white "missing" icon. I am running a refresh now. So far they only show up after clicking on the actor and then going back again. Will see if this will fix itself after some time,.

[mickle026 401]

25 minutes ago, Qowy said:

They are back to the white "missing" icon. I am running a refresh now. So far they only show up after clicking on the actor and then going back again. Will see if this will fix itself after some time,.

Mine replaced after running refresh metadata.  Until I did that it was the same as yours, only clicking them replaced them.

 

Glad they are back to normal though as that will allow them to work again instead of being "stuck" not working

Edited February 27, 2022 by mickle026

[mickle026 401]

Todays update to simply adds Purging (Deleting) Log files

Now you can delete all logs, or just CustomProvider made logs.

*Note if you choose to delete them all the embyserver.txt & any files in use will not be deleted, however the if they are not in use like the hardware log they will be deleted.

 

CustomProvider.zip

Edited February 27, 2022 by mickle026

[mickle026 401]

Added export to media folders ".actors" folder. (Backup Tab)

Currently export is only MOVIE types and not for Series or Episodes, this will come later.

So now you have import people to Actor Cards for (Movie and Series/TV Shows) and export People from (Movies) to the \media folders\.actors\ folder on this function

Un Checking the Overwrite backed up images will stop files existing being overwritten.  Example shown has missing images hence only 13 of 18 written.

NOTE: I have not removed images from the temporary file cache either yet.

 

The export (Backup Tab)

 

Internet urls are downloaded and written there too.

 

The import (Repair Tab)

 

 

Edited March 28, 2022 by mickle026

[mickle026 401]

Todays update, brings backing up Series and Episode actors to the \.actors folders inside your media directories.

I have done a backup ALL , or your can backup individually.

 

 

The ALL will do all Movies, Series and Episodes

Whats the difference between Series and Episodes?

Well the difference is that some people (cast members) in Episodes are not main cast members so do not appear in the series entry!  The Episode backup allows you to capture more people for this series than series alone.

Why seperate?

That is because you may only wnat to do certain libraries or even certain people - user has the choice...

 

 

CustomProvider.zip

[GrimReaper 3308]

Does exporting overwrite present images in .actors subfolder? 

Disregard, you already explained it in helper text. Great stuff.  

Edited February 28, 2022 by GrimReaper
Fineprint really should be read

[mickle026 401]

31 minutes ago, GrimReaper said:

Does exporting overwrite present images in .actors subfolder? 

 

I use where the Overwrite = true, Overwrite = false set by the checkbox at the top of the backup page.  ( I need to fix the typo I just spotted!)

File.Copy(CastImage, CopyTo, Overwrite);

Overwrite keyword is true or false, set by the checkbox
  ie File.Copy(EmbyImage, BackupPath, True or False);

So it shouldn't, but as this is an Alpha release, it will need testing on a test server first.  Don't do this yet on your main library if you are worried. (Im not responsible if you do!)
It should only overwrite is set to do so, and should still overwrite if set to and even if destination file exists and is read only.

 

This isn't fully tested yet for that, only tested for actually exporting properly.

 

 

Edited March 1, 2022 by mickle026

[GrimReaper 3308]

That's great, as I would actually like it to overwrite, keeping the images updated over years once replaced within Emby. 

[mickle026 401]

12 minutes ago, GrimReaper said:

That's great, as I would actually like it to overwrite, keeping the images updated over years once replaced within Emby. 

I think the only reason that they might not overwrite if set to do so in some circumstances might be down to "ownership" on linux based or btrfs sytsems such as a NAS, but that will log as a failure so you could investigate that.   Thanks to feedback from @Qowy I have now learned how to continue from these types of errors.

Edited March 1, 2022 by mickle026

[mickle026 401]

I guess that I have now inadvertantly (by accident) created a full backup and restore function!  That wasn't the intention of this plugin but it seems that it has happened.

The intention of this plugin is to create a backup and retrieval from a http server via Custom Provider fetcher in library settings incase of server reinstall!

1.  Backup to .actors, from Emby and Web links.
2.  Repair People to Emby from .actors folders.

This should therefore localise all links and remove weblinks from Emby for people, something else to test by doing this and then running a Get Actor Links and Urls report!

 

[mickle026 401]

I have found an error that I made in the backup to .actors, where some images didnt backup under certain conditions.

I have fixed that so will be in the next release

[GrimReaper 3308]

Shouldn't the red line of text be placed below Section header?

 

And what does the text in green mean in this context, Series Actors Backup?

[GrimReaper 3308]

Following same analogy, shouldn't there be a section Movies Actors Backup below Movie Backup?

 

[mickle026 401]

I do see what you mean, thanks

As this plugin is being developed, and to be fair it wasnt even meant to be released yet (and its not even the same one as this thread started, I abandoned that one).  Things are getting moved about and redesigned.  The plugin you have has 12 or 13 tabs.  I have already condesed that down to 10, and still working to improve stuff. 

The current version doesnt support the scrapers yet as even that area is being redesigned/coded.

It is essentially a prototype, rough and ready, being moulded into something useful.

I'll update as soon as I can.

Edited March 7, 2022 by mickle026

[mickle026 401]

Just an update of where I am with this.  It is still very much in progress.

I have done quite a lot, although it probably doesn't look like much at first.
 

Since 28th feb post

11.03.2022
*More GUI layout redesign (still work in progress)
*Added Discogs scraper for Artist Images

10.03.2022
*Fixed multiple errors
*More GUI layout redesign (still work in progress)
*Added Discogs scraper for Single/Track Cover Images
*Added 'ScraperCache' option to download search images to metadata (more info on this later)
*Added Global Settings to Scrapers with Log http response errors.

04.03.2022
*Fixed an Error in Backup Albums
--Backup Folders 'MusicBrainzAlbum' and 'AudioDbAlbum' require manual deletion and Backup>Albums re-running.
*Rewrite Fetcher for Albums
*Moved Album fetcher Logging to own Log
*Dissabled all web scrapers (for now)
*Dissabled contact other Emby web servers (for now)
*More re-organisation of Web gui (still in progress)
*Added Album/Primary Path report
*Added Enable/Dissable servers checkboxes in global config

03.03.2022
*Rewrite Fetchers (Artist/Person/Series/Episode)
*Start of Web Page Gui Redesign.
*Start of Implimenting Metadata Interfacing.
*More logging taken away from embyserver.txt (Still in progress)

I haven't re-enabled all the scrapers yet.  But I have implimented a new one for MusicArtists and MusicTracks(Songs)

 

And for tracks (Adele - Hello)

 

I have also enabled an image cache

If this is not set but enabled it will write the Cache folder to your metadata path and store them there.  These images are not currently used, but might be in the future.  This is a function that might be handy to some people

And On the Disk Drive

There still lots and lots of work to be done.  But here is where I am at so far.

If your config doesnt load check the spelling (case) of the dll againt the config xml file.  I had to rebuild the build file, not sure if its exactly the same.

 

 

I also update a lot to media-and-meta.com (for custom provider server)

Music Track Database contains
11311  Track Cover(s)
29  Backdrop Image(s)
3  Logo Image(s)

Person Database contains
53289 Person Portrait Images(s)

TV Show / Series Database contains
471  Cover(s)
85  Artwork Image(s)
828  Backdrop Image(s)
433  Banner Image(s)
342  Logo Image(s)
258  Thumb Image(s)

 

Direct search on the website doesn't really work.  It works best by adding it as a Custom Provider server

 

You can now turn servers on and off without having to delete them

TV Show Library

Music Library

 

 

 

Edited March 12, 2022 by mickle026

[mickle026 401]

Added Backup & Restore LiveTV Timers as this is simple and seems to be something that might come in handy to some users.

The locations are the same backup location used in the Global Config.

 

 

 

 

Edited March 28, 2022 by mickle026

[TallBoiDez 8]

On 3/11/2022 at 10:14 PM, mickle026 said:

Added Backup & Restore LiveTV Timers as this is simple and seems to be something that might come in handy to some users.

The locations are the same backup location used in the Global Config.

 

 

 

CustomProvider.zip 3.26 MB · 3 downloads

this version of the plugin Didn't appear in my plugin list on emby, I reverted back to the last version and it is showing up just fine.

[mickle026 401]

7 hours ago, TallBoiDez said:

this version of the plugin Didn't appear in my plugin list on emby, I reverted back to the last version and it is showing up just fine.

CustomProvider.zip

Sorry my fault.  Wrong nuget on build (add-in for the build).  I used the first stable release for the stable, but it was an older one that i needed.

[Spegeli 18]

I have the problem that some actor images only appear after you click on them thats why i tried your plugin because of the actor functions:

I had "Total: 100461 Missing Image(s)" and then i did a Force Actor Images, after that it was "Total: 99685 Missing Image(s)".
So some images found but a lot still missing and that although there are pictures on IMDB or TMDB:
 

When i click manuell on it, your Plugin still stay its no image available but the internal emby functions seems to found one: 
 

19.Mar.2022  -  12.32.42 PersonName: Guo Jingfei
19.Mar.2022  -  12.32.42 TVDB:  IMDB: nm3530937 TMDB: 1353688
19.Mar.2022  -  12.32.43 CustomProvider Server (IMDB) Primary Doesn't Exist for Guo Jingfei
19.Mar.2022  -  12.32.43 CustomProvider Server (TMDB) Primary Doesn't Exist for Guo Jingfei
19.Mar.2022  -  12.32.44 CustomProvider Server (PersonByName) Primary Doesn't Exist for Guo Jingfei
19.Mar.2022  -  12.32.44 Search Completed.

https://www.imdb.com/name/nm3530937/

https://www.themoviedb.org/person/1353688-guo-jingfei

2022-03-19 12:32:41.980 Info HttpClient: GET https://api.themoviedb.org/3/person/1353688?api_key=x_secret1_x&append_to_response=credits,images,external_ids&language=de
2022-03-19 12:32:42.145 Info App: MovieDbPersonProvider metadata is incomplete for language de. Trying English...
2022-03-19 12:32:42.279 Info HttpClient: GET https://api.themoviedb.org/3/person/1353688?api_key=x_secret1_x&append_to_response=credits,images,external_ids&language=en
2022-03-19 12:32:44.233 Info HttpClient: GET https://image.tmdb.org/t/p/original/xNyi4uOHKAqCgW7JhV5MPn5BG88.jpg

 

 

 

19.Mar.2022  -  12.35.30 PersonName: Liu Tianzuo
19.Mar.2022  -  12.35.30 TVDB:  IMDB: nm3602259 TMDB: 589906
19.Mar.2022  -  12.35.31 CustomProvider Server (IMDB) Primary Doesn't Exist for Liu Tianzuo
19.Mar.2022  -  12.35.31 CustomProvider Server (TMDB) Primary Doesn't Exist for Liu Tianzuo
19.Mar.2022  -  12.35.32 CustomProvider Server (PersonByName) Primary Doesn't Exist for Liu Tianzuo
19.Mar.2022  -  12.35.32 Search Completed.

https://www.themoviedb.org/person/589906-tianzuo-liu

https://www.imdb.com/name/nm3602259/

2022-03-19 12:35:29.911 Info HttpClient: GET https://api.themoviedb.org/3/person/589906?api_key=x_secret1_x&append_to_response=credits,images,external_ids&language=de
2022-03-19 12:35:30.161 Info App: MovieDbPersonProvider metadata is incomplete for language de. Trying English...
2022-03-19 12:35:30.211 Info HttpClient: GET https://api.themoviedb.org/3/person/589906?api_key=x_secret1_x&append_to_response=credits,images,external_ids&language=en
2022-03-19 12:35:32.183 Info HttpClient: GET https://image.tmdb.org/t/p/original/kszgzqaXsb2msNQR5zQLFZqABV0.jpg

 

 

Is it maybe because of 

MovieDbPersonProvider metadata is incomplete for language de. Trying English...

The Internal TMDB Function seems to use other languages if the Standard Library Language not found. In my Case the default Language is German.

 

So maybe your Plugin only Checks for German, if German not Found its not check for alternativ language English? And thats why in my Case so many Images are missing.

If yes there are 2 Solutions:

1) Do it like the Internal Emby Function and if in the Libary Language no image Found, use English as alternative

or

2) Ignore the Libary Language and use Englisch all the Time for Actor Images. Because on Actor Images i think it makes no different which language is set because there is no text etc. on the images. but the Englisch Database is the biggest one. So ignore the Libary Language and use Englisch all the time.

Edited March 19, 2022 by Spegeli