Jump to content

How to setup scraper for a lights out server?


F1r3b4ll

Recommended Posts

F1r3b4ll

Hi,

I want to set up a more shiny UI and have been directed to emby. At the moment I'm browsing the smb share.

So I've been playing around yesterday, scanning my movie share on my unRAID server.

Looked nice as I left.

Now I came back and the library is wiped clean.

I imagine this is due to the fact that my media server is not running 24/7.

The scheduler is set to scan the media library after 12 hours by default.

The emby docker itself is running 24/7 on a bananaPi.

SharpCifs.Smb.SmbException: SharpCifs.Smb.SmbException: Failed to connect: 0.0.0.0<00>/media.server.ip

What is the right setting in my usecase.

I think some check for the presence (e.g. ping) of the media server is needed before a library update is performed.

Somebody with this usecase here?

Edited by F1r3b4ll
Link to comment
Share on other sites

F1r3b4ll

Here you go!

 

Additional issue:

As you can see in the log, I have also tried to add my shows to an own library but it is not showing any content.

And it takes much longer to scrape than the movies.

Log.zip

Link to comment
Share on other sites

We don't support any SMB authentication at this time, so the path needs to be accessible anonymously. Is it? If any network credentials are required then it will not work.

 

I think you will have better luck if you instead mount the SMB path as a local share in your server machine, then add the local share path into Emby. Please let us know if that helps. Thanks.

Link to comment
Share on other sites

F1r3b4ll

Yes, the share is accessible, but the server was down as the rescan happened!

The server is running on demand, so a scheduled rescan is not an option. :huh:

Link to comment
Share on other sites

F1r3b4ll

I'm not sure.

I removed the 12 hours task:

Scan media library
Scans your media library and refreshes metatata based on configuration.

The library has not been deleted today, but the refresh won't take place anymore.

Do I have to start the refresh manually now?

Link to comment
Share on other sites

F1r3b4ll

Is there a way to trigger the refresh via command line?

I consider writing a shell script to check if the server is up and running before running a refresh.

Link to comment
Share on other sites

Happy2Play

Is there a way to trigger the refresh via command line?

I consider writing a shell script to check if the server is up and running before running a refresh.

 

You can look at the API (link at bottom of the Dashboard).

 

example for scheduled scan (noticed you need to add -d "" to the end when running the command manually in command line)

curl -X POST "http://localhost:8096/emby/ScheduledTasks/Running/6330ee8fb4a957f33981f89aa78b030f?api_key=API KEY HERE" -H  "accept: */*" -d ""

You can generate a api key in Dashboard-Advanced-Security.

 

Note you can see the taskID in the url when you click on the scheduled task to see the triggers.

Edited by Happy2Play
Link to comment
Share on other sites

F1r3b4ll

This is nice!

Thank you!

 

Just food for thought for the devs:

Do you consider it is a good solution to dump the library if emby can't connect to the source?

I didn't edit library entries by hand yet, but if people do and they get their database dumped due to connection issues it's very annoying.

Link to comment
Share on other sites

F1r3b4ll

Dump the library?

Yes, basically what happened to me in the OP.

The library (or database on the emby server) was deleted because the media server was not available to update the library.

Or do you think that was not the reason?

Link to comment
Share on other sites

Happy2Play

I don't do offline as my system is on 24/7, but offline media should not be removed during library scan unless something has changed.

Link to comment
Share on other sites

F1r3b4ll

I'm not sure, but if you check my attached log...see timestamp

2019-02-04 08:50:44.609 Info TaskManager: IntervalTrigger fired for task: Scan media library

then lots of smb error stuff and finally it starts with

2019-02-04 08:58:07.125 Info App: Deleting dead Genre 3310 Action.
Link to comment
Share on other sites

  • 2 weeks later...

@@F1r3b4ll

 

This might be specific to using libraries with SMB.

 

Can you instead try this - mount the SMB path as a local share in your OS, then add that local share to Emby instead of the smb path. Please let us know if this helps. Thanks !

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...