Jump to content


Photo

How to setup scraper for a lights out server?

library scan standby server

  • Please log in to reply
15 replies to this topic

#1 F1r3b4ll OFFLINE  

F1r3b4ll

    Member

  • Members
  • 18 posts
  • Local time: 11:10 PM

Posted 04 February 2019 - 04:12 PM

Hi,

I want to set up a more shiny UI and have been directed to emby. At the moment I'm browsing the smb share.

So I've been playing around yesterday, scanning my movie share on my unRAID server.

Looked nice as I left.

Now I came back and the library is wiped clean.

I imagine this is due to the fact that my media server is not running 24/7.

The scheduler is set to scan the media library after 12 hours by default.

The emby docker itself is running 24/7 on a bananaPi.

SharpCifs.Smb.SmbException: SharpCifs.Smb.SmbException: Failed to connect: 0.0.0.0<00>/media.server.ip

What is the right setting in my usecase.

I think some check for the presence (e.g. ping) of the media server is needed before a library update is performed.

Somebody with this usecase here?


Edited by F1r3b4ll, 04 February 2019 - 04:13 PM.


#2 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 124437 posts
  • Local time: 06:10 PM

Posted 04 February 2019 - 04:58 PM

Hi there, can you please attach the emby server log? Thanks.



#3 F1r3b4ll OFFLINE  

F1r3b4ll

    Member

  • Members
  • 18 posts
  • Local time: 11:10 PM

Posted 04 February 2019 - 06:48 PM

Here you go!

 

Additional issue:

As you can see in the log, I have also tried to add my shows to an own library but it is not showing any content.

And it takes much longer to scrape than the movies.

Attached Files

  • Attached File  Log.zip   1.34MB   5 downloads


#4 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 124437 posts
  • Local time: 06:10 PM

Posted 05 February 2019 - 01:29 AM

We don't support any SMB authentication at this time, so the path needs to be accessible anonymously. Is it? If any network credentials are required then it will not work.

 

I think you will have better luck if you instead mount the SMB path as a local share in your server machine, then add the local share path into Emby. Please let us know if that helps. Thanks.



#5 F1r3b4ll OFFLINE  

F1r3b4ll

    Member

  • Members
  • 18 posts
  • Local time: 11:10 PM

Posted 05 February 2019 - 04:58 AM

Yes, the share is accessible, but the server was down as the rescan happened!

The server is running on demand, so a scheduled rescan is not an option. :huh:



#6 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 124437 posts
  • Local time: 06:10 PM

Posted 05 February 2019 - 02:42 PM

Does that mean you're all set now?



#7 F1r3b4ll OFFLINE  

F1r3b4ll

    Member

  • Members
  • 18 posts
  • Local time: 11:10 PM

Posted 05 February 2019 - 03:16 PM

I'm not sure.

I removed the 12 hours task:

Scan media library
Scans your media library and refreshes metatata based on configuration.

The library has not been deleted today, but the refresh won't take place anymore.

Do I have to start the refresh manually now?



#8 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 124437 posts
  • Local time: 06:10 PM

Posted 05 February 2019 - 06:41 PM

Yes, if deleted all the triggers.



#9 F1r3b4ll OFFLINE  

F1r3b4ll

    Member

  • Members
  • 18 posts
  • Local time: 11:10 PM

Posted 05 February 2019 - 07:23 PM

Is there a way to trigger the refresh via command line?

I consider writing a shell script to check if the server is up and running before running a refresh.



#10 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 13845 posts
  • Local time: 03:10 PM
  • LocationWashington State

Posted 05 February 2019 - 07:46 PM

Is there a way to trigger the refresh via command line?

I consider writing a shell script to check if the server is up and running before running a refresh.

 

You can look at the API (link at bottom of the Dashboard).

 

example for scheduled scan (noticed you need to add -d "" to the end when running the command manually in command line)

curl -X POST "http://localhost:8096/emby/ScheduledTasks/Running/6330ee8fb4a957f33981f89aa78b030f?api_key=API KEY HERE" -H  "accept: */*" -d ""

You can generate a api key in Dashboard-Advanced-Security.

 

Note you can see the taskID in the url when you click on the scheduled task to see the triggers.


Edited by Happy2Play, 05 February 2019 - 07:49 PM.


#11 F1r3b4ll OFFLINE  

F1r3b4ll

    Member

  • Members
  • 18 posts
  • Local time: 11:10 PM

Posted 06 February 2019 - 03:37 AM

This is nice!

Thank you!

 

Just food for thought for the devs:

Do you consider it is a good solution to dump the library if emby can't connect to the source?

I didn't edit library entries by hand yet, but if people do and they get their database dumped due to connection issues it's very annoying.



#12 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 124437 posts
  • Local time: 06:10 PM

Posted 06 February 2019 - 02:10 PM

Dump the library?



#13 F1r3b4ll OFFLINE  

F1r3b4ll

    Member

  • Members
  • 18 posts
  • Local time: 11:10 PM

Posted 06 February 2019 - 04:46 PM

Dump the library?

Yes, basically what happened to me in the OP.

The library (or database on the emby server) was deleted because the media server was not available to update the library.

Or do you think that was not the reason?



#14 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 13845 posts
  • Local time: 03:10 PM
  • LocationWashington State

Posted 06 February 2019 - 04:49 PM

I don't do offline as my system is on 24/7, but offline media should not be removed during library scan unless something has changed.



#15 F1r3b4ll OFFLINE  

F1r3b4ll

    Member

  • Members
  • 18 posts
  • Local time: 11:10 PM

Posted 06 February 2019 - 05:09 PM

I'm not sure, but if you check my attached log...see timestamp

2019-02-04 08:50:44.609 Info TaskManager: IntervalTrigger fired for task: Scan media library

then lots of smb error stuff and finally it starts with

2019-02-04 08:58:07.125 Info App: Deleting dead Genre 3310 Action.


#16 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 124437 posts
  • Local time: 06:10 PM

Posted 18 February 2019 - 06:14 PM

@F1r3b4ll

 

This might be specific to using libraries with SMB.

 

Can you instead try this - mount the SMB path as a local share in your OS, then add that local share to Emby instead of the smb path. Please let us know if this helps. Thanks !







Also tagged with one or more of these keywords: library, scan, standby server

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users