Jump to content

Crawl through server.


Go to solution Solved by devansh9201,

Recommended Posts

devansh9201
Posted (edited)

I have setup my domain  configured with the server which helps me with caching images on it. I've noticed that for cloudflare to cache something , that item must first be requested by client. The number of files that I have is huge and it's difficult for me to then manually put requests for items. 

One way I've thought of for caching automatically is through web crawling . 

 just want a way to authorize my machine to authenticate and help it crawl (I'll take care of crawling part). I saw many forum prior to writing this. One I found was this 

https://someone.org/emby/Users/69xxxeff3f7c4axxxxx2a0df4fxxxx555/views.

PS:- I want to know in what way is the library urls configured , how can I get to them?

Edited by devansh9201
Found the way to authenticate.
devansh9201
Posted (edited)

Ok  i figured out the authentication part. But now I want my crawler to go through all libraries. How can I do that? I mean that I want url for libraries. How do you configure those?

Edited by devansh9201
  • Solution
devansh9201
Posted

Yeah found way for library too. 

Posted

Thanks for following up.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...