[bug?]

[Cthalpa 10]

Hi guys.

 

After adding an EPG source to my LiveTV, my cache and metadata folders has grown steadily since around feb. 20th.

(I have not added more than a dusin other movie titles since I added the LiveTV source.)

 

My cache has now reached almost 20GB, whereas it has "always" been steady around 14-15GB.

 

The source is a regional (danish) XML (in gz format).

I dont know if this could be a bug, but I am pretty sure, that the cache should'nt grow 5GB just because of adding an EPG source?

 

Deleting the EPG source does nothing to reduce metadata and/or cache.

Also, is it safe to purge the log directory on a daily basis? It's also between 3-4GB in size.

 

/BR

Edited February 27, 2020 by Cthalpa

[Cthalpa 10]

Hold on this.

After purging the log directory AND deleting the EPG source, I am down to normal data sizes.

 

I will investigate some more.

It could be a case of log directory expanding rapidly when adding EPG source.

[Cthalpa 10]

Update.

 

This is a case of logfiles not being rotated/purged.
Logfiles 3-4GB makes no sense, so I will just create a logrotate script, so I can keep the directory neat and clean.

 

/BR

[Cthalpa 10]

In case you want to know, what's filling up the log files rapidly, making them grow 3-4GB pr day (in my case) is that it's being filled with log lines full of stuff with this:

2020-02-27 11:27:53.803 Info HttpServer: HTTP GET https://HIDDEN:8920/videos/213942/hls/1ac1e25c00750941aa9e683f480a9964/1ac1e25c00750941aa9e683f480a996452.ts. Host=HIDDEN:8920, Connection=keep-alive, User-Agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.122 Safari/537.36, Sec-Fetch-Dest=empty, Accept=*/*, Sec-Fetch-Site=same-origin, Sec-Fetch-Mode=cors, Referer=https://HIDDEN:8920/web/index.html, Accept-Encoding=gzip, deflate, br, Accept-Language=da,en-US;q=0.9,en;q=0.8,da-DK;q=0.7,fr;q=0.6, Cookie=ys-torrentGrid=o%3Acolumns%3Da%253Ao%25253Aid%25253Ds%2525253Aqueue%25255Ewidth%25253Dn%2525253A30%255Eo%25253Aid%25253Ds%2525253Aname%25255Ewidth%25253Dn%2525253A525%255Eo%25253Aid%25253Dn%2525253A2%25255Ewidth%25253Dn%2525253A75%255Eo%25253Aid%25253Dn%2525253A3%25255Ewidth%25253Dn%2525253A150%255Eo%25253Aid%25253Dn%2525253A4%25255Ewidth%25253Dn%2525253A60%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A5%25255Ewidth%25253Dn%2525253A60%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A6%25255Ewidth%25253Dn%2525253A80%255Eo%25253Aid%25253Dn%2525253A7%25255Ewidth%25253Dn%2525253A80%255Eo%25253Aid%25253Dn%2525253A8%25255Ewidth%25253Dn%2525253A60%255Eo%25253Aid%25253Dn%2525253A9%25255Ewidth%25253Dn%2525253A60%255Eo%25253Aid%25253Dn%2525253A10%25255Ewidth%25253Dn%2525253A60%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A11%25255Ewidth%25253Dn%2525253A80%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A12%25255Ewidth%25253Dn%2525253A80%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A13%25255Ewidth%25253Dn%2525253A80%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A14%25255Ewidth%25253Dn%2525253A120%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A15%25255Ewidth%25253Dn%2525253A120%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A16%25255Ewidth%25253Dn%2525253A80%255Eo%25253Aid%25253Dn%2525253A17%25255Ewidth%25253Dn%2525253A80%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A18%25255Ewidth%25253Dn%2525253A80%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A19%25255Ewidth%25253Dn%2525253A75%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A20%25255Ewidth%25253Dn%2525253A75%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A21%25255Ewidth%25253Dn%2525253A75%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A22%25255Ewidth%25253Dn%2525253A75%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A23%25255Ewidth%25253Dn%2525253A75%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A24%25255Ewidth%25253Dn%2525253A75%25255Ehidden%25253Db%2525253A1%255Eo%25253Aid%25253Dn%2525253A25%25255Ewidth%25253Dn%2525253A75%25255Ehidden%25253Db%2525253A1%5Esort%3Do%253Afield%253Ds%25253Aname%255Edirection%253Ds%25253AASC

[Luke 36999]

https://dev.deluge-torrent.org/ticket/2894

[Cthalpa 10]

@@Luke

1) Will it fix this issue if I set a custom agent/referrer header?
2) Is this happening because my TV Stream is sent over some deluge/torrent "sh*t" ?

 

/BR

[Luke 36999]

I'm afraid this is specific to your tv stream so I don't know the answer, but yes you can try that.

 

What I can do though is stop writing that cookie value to the log to help get that size down.

[Cthalpa 10]

@@Luke

 

Perhaps it would be smart to do something about that cookie in your sourcecode, so that users would be able to upload logs (thats not 100M+).
Thanks for the reply though. I tried with a custom string, but it has not resolved it.

[Luke 36999]

Yes that's exactly what I just said. We won't write it to the log anymore.

[Cthalpa 10]

@@Luke

 

In the coming release?

[Luke 36999]

Yes.