talentless 2 Posted August 24, 2017 Share Posted August 24, 2017 (edited) Hello I am running emby server bare metal on an debian based arm64 platform with 2GB of memory. Yesterday I got an out of memory error: Aug 23 22:42:58 osmc kernel: [0]Bit depth luma = 10 Aug 23 22:42:58 osmc kernel: [0]Bit depth chroma = 10 Aug 23 22:42:58 osmc kernel: [0]set pic_list_init_flag 1 Aug 23 22:42:58 osmc kernel: [0]allocate begin Aug 23 22:42:58 osmc kernel: [0]allocate end Aug 23 22:42:58 osmc kernel: same as disp 3: 1684733952 Aug 23 22:42:58 osmc kernel: [0]init_decode_head_hw: (1920, 960) body_size 0x384000 header_size 0x1c20 Aug 23 22:42:58 osmc kernel: [0]init_buf_spec2 1920 960 Aug 23 22:42:58 osmc kernel: [0]set pic_list_init_flag to 2 Aug 23 22:42:58 osmc kernel: [0]set pic_list_init_flag to 3 Aug 23 22:43:42 osmc kernel: Threadpool work invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0 Aug 23 22:43:42 osmc kernel: Threadpool work cpuset=/ mems_allowed=0 Aug 23 22:43:42 osmc kernel: CPU: 1 PID: 13638 Comm: Threadpool work Tainted: G W O 3.14.29-28-osmc #1 Aug 23 22:43:42 osmc kernel: Call trace: Aug 23 22:43:42 osmc kernel: [<ffffffc001087cf4>] dump_backtrace+0x0/0x144 Aug 23 22:43:42 osmc kernel: [<ffffffc001087e54>] show_stack+0x1c/0x28 Aug 23 22:43:42 osmc kernel: [<ffffffc00186dd68>] dump_stack+0x74/0x94 Aug 23 22:43:42 osmc kernel: [<ffffffc001143ebc>] dump_header.isra.9+0x8c/0x1d8 Aug 23 22:43:42 osmc kernel: [<ffffffc001144598>] oom_kill_process+0x2dc/0x418 Aug 23 22:43:42 osmc kernel: [<ffffffc001144bc4>] out_of_memory+0x2e0/0x310 Aug 23 22:43:42 osmc kernel: [<ffffffc00114ac88>] __alloc_pages_nodemask+0x9f4/0xa08 Aug 23 22:43:42 osmc kernel: [<ffffffc001142620>] filemap_fault+0x278/0x4a8 Aug 23 22:43:42 osmc kernel: [<ffffffc001168de4>] __do_fault+0x7c/0x67c Aug 23 22:43:42 osmc kernel: [<ffffffc00116d1ec>] handle_mm_fault+0x15c/0xcec Aug 23 22:43:42 osmc kernel: [<ffffffc0010910e0>] do_page_fault+0x178/0x260 Aug 23 22:43:42 osmc kernel: [<ffffffc001081250>] do_mem_abort+0x50/0xb4 Aug 23 22:43:42 osmc kernel: Exception stack(0xffffffc00b11fe30 to 0xffffffc00b11ff50) Aug 23 22:43:42 osmc kernel: fe20: 00000000 00000000 00000000 00000000 Aug 23 22:43:42 osmc kernel: fe40: ffffffff ffffffff f5890b20 00000000 00000000 00000000 0108422c ffffffc0 Aug 23 22:43:42 osmc kernel: fe60: 00000000 00000000 00000000 00000000 ffffffff ffffffff f73c68e6 00000000 Aug 23 22:43:42 osmc kernel: fe80: 200f0030 00000000 00000011 00000000 0b11feb0 ffffffc0 01087808 ffffffc0 Aug 23 22:43:42 osmc kernel: fea0: 00400008 00000000 0b11fed0 ffffffc0 00000000 00000000 010842d4 ffffffc0 Aug 23 22:43:42 osmc kernel: fec0: 00000000 00000000 00000000 00000000 f23e3e78 00000000 00000001 00000000 Aug 23 22:43:42 osmc kernel: fee0: 00000076 00000000 00000001 00000000 0000001e 00000000 f23e3dd0 00000000 Aug 23 22:43:42 osmc kernel: ff00: f23e3de8 00000000 f55da298 00000000 edec8a40 00000000 00000000 00000000 Aug 23 22:43:42 osmc kernel: ff20: 00000002 00000000 d67fe330 00000000 0017dff0 00000000 d67fe330 00000000 Aug 23 22:43:42 osmc kernel: ff40: f58a6f8c 00000000 00000000 00000000 Aug 23 22:43:42 osmc kernel: Mem-Info: Aug 23 22:43:42 osmc kernel: Normal per-cpu: Aug 23 22:43:42 osmc kernel: CPU 0: hi: 186, btch: 31 usd: 0 Aug 23 22:43:42 osmc kernel: CPU 1: hi: 186, btch: 31 usd: 0 Aug 23 22:43:42 osmc kernel: CPU 2: hi: 186, btch: 31 usd: 0 Aug 23 22:43:42 osmc kernel: CPU 3: hi: 186, btch: 31 usd: 0 Aug 23 22:43:42 osmc kernel: active_anon:354055 inactive_anon:20481 isolated_anon:0 active_file:960 inactive_file:2390 isolated_file:105 unevictable:0 dirty:0 writeback:0 unstable:0 free:3047 slab_reclaimable:3690 slab_unreclaimable:5812 mapped:3506 shmem:24343 pagetables:1579 bounce:0 used_cma:19324 cma:0 anon_cma:35658 file_cma:172 isolate_cma:0 isolate:0 unmovable:2182 reclaimable:910 movable:33 reserve:0 Aug 23 22:43:42 osmc kernel: Normal free:12188kB min:12288kB low:15360kB high:18432kB active_anon:1416220kB inactive_anon:81924kB active_file:3840kB inactive_file:9436kB unevictable:0kB isolated(anon):0kB isolated(file):548kB present:2044928kB managed:1832716kB mlocked:0kB dirty:0kB writeback:0kB mapped:140 Aug 23 22:43:42 osmc kernel: lowmem_reserve[]: 0 0 Aug 23 22:43:42 osmc kernel: Normal: 3093*4kB (UEM) 0*8kB 0*16kB 4*32kB (M) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 12500kB Aug 23 22:43:42 osmc kernel: 27825 total pagecache pages Aug 23 22:43:42 osmc kernel: 0 pages in swap cache Aug 23 22:43:42 osmc kernel: Swap cache stats: add 0, delete 0, find 0/0 Aug 23 22:43:42 osmc kernel: Free swap = 0kB Aug 23 22:43:42 osmc kernel: Total swap = 0kB Aug 23 22:43:42 osmc kernel: 511232 pages RAM Aug 23 22:43:42 osmc kernel: 0 pages HighMem/MovableOnly Aug 23 22:43:42 osmc kernel: 53053 pages reserved Aug 23 22:43:42 osmc kernel: [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name Aug 23 22:43:42 osmc kernel: [ 172] 0 172 2955 1255 10 0 0 systemd-journal Aug 23 22:43:42 osmc kernel: [ 192] 0 192 2548 132 6 0 -1000 systemd-udevd Aug 23 22:43:42 osmc kernel: [ 288] 105 288 823 113 6 0 0 avahi-daemon Aug 23 22:43:42 osmc kernel: [ 293] 0 293 806 125 5 0 0 systemd-logind Aug 23 22:43:42 osmc kernel: [ 294] 104 294 1233 206 7 0 -900 dbus-daemon Aug 23 22:43:42 osmc kernel: [ 296] 0 296 441 69 5 0 0 lircd Aug 23 22:43:42 osmc kernel: [ 298] 105 298 790 55 6 0 0 avahi-daemon Aug 23 22:43:42 osmc kernel: [ 315] 0 315 1603 115 7 0 0 connmand Aug 23 22:43:42 osmc kernel: [ 319] 0 319 452 58 5 0 0 eventlircd Aug 23 22:43:42 osmc kernel: [ 337] 0 337 1650 114 8 0 -1000 sshd Aug 23 22:43:42 osmc kernel: [ 357] 0 357 1357 76 7 0 0 wpa_supplicant Aug 23 22:43:42 osmc kernel: [ 400] 0 400 450 31 5 0 0 agetty Aug 23 22:43:42 osmc kernel: [ 430] 0 430 919 75 6 0 0 rpcbind Aug 23 22:43:42 osmc kernel: [ 468] 1000 468 1357 112 7 0 0 udisks-glue Aug 23 22:43:42 osmc kernel: [ 485] 0 485 6412 176 10 0 0 udisks-daemon Aug 23 22:43:42 osmc kernel: [ 486] 0 486 1717 82 7 0 0 udisks-daemon Aug 23 22:43:42 osmc kernel: [ 494] 0 494 8682 181 11 0 0 polkitd Aug 23 22:43:42 osmc kernel: [ 841] 106 841 1234 136 6 0 0 ntpd Aug 23 22:43:42 osmc kernel: [ 1837] 0 1837 22544 1988 19 0 0 php5-fpm Aug 23 22:43:42 osmc kernel: [31735] 115 31735 48742 24433 98 0 0 mono Aug 23 22:43:42 osmc kernel: [13851] 109 13851 33620 12379 48 0 0 transmission-da Aug 23 22:43:42 osmc kernel: [24291] 110 24291 97808 65189 212 0 0 mono Aug 23 22:43:42 osmc kernel: [10305] 0 10305 542 54 5 0 0 atd Aug 23 22:43:42 osmc kernel: [22940] 0 22940 700 78 5 0 0 mediacenter Aug 23 22:43:42 osmc kernel: [22990] 0 22990 1355 111 5 0 0 sudo Aug 23 22:43:42 osmc kernel: [22997] 1000 22997 340355 101311 440 0 0 kodi.bin Aug 23 22:43:42 osmc kernel: [10009] 0 10009 198976 503 11 0 0 gotty Aug 23 22:43:42 osmc kernel: [10017] 0 10017 3385 222 10 0 0 nginx Aug 23 22:43:42 osmc kernel: [10018] 33 10018 3523 383 10 0 0 nginx Aug 23 22:43:42 osmc kernel: [10019] 33 10019 3519 367 10 0 0 nginx Aug 23 22:43:42 osmc kernel: [17542] 113 17542 64349 34422 159 0 0 mono Aug 23 22:43:42 osmc kernel: [27600] 0 27600 1060 86 6 0 0 su Aug 23 22:43:42 osmc kernel: [27623] 117 27623 1041 100 6 0 0 systemd Aug 23 22:43:42 osmc kernel: [27628] 117 27628 5944 474 8 0 0 (sd-pam) Aug 23 22:43:42 osmc kernel: [27633] 117 27633 146497 107312 338 0 0 mono-sgen Aug 23 22:43:42 osmc kernel: [ 5701] 1000 5701 1042 122 6 0 0 systemd Aug 23 22:43:42 osmc kernel: [ 5706] 1000 5706 5944 474 8 0 0 (sd-pam) Aug 23 22:43:42 osmc kernel: [ 5709] 1000 5709 743 50 5 0 0 ssh-agent Aug 23 22:43:42 osmc kernel: [13232] 33 13232 22667 993 20 0 0 php5-fpm Aug 23 22:43:42 osmc kernel: [13251] 33 13251 22599 982 19 0 0 php5-fpm Aug 23 22:43:42 osmc kernel: Out of memory: Kill process 27633 (mono-sgen) score 234 or sacrifice child Aug 23 22:43:42 osmc kernel: Killed process 27633 (mono-sgen) total-vm:585988kB, anon-rss:429084kB, file-rss:164kB Running kodi also with emby plugin (native path mode). Both kodi and emby were on the 400MB usage mark. Thats 100 over for kodi usual, and over 200MB over for emby usual. I peeked on both kodi logs and emby logs to check what was happening at the time and before. Emby logs are full of this: 2017-08-23 21:48:43.514 Info HttpServer: HTTP GET http://10.8.1.12:8096/emby/Items/797a380d9251abbb0b5ebf7e7d7932f4/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=0307d86e74dc45103f0d00f1c121dbc2. UserAgent: Kodi/17.3 (X11; Linux aarch64) OSMC/2017.07-1 App_Bitness/32 Version/17.3 2017-08-23 21:48:43.517 Error HttpServer: Error processing request *** Error Report *** Version: 3.2.28.0 Command line: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe -programdata /var/lib/emby-server -restartpath /usr/lib/emby-server/restart.sh Operating system: Unix 3.14.29.28 64-Bit OS: True 64-Bit Process: False Mono: 5.2.0.215 (tarball Mon Aug 14 16:25:12 UTC 2017) Processor count: 4 Program data path: /var/lib/emby-server Application directory: /usr/lib/emby-server/bin System.NullReferenceException: Object reference not set to an instance of an object. at MediaBrowser.Api.Images.ImageService.GetImageInfo (MediaBrowser.Api.Images.ImageRequest request, MediaBrowser.Controller.Entities.IHasMetadata item) [0x00028] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at MediaBrowser.Api.Images.ImageService.GetImage (MediaBrowser.Api.Images.ImageRequest request, MediaBrowser.Controller.Entities.IHasMetadata item, System.Boolean isHeadRequest) [0x00125] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at MediaBrowser.Api.Images.ImageService.Get (MediaBrowser.Api.Images.GetItemImage request) [0x00032] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at (wrapper dynamic-method) System.Object:lambda_method (System.Runtime.CompilerServices.Closure,object,object) at Emby.Server.Implementations.Services.ServiceExecGeneral+<Execute>c__async0.MoveNext () [0x0010a] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0003e] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x00028] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x00008] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <204f770036d441bb8dfd3daba3550e83>:0 at Emby.Server.Implementations.Services.ServiceHandler+<ProcessRequestAsync>c__async1.MoveNext () [0x0016b] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0003e] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x00028] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x00008] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <204f770036d441bb8dfd3daba3550e83>:0 at Emby.Server.Implementations.HttpServer.HttpListenerHost+<RequestHandler>c__async0.MoveNext () [0x006c8] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 System.NullReferenceException at MediaBrowser.Api.Images.ImageService.GetImageInfo (MediaBrowser.Api.Images.ImageRequest request, MediaBrowser.Controller.Entities.IHasMetadata item) [0x00028] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at MediaBrowser.Api.Images.ImageService.GetImage (MediaBrowser.Api.Images.ImageRequest request, MediaBrowser.Controller.Entities.IHasMetadata item, System.Boolean isHeadRequest) [0x00125] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at MediaBrowser.Api.Images.ImageService.Get (MediaBrowser.Api.Images.GetItemImage request) [0x00032] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at (wrapper dynamic-method) System.Object:lambda_method (System.Runtime.CompilerServices.Closure,object,object) at Emby.Server.Implementations.Services.ServiceExecGeneral+<Execute>c__async0.MoveNext () [0x0010a] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0003e] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x00028] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x00008] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <204f770036d441bb8dfd3daba3550e83>:0 at Emby.Server.Implementations.Services.ServiceHandler+<ProcessRequestAsync>c__async1.MoveNext () [0x0016b] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0003e] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x00028] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x00008] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <204f770036d441bb8dfd3daba3550e83>:0 at Emby.Server.Implementations.HttpServer.HttpListenerHost+<RequestHandler>c__async0.MoveNext () [0x006c8] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 And kodi logs are full of this: 21:50:47.462 T:3176059888 ERROR: CCurlFile::Stat - Failed: HTTP response code said error(22) for http://10.8.1.12:8096/emby/Items/a4b9ce96d071e2f7e8ddceb787b0afad/Images/Backdrop/0?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=490d47f0f39913b9d8544b83a5e47a6d 21:50:47.484 T:3176059888 ERROR: Previous line repeats 1 times. 21:50:47.484 T:3176059888 ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 500 21:50:47.484 T:3176059888 ERROR: CCurlFile::Open failed with code 500 for http://10.8.1.12:8096/emby/Items/a4b9ce96d071e2f7e8ddceb787b0afad/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=490d47f0f39913b9d8544b83a5e47a6d 21:50:47.484 T:3176059888 ERROR: GetDirectory - Unable to get http directory (http://10.8.1.12:8096/emby/Items/a4b9ce96d071e2f7e8ddceb787b0afad/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=490d47f0f39913b9d8544b83a5e47a6d) 21:50:47.485 T:3176059888 ERROR: GetDirectory - Error getting http://10.8.1.12:8096/emby/Items/a4b9ce96d071e2f7e8ddceb787b0afad/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=490d47f0f39913b9d8544b83a5e47a6d 21:50:47.497 T:3042972656 ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 500 21:50:47.498 T:3042972656 ERROR: CCurlFile::Open failed with code 500 for http://10.8.1.12:8096/emby/Items/a4b9ce96d071e2f7e8ddceb787b0afad/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=490d47f0f39913b9d8544b83a5e47a6d 21:50:47.498 T:3042972656 ERROR: GetDirectory - Unable to get http directory (http://10.8.1.12:8096/emby/Items/a4b9ce96d071e2f7e8ddceb787b0afad/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=490d47f0f39913b9d8544b83a5e47a6d) 21:50:47.498 T:3042972656 ERROR: GetDirectory - Error getting http://10.8.1.12:8096/emby/Items/a4b9ce96d071e2f7e8ddceb787b0afad/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=490d47f0f39913b9d8544b83a5e47a6d Just checking if it rings a bell for anyone. Other than that, no more clues. thanks. Edited August 24, 2017 by talentless Link to comment Share on other sites More sharing options...
Luke 37271 Posted August 24, 2017 Share Posted August 24, 2017 Hi there, can you please attach the complete emby server log? thanks ! Link to comment Share on other sites More sharing options...
talentless 2 Posted August 24, 2017 Author Share Posted August 24, 2017 (edited) the day of the crash https://file.io/DwqQB9 the day before https://file.io/OdamPs ... and now I realized how files are attached Edited August 25, 2017 by talentless Link to comment Share on other sites More sharing options...
Luke 37271 Posted August 25, 2017 Share Posted August 25, 2017 @@talentless those are both coming up 404 not found. Link to comment Share on other sites More sharing options...
talentless 2 Posted August 25, 2017 Author Share Posted August 25, 2017 There. Sorry for that. Big one is of the day of the crash, and the other one the day before. server-63638956800.txt server-63639043200.txt Link to comment Share on other sites More sharing options...
Luke 37271 Posted August 25, 2017 Share Posted August 25, 2017 I don't see anything obvious but please be aware we haven't tested with mono 5.2 yet, and I see you have that installed. In fact, our recommended version is still 4.8.1. We are really focusing on moving over to .NET core. I would be interested to see if this issue occurs for you there. If you don't mind a little experimentation can you jump into our testing thread there: https://emby.media/community/index.php?/topic/50012-emby-server-for-net-core/ Thanks. Link to comment Share on other sites More sharing options...
talentless 2 Posted August 25, 2017 Author Share Posted August 25, 2017 I see. I don't know if I have much leeway in choosing the specific version of mono I run with. I will check that out. Otherwise, about running with .NET core, can they share the var dir with legacy setup? Or can installations be done in parallel? Thanks. Link to comment Share on other sites More sharing options...
Luke 37271 Posted August 25, 2017 Share Posted August 25, 2017 The install right now would be parallel. Eventually we will switch our install packages to .net core and it will update seamlessly, but right now it is just for testing and experimentation. Thanks ! Link to comment Share on other sites More sharing options...
puithove 208 Posted August 26, 2017 Share Posted August 26, 2017 You might also be able to rectify the situation with mono if you switch your mono executable to mono-sgen, and then change the nursery size (what to use here depends on how much RAM you have) - MONO_GC_PARAMS=nursery-size=512m Simply changing to mono-sgen even without changing the nursery size might even be enough. It has different garbage collection than the base mono executable. I was always running into memory issues prior to doing that - server would become unresponsive usually, and occasionally outright crash. Link to comment Share on other sites More sharing options...
talentless 2 Posted August 26, 2017 Author Share Posted August 26, 2017 (edited) Yes, was running mono-sgen. 64m nursery size. Edited August 26, 2017 by talentless Link to comment Share on other sites More sharing options...
talentless 2 Posted August 27, 2017 Author Share Posted August 27, 2017 (edited) @@Luke, I think there is something worth looking at here. These requests that the kodi emby plugin keeps making continuously to emby server for an item that does not exist for which obviously an HTTP 500 response is given might be related to the memory problem, or at least it is a problem on itself. This is happening for every item that is removed from the library: From a fresh restart, everything seems normal. But then I delete an item from the library: 2017-08-27 13:59:26.685 Info HttpServer: HTTP DELETE http://osmc.local:8096/emby/Items/3af37eab28a01f458559095957281366. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.101 Safari/537.36 Soon after, even though the item has been deleted, kodi keeps asking about it: 2017-08-27 14:12:58.768 Info HttpServer: HTTP HEAD http://10.8.1.12:8096/emby/Items/3af37eab28a01f458559095957281366/Images/Backdrop/0?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=d44395f55e03ca8672ed9003660ca06b. UserAgent: Kodi/17.3 (X11; Linux aarch64) OSMC/2017.07-1 App_Bitness/32 Version/17.3 2017-08-27 14:12:58.892 Error HttpServer: Error processing request *** Error Report *** Version: 3.2.28.0 Command line: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe -programdata /var/lib/emby-server -restartpath /usr/lib/emby-server/restart.sh Operating system: Unix 3.14.29.28 64-Bit OS: True 64-Bit Process: False Mono: 5.2.0.215 (tarball Mon Aug 14 16:25:12 UTC 2017) Processor count: 4 Program data path: /var/lib/emby-server Application directory: /usr/lib/emby-server/bin System.NullReferenceException: Object reference not set to an instance of an object. at MediaBrowser.Api.Images.ImageService.GetImageInfo (MediaBrowser.Api.Images.ImageRequest request, MediaBrowser.Controller.Entities.IHasMetadata item) [0x00028] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at MediaBrowser.Api.Images.ImageService.GetImage (MediaBrowser.Api.Images.ImageRequest request, MediaBrowser.Controller.Entities.IHasMetadata item, System.Boolean isHeadRequest) [0x00125] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at MediaBrowser.Api.Images.ImageService.Head (MediaBrowser.Api.Images.GetItemImage request) [0x00032] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at (wrapper dynamic-method) System.Object:lambda_method (System.Runtime.CompilerServices.Closure,object,object) at Emby.Server.Implementations.Services.ServiceExecGeneral+<Execute>c__async0.MoveNext () [0x0010a] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0003e] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x00028] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x00008] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <204f770036d441bb8dfd3daba3550e83>:0 at Emby.Server.Implementations.Services.ServiceHandler+<ProcessRequestAsync>c__async1.MoveNext () [0x0016b] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0003e] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x00028] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x00008] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <204f770036d441bb8dfd3daba3550e83>:0 at Emby.Server.Implementations.HttpServer.HttpListenerHost+<RequestHandler>c__async0.MoveNext () [0x006c8] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 System.NullReferenceException at MediaBrowser.Api.Images.ImageService.GetImageInfo (MediaBrowser.Api.Images.ImageRequest request, MediaBrowser.Controller.Entities.IHasMetadata item) [0x00028] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at MediaBrowser.Api.Images.ImageService.GetImage (MediaBrowser.Api.Images.ImageRequest request, MediaBrowser.Controller.Entities.IHasMetadata item, System.Boolean isHeadRequest) [0x00125] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at MediaBrowser.Api.Images.ImageService.Head (MediaBrowser.Api.Images.GetItemImage request) [0x00032] in <7ef724ea6c9f4850ad7e015736f9c683>:0 at (wrapper dynamic-method) System.Object:lambda_method (System.Runtime.CompilerServices.Closure,object,object) at Emby.Server.Implementations.Services.ServiceExecGeneral+<Execute>c__async0.MoveNext () [0x0010a] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0003e] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x00028] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x00008] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <204f770036d441bb8dfd3daba3550e83>:0 at Emby.Server.Implementations.Services.ServiceHandler+<ProcessRequestAsync>c__async1.MoveNext () [0x0016b] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0003e] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x00028] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x00008] in <204f770036d441bb8dfd3daba3550e83>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <204f770036d441bb8dfd3daba3550e83>:0 at Emby.Server.Implementations.HttpServer.HttpListenerHost+<RequestHandler>c__async0.MoveNext () [0x006c8] in <adbab6d6a6d34810a7acfd00fe3db61f>:0 The same can be seen in kodi log 14:12:58.906 T:3195007984 ERROR: CCurlFile::Stat - Failed: HTTP response code said error(22) for http://10.8.1.12:8096/emby/Items/3af37eab28a01f458559095957281366/Images/Backdrop/0?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=d44395f55e03ca8672ed9003660ca06b 14:12:58.923 T:3195007984 ERROR: CCurlFile::FillBuffer - Failed: HTTP returned error 500 14:12:58.923 T:3195007984 ERROR: CCurlFile::Open failed with code 500 for http://10.8.1.12:8096/emby/Items/3af37eab28a01f458559095957281366/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=d44395f55e03ca8672ed9003660ca06b 14:12:58.923 T:3195007984 ERROR: GetDirectory - Unable to get http directory (http://10.8.1.12:8096/emby/Items/3af37eab28a01f458559095957281366/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=d44395f55e03ca8672ed9003660ca06b) 14:12:58.923 T:3195007984 ERROR: GetDirectory - Error getting http://10.8.1.12:8096/emby/Items/3af37eab28a01f458559095957281366/Images/Backdrop/0/?MaxWidth=10000&MaxHeight=10000&Format=original&Tag=d44395f55e03ca8672ed9003660ca06b This goes on forever, every few minutes, for every item I ever remove from the library. It's clear that on kodi side of things something has not been cleared. Which is also not gently handled on the server (might be a mono version issue on its side, true). Coincidentally, memory consumption increases. Not sure that both things are related, but I think it would be appropriate to do away with this issue. Edited August 27, 2017 by talentless Link to comment Share on other sites More sharing options...
Luke 37271 Posted August 27, 2017 Share Posted August 27, 2017 That's not going to cause any major problem. Link to comment Share on other sites More sharing options...
Luke 37271 Posted November 19, 2018 Share Posted November 19, 2018 Emby Server for Arm64 is now available ! https://emby.media/community/index.php?/topic/65476-emby-server-for-arm64-now-available/ Thanks. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now