Server crash scanning music library

[widget100 8]

Trying to defect to Emby from Plex after their destruction of the Android client and really impressed with Emby apart from a couple of minor UI criticisms and a major issue -

 

Raspberry PI 3 running Stretch, all updated to latest. Emby Version 3.4.1.0.  I've reflashed Stretch and rebuilt Emby, nothing else on the Pi apart from TVHeadend and problem is the same.

 

Add a music folder and scans for a while then Emby crashes. Remove the music library and all is stable. My music is on a CIFS share with full r/w perms. All manage folder setting in Emby for that media folder are default (I tried ticking the box for saving to the share but that seemed worse).  Video libraries are fine.

 

Every time I start Emby with sudo systemctl status emby-server and start a scan it crashes again with the below until I remove the Music folder. Please help me ditch plex

 

pi@raspberrypi:~ $ sudo systemctl status emby-server

● emby-server.service - Emby Server is a personal media server with apps on just about every device.

   Loaded: loaded (/usr/lib/systemd/system/emby-server.service; enabled; vendor preset: enabled)

   Active: failed (Result: signal) since Tue 2018-06-26 16:51:30 UTC; 10s ago

  Process: 8668 ExecStart=/opt/emby-server/bin/emby-server (code=killed, signal=SEGV)

 Main PID: 8668 (code=killed, signal=SEGV)

 

Jun 26 16:50:58 raspberrypi emby-server[8668]: Info App: Sqlite compiler options: COMPILER=gcc-6.4.1 20170707,ENABLE_COLUMN_METADATA,ENABLE_DBSTAT_VTAB,ENABLE_FTS3,ENABLE_FTS3_PARENTHESIS,E

Jun 26 16:50:58 raspberrypi emby-server[8668]: Info App: Default journal_mode for /var/lib/emby/data/sync14.db is wal

Jun 26 16:50:58 raspberrypi emby-server[8668]: Info App: PRAGMA synchronous=1

Jun 26 16:50:58 raspberrypi emby-server[8668]: Info App: Entry point completed: Emby.Server.Sync.SyncManagerEntryPoint. Duration: 0.0772895 seconds

Jun 26 16:50:58 raspberrypi emby-server[8668]: Info App: Starting entry point Emby.Server.Sync.SyncNotificationEntryPoint

Jun 26 16:50:58 raspberrypi emby-server[8668]: Info App: Entry point completed: Emby.Server.Sync.SyncNotificationEntryPoint. Duration: 0.0047981 seconds

Jun 26 16:50:58 raspberrypi emby-server[8668]: Info App: All entry points have started

Jun 26 16:51:30 raspberrypi systemd[1]: emby-server.service: Main process exited, code=killed, status=11/SEGV

Jun 26 16:51:30 raspberrypi systemd[1]: emby-server.service: Unit entered failed state.

Jun 26 16:51:30 raspberrypi systemd[1]: emby-server.service: Failed with result 'signal'.

 

Logs attached

embyserver.txt

embyserver-63665628629.txt

[Luke 42077]

Hi, this is strange. would you mind trying the beta install and seeing if that's any different? Thanks.

[widget100 8]

Thanks for the quick response.

 

Same again with the beta. It seemed to get further this time but same outcome. Wonder if it's anything to do with the TV reporting conflicts or is that a red herring.

 

Anything I can do to help diagnose it, I'm happy to do so.

 

pi@raspberrypi:/home $ sudo systemctl status emby-server
● emby-server.service - Emby Server is a personal media server with apps on just about every device.
   Loaded: loaded (/usr/lib/systemd/system/emby-server.service; enabled; vendor preset: enabled)
   Active: failed (Result: signal) since Tue 2018-06-26 19:56:49 UTC; 36s ago
  Process: 1740 ExecStart=/opt/emby-server/bin/emby-server (code=killed, signal=SEGV)
 Main PID: 1740 (code=killed, signal=SEGV)

Jun 26 19:48:31 raspberrypi emby-server[1740]:   libavformat    58. 12.100 / 58. 12.100
Jun 26 19:48:31 raspberrypi emby-server[1740]:   libavdevice    58.  3.100 / 58.  3.100
Jun 26 19:48:31 raspberrypi emby-server[1740]:   libavfilter     7. 16.100 /  7. 16.100
Jun 26 19:48:31 raspberrypi emby-server[1740]:   libswscale      5.  1.100 /  5.  1.100
Jun 26 19:48:31 raspberrypi emby-server[1740]:   libswresample   3.  1.100 /  3.  1.100
Jun 26 19:48:31 raspberrypi emby-server[1740]:   libpostproc    55.  1.100 / 55.  1.100
Jun 26 19:48:32 raspberrypi emby-server[1740]: [mp3 @ 0x2816c0] Format mp3 detected only with low score of 1, misdetection possible!
Jun 26 19:56:49 raspberrypi systemd[1]: emby-server.service: Main process exited, code=killed, status=11/SEGV
Jun 26 19:56:49 raspberrypi systemd[1]: emby-server.service: Unit entered failed state.
Jun 26 19:56:49 raspberrypi systemd[1]: emby-server.service: Failed with result 'signal'.
 

 

embyserver-63665639940.txt

[Luke 42077]

On the beta, can you try turning off the server's dlna features, and also the automatic port mapper? Then restart the server and see if that makes any difference. thanks.

[widget100 8]

Unticked everything on the DLNA page but wierdly there's still DLNA errors in the log. Unticked the port map too, rebooted the PI.

 

Same again. it goes down as soon as I hit the refresh library button.

 

 

 

embyserver-63665644287.txt

embyserver1.txt

[Luke 42077]

Those are not dlna errors, those are related to the port mapper. I'm assuming you tried restarting the server after that?

[widget100 8]

I did, but I've just checked and the setting didn't save, port mapping was ticked after the reboot. Just tried it again, untick port mapping, save, go back in and port mapping is enabled. same after a reboot.

 

Interestingly I've just updated to 1.22 and the server didnt seem to crash when adding the music folder, it just hung here. But then I stopped and restarted the folder scan and the server fell over immediately. (log 4)

 

pi@raspberrypi:/home $ sudo systemctl status emby-server
● emby-server.service - Emby Server is a personal media server with apps on just about every device.
   Loaded: loaded (/usr/lib/systemd/system/emby-server.service; enabled; vendor preset: enabled)
   Active: active (running) since Wed 2018-06-27 07:55:08 UTC; 43min ago
 Main PID: 10472 (EmbyServer)
   CGroup: /system.slice/emby-server.service
           ├─10472 /opt/emby-server/system/EmbyServer -programdata /var/lib/emby -ffmpeg /opt/emby-server/bin/ffmpeg -ffprobe /opt/emby-server/bin/ffprobe -
           └─14198 /opt/emby-server/bin/ffprobe -i smb://192.168.1.222/media/Music/Jazz/Jaz/Glenn Miller/Song of the Volga boatmen.mp3 -threads 0 -v info -p

Jun 27 08:12:13 raspberrypi emby-server[10472]: le-nvenc
Jun 27 08:12:13 raspberrypi emby-server[10472]:   libavutil      56. 14.100 / 56. 14.100
Jun 27 08:12:13 raspberrypi emby-server[10472]:   libavcodec     58. 18.100 / 58. 18.100
Jun 27 08:12:13 raspberrypi emby-server[10472]:   libavformat    58. 12.100 / 58. 12.100
Jun 27 08:12:13 raspberrypi emby-server[10472]:   libavdevice    58.  3.100 / 58.  3.100
Jun 27 08:12:13 raspberrypi emby-server[10472]:   libavfilter     7. 16.100 /  7. 16.100
Jun 27 08:12:13 raspberrypi emby-server[10472]:   libswscale      5.  1.100 /  5.  1.100
Jun 27 08:12:13 raspberrypi emby-server[10472]:   libswresample   3.  1.100 /  3.  1.100
Jun 27 08:12:13 raspberrypi emby-server[10472]:   libpostproc    55.  1.100 / 55.  1.100
Jun 27 08:12:14 raspberrypi emby-server[10472]: [mp3 @ 0xf716c0] Format mp3 detected only with low score of 1, misdetection possible!
 

 

embyserver2.txt

embyserver3.txt

Log.4txt.txt

Edited June 27, 2018 by widget100

[Luke 42077]

As a test are you able to scan through a small video library? To verify this it might require you to remove the music library. Thanks.

[widget100 8]

No problem doing that, have had to remove the library every time as when I started the server it would crash again as soon as it started the scan again.

 

test 1, added a single album folder with 6 tracks in it. Scan completed but then sever fell over when I tried to browse music.

test 2, added a second album, all good.

test3, added a folder with three album folders under it, crashed during the scan. 

 

Restarted, sent it off doing a full media scan and it fell over again.

 

Restarted, tried to access Music and it fell over again. Both these are repeatable until I remove the folders from that library.

 

Any ideas what to try next?

[Luke 42077]

did you try a small video library?

[widget100 8]

Sorry, misread what you said, thought you said audio, video is fine. I've got loads of video folders in there, some nested, mix of files types, some stuff from TVH.

 

That's been rock solid all week, it's only when I add music.

Edited June 30, 2018 by widget100

[widget100 8]

Any more ideas on how to troubleshoot this ?

[Luke 42077]

Have you tried the latest beta server?

[widget100 8]

Yep, running 3.4.1.8

[Luke 42077]

That's really out of date at this point.

[widget100 8]

Sorry, I seem to have been watching the wrong page https://github.com/MediaBrowser/Emby/releases rather than https://github.com/MediaBrowser/Emby.Releases/releases/.

 

I've now updated to .28, added a music library, it got to 90.3% and then fell over again. Restart and now whenever I click on anything in the music library it dies as before. Remove the music library and it's stable.

pi@raspberrypi:~ $ sudo systemctl status emby-server
● emby-server.service - Emby Server is a personal media server with apps on just about every device.
   Loaded: loaded (/usr/lib/systemd/system/emby-server.service; enabled; vendor preset: enabled)
   Active: failed (Result: signal) since Sun 2018-07-08 09:23:52 UTC; 9s ago
  Process: 7360 ExecStart=/opt/emby-server/bin/emby-server (code=killed, signal=SEGV)
 Main PID: 7360 (code=killed, signal=SEGV)

Jul 08 09:23:34 raspberrypi emby-server[7360]: Info App: Sqlite compiler options: COMPILER=gcc-6.4.1 20170707,ENABLE_COLUMN_METADATA,ENABLE_DBSTAT_V
Jul 08 09:23:34 raspberrypi emby-server[7360]: Info App: Default journal_mode for /var/lib/emby/data/sync14.db is wal
Jul 08 09:23:34 raspberrypi emby-server[7360]: Info App: PRAGMA synchronous=1
Jul 08 09:23:34 raspberrypi emby-server[7360]: Info App: Entry point completed: Emby.Server.Sync.SyncManagerEntryPoint. Duration: 0.0678004 seconds
Jul 08 09:23:34 raspberrypi emby-server[7360]: Info App: Starting entry point Emby.Server.Sync.SyncNotificationEntryPoint
Jul 08 09:23:34 raspberrypi emby-server[7360]: Info App: Entry point completed: Emby.Server.Sync.SyncNotificationEntryPoint. Duration: 0.0072879 sec
Jul 08 09:23:34 raspberrypi emby-server[7360]: Info App: All entry points have started
Jul 08 09:23:52 raspberrypi systemd[1]: emby-server.service: Main process exited, code=killed, status=11/SEGV
Jul 08 09:23:52 raspberrypi systemd[1]: emby-server.service: Unit entered failed state.
Jul 08 09:23:52 raspberrypi systemd[1]: emby-server.service: Failed with result 'signal'.

[widget100 8]

Ok, there seems to be a consistent failure with the folder that this song is in.

 

pi@raspberrypi:~ $ sudo systemctl status emby-server
● emby-server.service - Emby Server is a personal media server with apps on just about every device.
   Loaded: loaded (/usr/lib/systemd/system/emby-server.service; enabled; vendor preset: enabled)
   Active: active (running) since Sun 2018-07-08 11:15:05 UTC; 54min ago
 Main PID: 381 (EmbyServer)
   CGroup: /system.slice/emby-server.service
           ├─ 381 /opt/emby-server/system/EmbyServer -programdata /var/lib/emby -ffmpeg /opt/emby-server/bin/ffmpeg -ffprobe /opt/emby-server/bin/ffprobe -restartexitcode 3 -updatepa
           └─7940 /opt/emby-server/bin/ffprobe -i smb://192.168.1.222/media/Music/Jazz/Jaz/Glenn Miller/Song of the Volga boatmen.mp3 -threads 0 -v info -print_format json -show_stre

Jul 08 11:49:48 raspberrypi emby-server[381]: le-nvenc
Jul 08 11:49:48 raspberrypi emby-server[381]:   libavutil      56. 14.100 / 56. 14.100
Jul 08 11:49:48 raspberrypi emby-server[381]:   libavcodec     58. 18.100 / 58. 18.100
Jul 08 11:49:48 raspberrypi emby-server[381]:   libavformat    58. 12.100 / 58. 12.100
Jul 08 11:49:48 raspberrypi emby-server[381]:   libavdevice    58.  3.100 / 58.  3.100
Jul 08 11:49:48 raspberrypi emby-server[381]:   libavfilter     7. 16.100 /  7. 16.100
Jul 08 11:49:48 raspberrypi emby-server[381]:   libswscale      5.  1.100 /  5.  1.100
Jul 08 11:49:48 raspberrypi emby-server[381]:   libswresample   3.  1.100 /  3.  1.100
Jul 08 11:49:48 raspberrypi emby-server[381]:   libpostproc    55.  1.100 / 55.  1.100
Jul 08 11:49:48 raspberrypi emby-server[381]: [mp3 @ 0x27e6c0] Format mp3 detected only with low score of 1, misdetection possible!
 

It hung here for 20 mins, scanning hung at 90.2%. So I clicked Home, Music, and then clicked on a random Album folder and Emby crashed status=11/SEGV again.

 

Removed the music library, create a new one with just the path \\192.168.1.222\media\Music\Jazz\Jaz\Glenn Miller, it gets to that same file, same error and as soon as I click on the Music library same 11/SEGV.

 

So I have it in a place where it's completely repeatable with this one folder (happens on others too, but lets concentrate on this one).  On further investigation, copying that folder locally, it turns out the mp3 files wont play in Windows Media Player, and only 2 of the 21 plays in VLC. So they're corrupt even though FFMPEG manages to index most of them. It shouldn't crash Emby though.

 

How do I help you troubleshoot this?   

 

 

[Luke 42077]

Right now I'm not sure as these segfaults are always the nastiest to hunt down.

[widget100 8]

Would it help if I zipped up the offended files so you can grab them and test?

[Luke 42077]

Yes that would, thanks.

[widget100 8]

Here we go, good luck.

 

Loving pretty much everything else about Emby.  (only downer is the dropping support for older Samsung 2011 series but I cant expect you to continue forever on something so old).

 

Quite unbelievably I seem to be able to transcode at 28 fps from recorded TVH files on a RPI 3B to the Web client. It only manages 18 fps on a live TVH stream but I'm going to buy one of the new 3B+ to see if the extra grunt will manage 24. If it does then that'll be amazing. Also if that will transcode to Chromecast on the fly that'll negate the Samsung issue.

 

Bad MP3.zip

[widget100 8]

So I deleted that folder, add the library again, get quite a bit further but then the scanning hangs at a track that's actually fine. I've checked all the .ogg files in that folder and they play fine. Whilst the scan is hanging  for 20 mins or so it doesnt actually crash (you can see in the log what happens after it hits the 1st Julie London track), I go to the home page, click music, click an album and it segfaults.

 

hang.log

[Luke 42077]

Thanks, we are still trying to chase this down.

[widget100 8]

Ok, I have some more clues. Ripped a load of CDs that I bought a couple of weeks back, MP3, 320K. Stuck them on the share and same crash as usual importing the library.

 

I thought no way are these corrupt so I put a USB stick on the PI, copied the files to that and set /mnt/usb/music as the folder. All perfect.

Then I took the bad MP3 files put them on the stick and added that folder to the library, all perfect. Emby says unplayable for the files that are corrupt but plays the good ones. No Seg faults, no hangs accessing the interface.

 

So we can conclude that it's something to do with scanning shares/adding libraries across the network. Does that help any?

 

... and a couple of hours later I have some very good news (for me, not for you. You still have a bug )

 

I've been adding the folders as \\192.168.1.xxx\share\folder which worked perfectly for all my videos but not for the music.

 

I decided to mount the folders in FSTAB in the format //192.168.1.xxx/media/Music/jazz  /mnt/jazz  cifs  auto,defaults,nofail,username=guest,password=,iocharset=utf8,sec=ntlm,noserverino,vers=1.0 0  0

 

Everything works perfectly. I did have one crash with a  Main process exited, code=killed, status=6/ABRT but restarted, rescanned the folder and all is good.

 

So over to you for the weird network scanning issue but I'm happy and I'll be getting premiere after payday. If you need me to test anything let me know.

 

 

Edited July 12, 2018 by widget100

[Luke 42077]

Thanks for the info. We're still trying to chase this down. I'm not sure it will matter, but please try the .34 beta once available. Thanks.