Emby on Docker over Centos 8 or Windows server with iscsi targets

[SMLMATS 0]

Hey guys

I started before and made a windows server my emby server and shared it with family and a few people in reddit

Now I have main server with iscsi disks from 2nd server

I was told this is not good and I should use Docker

 

Installed docker on seperate machine with emby on it.

 

I'm looking to be able to scale easily

What's your recommended solution?

 

I did both through youtube and reading around the web.

 

First server has 15 TB second one has 27 TB

They are mostly empty since i'm working on a good scalable system

 

 

Any help would be appreciated

Regards

[Luke 37010]

@@jscoys

@@Jdiesel

@@pir8radio

 

may have some tips on this.

[pir8radio 1292]

Hey guys

I started before and made a windows server my emby server and shared it with family and a few people in reddit

Now I have main server with iscsi disks from 2nd server

I was told this is not good and I should use Docker

 

Installed docker on seperate machine with emby on it.

 

I'm looking to be able to scale easily

What's your recommended solution?

 

I did both through youtube and reading around the web.

 

First server has 15 TB second one has 27 TB

They are mostly empty since i'm working on a good scalable system

 

 

Any help would be appreciated

Regards

 

 

Whats "not good" about the original setup?    What is providing your iscsi target?      Nothing wrong with iscsi targets attached to a server with all of your media on it..     Thats what I run, except my target is an actual raid array, but as long as your hardware can support whatever you are trying to move through it, it should be fine. 

 

Depending on what you are trying to "scale" to...    My setup has 64TB iscsi raid, with two copper 1gbps links to my windows box, those two links are tied together using MPIO.  I get decent throughput. 1.8 Gbps read and 1.4 write.

-----------------------------------------------------------------------
CrystalDiskMark 6.0.2 x64 (C) 2007-2018 hiyohiyo
                          Crystal Dew World : https://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

   Sequential Read (Q= 32,T= 1) :   227.830 MB/s [1.82264 Gb/s  ]
  Sequential Write (Q= 32,T= 1) :   185.675 MB/s [1.4854  Gb/s  ]
  Random Read 4KiB (Q=  8,T= 8) :    13.163 MB/s [   3213.6 IOPS]
 Random Write 4KiB (Q=  8,T= 8) :     6.317 MB/s [   1542.2 IOPS]
  Random Read 4KiB (Q= 32,T= 1) :    12.166 MB/s [   2970.2 IOPS]
 Random Write 4KiB (Q= 32,T= 1) :     6.424 MB/s [   1568.4 IOPS]
  Random Read 4KiB (Q=  1,T= 1) :     2.946 MB/s [    719.2 IOPS]
 Random Write 4KiB (Q=  1,T= 1) :     6.007 MB/s [   1466.6 IOPS]

  Test : 500 MiB [G: 11.7% (7693.9/65536.0 GiB)] (x2)  [Interval=5 sec]
  Date : 2019/12/30 11:35:17
    OS : Windows 10 Professional [10.0 Build 17763] (x64)

And I seldom see the iscsi usage even come close to hitting 1 Gb/s with normal emby use, unzipping movies, downloading to iscsi while multiple movies being streamed. 

Edited April 1, 2020 by pir8radio

[SMLMATS 0]

Thank you @@pir8radio

My iscsi is another server acting as Target.
I heard about mipo but didn't know how to configure it.

I think MIPO won't work since I have igb link
Thank you again for your input
Would I be able to attach more servers as targets?
In same DC or different one?

Edited April 2, 2020 by Luke

[pir8radio 1292]

Thank you @@pir8radio

 

My iscsi is another server acting as Target.

I heard about mipo but didn't know how to configure it.

 

I think MIPO won't work since I have igb link

Thank you again for your input

Would I be able to attach more servers as targets?

In same DC or different one?

 

I have two 1GB links tied with MPIO, and i get 1.8gbps of throughput.

 

yes you can attach more as targets... you just want to have them on their own "san" network if you can...  you dont want to talk iscsi over the same interface that they use to reach the internet or whatever.

Edited April 2, 2020 by pir8radio

[SMLMATS 0]

I have two 1GB links tied with MPIO, and i get 1.8gbps of throughput.

 

yes you can attache more as targets... you just want to have them on their own "san" network if you can...  you dont want to talk iscsi over the same interface that they use to reach the internet or whatever.

Thank you again pir8radio

 

I'm thinkin of making a scale out file server so in the long it would be easier to expand for multiple users

For ISCSI scenario, I have to the option to attach them through same interface but via a vSwitch provided by data center.

 

Which option is better?

Regards

[pir8radio 1292]

Thank you again pir8radio

 

I'm thinkin of making a scale out file server so in the long it would be easier to expand for multiple users

For ISCSI scenario, I have to the option to attach them through same interface but via a vSwitch provided by data center.

 

Which option is better?

Regards

 

what two options are you asking about?

[SMLMATS 0]

the scale out file server or pure iscsi targets

 

I think that using scale out file server will allow my cluster to be more reliable and provide scalability

[pir8radio 1292]

Im still not following, what are you calling a "file server"   iscsi devices are just remote drives for a central server...    so technically it could be a file server with a bunch of iscsi servers attached..

 

or are you talking about an all new windows server with a bunch of drives in it, that also runs emby...       

 

Just think of what your "scale" will be, your bottleneck will move around depending on scale...  If you only have a 1gb upstream internet connection, then that will most likely be your bottle neck, if you have a 10gbps internet connection, then the IO between the drives could be your bottleneck, especially if you chose a software raid, vs HW,  sata vs SAS.   Depending on your server hardware, and if you are doing transcoding, your CPU could be the bottleneck.      There are a lot of variables that you need to figure out....

 

 

I started with a beefy server, dual xeons, fast ram, internal raid with sata drives, and wasnt happy with its performance.   I now run a GPU server with dual xeons, onboard SAS SSD's for transcoding, a 12bay ISCSI array, with SSD tiering, 1 of the 4 GPU slots has an Nvidia RTX 4000 (i can add 3 more if needed), in a data center, with two 1Gbps internet connections linked LACP to their router that has multiple 10gbps links to the net.  and so far that has been working great.     for me, but that may not be good enough for whatever scale you hope to reach...