SMLMATS 0 Posted April 1, 2020 Share Posted April 1, 2020 Hey guys I started before and made a windows server my emby server and shared it with family and a few people in reddit Now I have main server with iscsi disks from 2nd server I was told this is not good and I should use Docker Installed docker on seperate machine with emby on it. I'm looking to be able to scale easily What's your recommended solution? I did both through youtube and reading around the web. First server has 15 TB second one has 27 TB They are mostly empty since i'm working on a good scalable system Any help would be appreciated Regards Link to comment Share on other sites More sharing options...
Luke 37098 Posted April 1, 2020 Share Posted April 1, 2020 @@jscoys @@Jdiesel @@pir8radio may have some tips on this. Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted April 1, 2020 Share Posted April 1, 2020 (edited) Hey guys I started before and made a windows server my emby server and shared it with family and a few people in reddit Now I have main server with iscsi disks from 2nd server I was told this is not good and I should use Docker Installed docker on seperate machine with emby on it. I'm looking to be able to scale easily What's your recommended solution? I did both through youtube and reading around the web. First server has 15 TB second one has 27 TB They are mostly empty since i'm working on a good scalable system Any help would be appreciated Regards Whats "not good" about the original setup? What is providing your iscsi target? Nothing wrong with iscsi targets attached to a server with all of your media on it.. Thats what I run, except my target is an actual raid array, but as long as your hardware can support whatever you are trying to move through it, it should be fine. Depending on what you are trying to "scale" to... My setup has 64TB iscsi raid, with two copper 1gbps links to my windows box, those two links are tied together using MPIO. I get decent throughput. 1.8 Gbps read and 1.4 write. ----------------------------------------------------------------------- CrystalDiskMark 6.0.2 x64 (C) 2007-2018 hiyohiyo Crystal Dew World : https://crystalmark.info/ ----------------------------------------------------------------------- * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s] * KB = 1000 bytes, KiB = 1024 bytes Sequential Read (Q= 32,T= 1) : 227.830 MB/s [1.82264 Gb/s ] Sequential Write (Q= 32,T= 1) : 185.675 MB/s [1.4854 Gb/s ] Random Read 4KiB (Q= 8,T= 8) : 13.163 MB/s [ 3213.6 IOPS] Random Write 4KiB (Q= 8,T= 8) : 6.317 MB/s [ 1542.2 IOPS] Random Read 4KiB (Q= 32,T= 1) : 12.166 MB/s [ 2970.2 IOPS] Random Write 4KiB (Q= 32,T= 1) : 6.424 MB/s [ 1568.4 IOPS] Random Read 4KiB (Q= 1,T= 1) : 2.946 MB/s [ 719.2 IOPS] Random Write 4KiB (Q= 1,T= 1) : 6.007 MB/s [ 1466.6 IOPS] Test : 500 MiB [G: 11.7% (7693.9/65536.0 GiB)] (x2) [Interval=5 sec] Date : 2019/12/30 11:35:17 OS : Windows 10 Professional [10.0 Build 17763] (x64) And I seldom see the iscsi usage even come close to hitting 1 Gb/s with normal emby use, unzipping movies, downloading to iscsi while multiple movies being streamed. Edited April 1, 2020 by pir8radio 1 Link to comment Share on other sites More sharing options...
SMLMATS 0 Posted April 2, 2020 Author Share Posted April 2, 2020 (edited) Thank you @@pir8radioMy iscsi is another server acting as Target.I heard about mipo but didn't know how to configure it.I think MIPO won't work since I have igb linkThank you again for your inputWould I be able to attach more servers as targets?In same DC or different one? Edited April 2, 2020 by Luke Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted April 2, 2020 Share Posted April 2, 2020 (edited) Thank you @@pir8radio My iscsi is another server acting as Target. I heard about mipo but didn't know how to configure it. I think MIPO won't work since I have igb link Thank you again for your input Would I be able to attach more servers as targets? In same DC or different one? I have two 1GB links tied with MPIO, and i get 1.8gbps of throughput. yes you can attach more as targets... you just want to have them on their own "san" network if you can... you dont want to talk iscsi over the same interface that they use to reach the internet or whatever. Edited April 2, 2020 by pir8radio 1 Link to comment Share on other sites More sharing options...
SMLMATS 0 Posted April 2, 2020 Author Share Posted April 2, 2020 I have two 1GB links tied with MPIO, and i get 1.8gbps of throughput. yes you can attache more as targets... you just want to have them on their own "san" network if you can... you dont want to talk iscsi over the same interface that they use to reach the internet or whatever. Thank you again pir8radio I'm thinkin of making a scale out file server so in the long it would be easier to expand for multiple users For ISCSI scenario, I have to the option to attach them through same interface but via a vSwitch provided by data center. Which option is better? Regards Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted April 2, 2020 Share Posted April 2, 2020 Thank you again pir8radio I'm thinkin of making a scale out file server so in the long it would be easier to expand for multiple users For ISCSI scenario, I have to the option to attach them through same interface but via a vSwitch provided by data center. Which option is better? Regards what two options are you asking about? Link to comment Share on other sites More sharing options...
SMLMATS 0 Posted April 2, 2020 Author Share Posted April 2, 2020 the scale out file server or pure iscsi targets I think that using scale out file server will allow my cluster to be more reliable and provide scalability Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted April 2, 2020 Share Posted April 2, 2020 Im still not following, what are you calling a "file server" iscsi devices are just remote drives for a central server... so technically it could be a file server with a bunch of iscsi servers attached.. or are you talking about an all new windows server with a bunch of drives in it, that also runs emby... Just think of what your "scale" will be, your bottleneck will move around depending on scale... If you only have a 1gb upstream internet connection, then that will most likely be your bottle neck, if you have a 10gbps internet connection, then the IO between the drives could be your bottleneck, especially if you chose a software raid, vs HW, sata vs SAS. Depending on your server hardware, and if you are doing transcoding, your CPU could be the bottleneck. There are a lot of variables that you need to figure out.... I started with a beefy server, dual xeons, fast ram, internal raid with sata drives, and wasnt happy with its performance. I now run a GPU server with dual xeons, onboard SAS SSD's for transcoding, a 12bay ISCSI array, with SSD tiering, 1 of the 4 GPU slots has an Nvidia RTX 4000 (i can add 3 more if needed), in a data center, with two 1Gbps internet connections linked LACP to their router that has multiple 10gbps links to the net. and so far that has been working great. for me, but that may not be good enough for whatever scale you hope to reach... Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now