Database maximum

[Emby Tower 34]

Hi,

 

in a few weeks I'll build my 42U server rack with 1.5 Petabyte stoarge capacity (only for Kodi and Emby ) and so I ask myself what the maximum of the embedded database is (video entries, music entries, etc.).

And so it would be very nice to know an approximate value of possible videos in Emby. Not exactly, but a number I can work with.

 

Thanks a lot.

Edited March 23, 2016 by XBMC Workstation

[Randomacts 5]

As far as I am aware there is not technically a limit but I doubt it has been tested on that large of a RAID. 

 

I'm sure the devs at some point will chime in but most likely if you run into issues just make a thread about on the forums.

[MrWebsmith 598]

and post pics and specs/config when youre done so we can all be jealous!

[MSattler 390]

The limitation won't be in relation to the drive space, but to the number of objects in the database, etc.

 

Since this is still all running on sqllite that is where you want to look for the limitations.    From this link it looks like a 140TB max:

 

https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&cad=rja&uact=8&ved=0ahUKEwjn-4ad7tbLAhWEez4KHaxOA5QQFggjMAE&url=http%3A%2F%2Fstackoverflow.com%2Fquestions%2F14451624%2Fwill-sqlite-performance-degrade-if-the-database-size-is-greater-than-2-gigabytes&usg=AFQjCNFxuNzHG6wxwdNgyVkyVDD0whJgZA&sig2=EyMd85uCeCyYkChPmaNtPQ

[Emby Tower 34]

and post pics and specs/config when youre done so we can all be jealous!

I'm planning a website about this project ...

[thefirstofthe300 292]

You will probably also have issues with RAM unless you have a crap-ton of it.  People seem to have issues with out-of-memory errors when the library gets too big.  Maybe that issue was fixed with the database changes Luke made?

[Koleckai Silvestri 1154]

Emby uses SQLite for its databases. The maximum size of an SQLite database is something like 140 Terabytes. There are multiple databases in Emby covering users, media, watched status, etc... Since the actual media isn't stored in the database, you can have quite a bit of media.

[Emby Tower 34]

Emby uses SQLite for its databases. The maximum size of an SQLite database is something like 140 Terabytes. There are multiple databases in Emby covering users, media, watched status, etc... Since the actual media isn't stored in the database, you can have quite a bit of media.

So we can say, that Emby has no reachable limit with its database(s)?! If yes, then it is AWESOME ....

[Koleckai Silvestri 1154]

So we can say, that Emby has no reachable limit with its database(s)?! If yes, then it is AWESOME ....

Well as stated above, other issues may arise. RAM and Storage can affect the database and performance. However, throw enough hardware at any problem and it goes away.

[Emby Tower 34]

Well as stated above, other issues may arise. RAM and Storage can affect the database and performance. However, throw enough hardware at any problem and it goes away.

Ok, then I'm very happy to have 32 GB RAM for the first time ...

[ebr 16169]

The bottlenecks that will arise are much more likely to be in either network bandwidth, payload size or the apps just being able to deal with really large result sets.

 

What is all this personal media that is going to fill up that storage?  Never mind... don't answer that.  I don't want to know.

[JeremyFr79 228]

The sarcasm is heavy with OP.  I can tell you I have a fairly large setup at 100TB of storage on an iSCSI SAN, it feeds a 32core server with 128GB of memory and Emby and it's databases have had 0 issues with the library.

[JeremyFr79 228]

I can also say that I can attest to the slower result sets on some clients, loading emby on say my Nexus Player in my bedroom, takes about 10-15 seconds for everything to fully populate.  And it's hardwired to my network so that's not an issue.

[MSattler 390]

I can also say that I can attest to the slower result sets on some clients, loading emby on say my Nexus Player in my bedroom, takes about 10-15 seconds for everything to fully populate.  And it's hardwired to my network so that's not an issue.

 

The NP is a total turd so that doesn't help =)  I see the same, my Shield on the other hands has no issues.

 

Hey google, want this NP back? =)

[Emby Tower 34]

The bottlenecks that will arise are much more likely to be in either network bandwidth, payload size or the apps just being able to deal with really large result sets.

 

What is all this personal media that is going to fill up that storage?  Never mind... don't answer that.  I don't want to know.

Oh, there is no warez activity by myself, I'm loving it to collect REAL BDs and DVDs ... You can see my BD collection at http://www.bluray-disc.de/blulife/filmliste/mcstarfighter ... Sorry, the collection list is in german language ... 

Edited March 23, 2016 by XBMC Workstation

[Randomacts 5]

Oh, there is no warez activity by myself, I'm loving it to collect REAL BDs and DVDs ... You can see my BD collection at http://www.bluray-disc.de/blulife/filmliste/mcstarfighter ... Sorry, the collection list is in german language ... 

 

Ah I thought so. @@ebr was prob thinking some other forms of entertainment but I figured it was prob just remuxes going by your posting history =p

[Emby Tower 34]

Ah I thought so. @@ebr was prob thinking some other forms of entertainment but I figured it was prob just remuxes going by your posting history =p

Remuxes are the easiest and fastest way to build a collection ... And I'm a big big fan of lossless media files ... FLACs, remux-MKVs, and so on ...

[Karbowiak 27]

You'll run into trouble with database performance way before sqlite gives out from amount of data.

Sort of wish using mysql/mariadb/postgresql was a possibility /o\

[Sven 136]

@@Karbowiak that's indeed also something we want. But for the moment that's a low priority.

[dcrdev 255]

You'll run into trouble with database performance way before sqlite gives out from amount of data.

 

Sort of wish using mysql/mariadb/postgresql was a possibility /o\

 

Already raised here: http://emby.media/community/index.php?/topic/31103-mysql-support/