Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Without knowing more on the specific needs (I followed some of the threads to try to grok it), it would be hard to guess what they really need.

[commercial alert]

My company (Scalable Informatics) literally builds very high performance Ceph (and other) appliances, specifically for people with huge data flow/load/performance needs.

Relevant links via shortener:

Main site: http://scalableinformatics.com (everything below is at that site under the FastPath->Unison tab) http://bit.ly/1vp3hGd

Ceph appliance: http://bit.ly/1qiOYpy

Especially relevant given the numbers I saw on the benchmarking ...

Ceph appliance benchmark whitepaper: http://bit.ly/2fMahfJ

Our EC test was about 2x better than the Dell unit (and the Supermicro unit), and our Librados tests were even more significantly ahead.

Petabyte scale appliances: http://bit.ly/2fuTTAH

We've even got some very nice SSD and NVM units, the latter starting around $1USD/GB.

[end commercial alert]

I noticed the 10k RPM drives ... really, drop them and go with SSDs if possible. You won't regret it.

Someone suggested underprovisioned 850 EVO. Our strong recommendation is against this, based upon our experience with Ceph, distributed storage, and consumer SSDs. You will be sorry if you go that route, as you will lose journals/MDS or whatever you put on there.

Additionally, I saw a thread about using RAIDs underneath. Just ... don't. Ceph doesn't like this ... or better, won't be able to make as effective use of it. Use the raw devices.

Depending upon the IOP needs (multi-tenant/massive client systems usually devolve into a DDoS against your storage platforms anyway), we'd probably recommend a number of specific SSD variations at various levels.

The systems we build are generally for people doing large scale genomics and financial processing (think thousands of cores hitting storage over 40-100Gb networks, where latency matters, and sustained performance needs to always be high). We do this with disk, flash, and NVMe.

I am at landman _at_ the company name above with no spaces, and a dot com at that end .



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: