Hardware Recommendations

For small clusters (5-50 nodes)

Machine TypeWorkload Pattern/ Cluster TypeStorageProcessor (# of Cores)Memory (GB)Network
SlavesBalanced workloadFour to six 2 TB disksOne Quad241 GB Ethernet all-to-all
HBase clusterSix 2 TB disksDual Quad48
MastersBalanced and/or HBase clusterFour to six 2 TB disksDual Quad24

For medium to large clusters (100s to 1000s nodes)

Machine TypeWorkload Pattern/ Cluster TypeStorageProcessor (# of Cores)Memory (GB)Network
SlavesBalanced workloadFour to six 1 TB disksDual Quad24Dual 1 GB links for all nodes in a 20 node rack and 2 x 10 GB intercon­nect links per rack going to a pair of central switches.
Compute intensive workloadFour to six 1 TB or 2 TB disksDual Hexa Quad24-48
I/O intensive workloadTwelve 1 TB disksDual Quad24-48
HBase clustersTwelve 1 TB disksDual Hexa Quad48-96
MastersAll workload patterns/HBase clustersFour to six 2 TB disksDual QuadDepends on number of file system objects to be created by NameNode.
Share this post
[social_warfare]
Vendor Comparison
Hadoop Installation

Get industry recognized certification – Contact us

keyboard_arrow_up