Ms3

The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

This page contains historical information. It may be outdated or unreliable.

Linux setup with 14 RAID-1 volumes of 3 disks each (spread over controllers), striped together in an LVM volume group.

Disk setup

# The first disks of the first and second controller,
# /dev/sda and /dev/sdi respectively, are used as host OS drives.
# The first disks of the remaining controllers will be used as spares.
#
# (md7)   |  h |  p |  x || af | an | av |  (md15)
# (md6)   |  g |  o |  w || ae | am | au |  (md14)
# (md5)   |  f |  n |  v || ad | al | at |  (md13)
# (md4)   |  e |  m |  u || ac | ak | as |  (md12)
# (md3)   |  d |  l |  t || ab | aj | ar |  (md11)
# (md2)   |  c |  k |  s || aa | ai | aq |  (md10)
# (md1)   |  b |  j |  r ||  z | ah | ap |  (md9) 
# (md0)   |  a |  i || q  |  y | ag | ao |  (spares, md8 missing)
#
#           c0   c1   c2    c3   c4   c5

Output of /home/mark/thumper-es-raid-lvs-setup.py:

mdadm --create --level 1 --raid-devices 3 /dev/md1 /dev/sdb /dev/sdj /dev/sdr
mdadm --create --level 1 --raid-devices 3 /dev/md9 /dev/sdz /dev/sdah /dev/sdap
mdadm --create --level 1 --raid-devices 3 /dev/md2 /dev/sdc /dev/sdk /dev/sds
mdadm --create --level 1 --raid-devices 3 /dev/md10 /dev/sdaa /dev/sdai /dev/sdaq
mdadm --create --level 1 --raid-devices 3 /dev/md3 /dev/sdd /dev/sdl /dev/sdt
mdadm --create --level 1 --raid-devices 3 /dev/md11 /dev/sdab /dev/sdaj /dev/sdar
mdadm --create --level 1 --raid-devices 3 /dev/md4 /dev/sde /dev/sdm /dev/sdu
mdadm --create --level 1 --raid-devices 3 /dev/md12 /dev/sdac /dev/sdak /dev/sdas
mdadm --create --level 1 --raid-devices 3 /dev/md5 /dev/sdf /dev/sdn /dev/sdv
mdadm --create --level 1 --raid-devices 3 /dev/md13 /dev/sdad /dev/sdal /dev/sdat
mdadm --create --level 1 --raid-devices 3 /dev/md6 /dev/sdg /dev/sdo /dev/sdw
mdadm --create --level 1 --raid-devices 3 /dev/md14 /dev/sdae /dev/sdam /dev/sdau
mdadm --create --level 1 --raid-devices 3 /dev/md7 /dev/sdh /dev/sdp /dev/sdx
mdadm --create --level 1 --raid-devices 3 /dev/md15 /dev/sdaf /dev/sdan /dev/sdav
spares:
mdadm --add /dev/md1 /dev/sdq /dev/sdy /dev/sdag /dev/sdao
pvcreate:
pvcreate /dev/md1
pvcreate /dev/md2
pvcreate /dev/md3
pvcreate /dev/md4
pvcreate /dev/md5
pvcreate /dev/md6
pvcreate /dev/md7
pvcreate /dev/md9
pvcreate /dev/md10
pvcreate /dev/md11
pvcreate /dev/md12
pvcreate /dev/md13
pvcreate /dev/md14
pvcreate /dev/md15
vgcreate:
vgcreate data /dev/md1 /dev/md2 /dev/md3 /dev/md4 /dev/md5 /dev/md6 /dev/md7 /dev/md9 /dev/md10 /dev/md11 /dev/md12 /dev/md13 /dev/md14 /dev/md15
lvcreate:
lvcreate -i 14 -I 64 -n ES data

bonnie++

Version 1.03b       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
ms3          64608M           414517  45 147501  24           364129  33 539.1   1
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  2085   2 +++++ +++  9414  18  7345  33 +++++ +++  5624  19
ms3,64608M,,,414517,45,147501,24,,,364129,33,539.1,1,16,2085,2,+++++,+++,9414,18,7345,33,+++++,+++,5624,19