Defcon Kaklkaklkekl (Wiki)

====== Testing disk I/O on HP DL320-series boxes ====== Common for all tests: Debian Lenny.4, EXT3 file-system, default setup. ===== HP DL320s G1 ===== **SMART P400, RAID5, 64k stripe, Array accelerator on, DWC off, med/med priority, 25/75 acc pri, building** <code> Smart Array P400 in Slot 2 Firmware Version: 4.06 Rebuild Priority: Medium Expand Priority: Medium Accelerator Ratio: 25% Read / 75% Write Drive Write Cache: Disabled Total Cache Size: 512 MB logicaldrive 1 (2.5 TB, RAID 5, OK) Stripe Size: 64 KB Status: OK Array Accelerator: Enabled Parity Initialization Status: In Progress </code> <code> box1:~# cat bonnie_box1 Version 1.03d ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP box1 7G 56994 99 70378 25 31370 9 63906 96 214870 34 625.1 1 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ box1,7G,56994,99,70378,25,31370,9,63906,96,214870,34,625.1,1,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ </code> SMART P400, RAID5, 64k stripe, Array accelerator on, **DWC on**, med/med priority, **50/50 acc pri**, building <code> Accelerator Ratio: 50% Read / 50% Write Drive Write Cache: Enabled </code> <code> box2:~# cat bonnie_box2 Version 1.03d ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP box2 7G 56867 99 161523 55 51480 16 64391 97 220993 35 627.8 1 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ box2,7G,56867,99,161523,55,51480,16,64391,97,220993,35,627.8,1,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ </code> SMART P400, RAID5, 64k stripe, Array accelerator on, DWC on, med/med priority, 50/50 acc pri, **complete** <code> Parity Initialization Status: Initialization Completed </code> <code> box2:~# cat bonnie_box2 Version 1.03d ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP box2 7G 57185 99 175482 56 58611 18 65126 97 219533 35 606.4 0 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ box2,7G,57185,99,175482,56,58611,18,65126,97,219533,35,606.4,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ </code> SMART P400, RAID5, 64k stripe, Array accelerator on, **DWC off**, med/med priority, 50/50 acc pri, complete <code> Drive Write Cache: Disabled </code> <code> box2:~# cat bonnie_box2 Version 1.03d ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP box2 7G 52916 97 71789 26 33657 10 61096 96 214516 35 625.1 0 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ box2,7G,52916,97,71789,26,33657,10,61096,96,214516,35,625.1,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ </code> SMART P400, RAID5, 64k stripe, Array accelerator on, DWC off, med/med priority, **25/75 acc pri**, complete <code> Accelerator Ratio: 25% Read / 75% Write Drive Write Cache: Disabled Parity Initialization Status: Initialization Completed </code> <code> box1:~# cat bonnie_box1 Version 1.03d ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP box1 7G 56868 98 72069 26 32848 9 64018 96 217405 36 630.9 1 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ box1,7G,56868,98,72069,26,32848,9,64018,96,217405,36,630.9,1,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ </code> SMART P400, RAID5, 64k stripe, Array accelerator on, **DWC on**, med/med priority, 25/75 acc pri, complete <code> Drive Write Cache: Enabled </code> <code> box1:~# cat bonnie_box1 Version 1.03d ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP box1 7G 55637 96 176395 57 60997 19 64759 97 219313 35 612.9 0 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ box1,7G,55637,96,176395,57,60997,19,64759,97,219313,35,612.9,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ </code> Suggested conclusion: accelerator priority is of little relevance, DWC improves block writes significantly, but has little-to-no other effect. ===== HP DL320 G5 ===== First test: RAID1 with Drive Write Cache **enabled**. <code> Smart Array E200 in Slot 2 Firmware Version: 1.66 Rebuild Priority: Medium Expand Priority: Medium Accelerator Ratio: 100% Read / 0% Write Drive Write Cache: Enabled logicaldrive 1 (232.9 GB, RAID 1+0, OK) Stripe Size: 128 KB Array Accelerator: Enabled </code> <code> box4:~# cat bonnie_box4 Version 1.03d ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP box4 7G 11171 23 11281 3 9384 2 51479 79 55065 8 373.9 0 en ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ 21155 24 box4,7G,11171,23,11281,3,9384,2,51479,79,55065,8,373.9,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,21155,24 </code> Second test: RAID1 with Drive Write Cache **disabled**. <code> Smart Array E200 in Slot 2 Hardware Revision: Rev A Firmware Version: 1.66 Rebuild Priority: Medium Expand Priority: Medium Accelerator Ratio: 100% Read / 0% Write Drive Write Cache: Disabled logicaldrive 1 (232.9 GB, RAID 1+0, OK) Stripe Size: 128 KB Array Accelerator: Enabled </code> <code> box3:~# cat bonnie_box3 Version 1.03d ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP box3 7G 11001 23 11116 3 9096 2 51365 79 53534 8 368.5 0 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ box3,7G,11001,23,11116,3,9096,2,51365,79,53534,8,368.5,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ </code> On the P200, no apparent performance gain with DWC on. Accelerator ratio is fixed on this controller. Stripe size may have an effect, will not be tested now... ===== HP DL585 ===== <code> Smart Array 5i in Slot 0 Rebuild Priority: Low Expand Priority: Low Accelerator Ratio: 50% Read / 50% Write Total Cache Size: 48 MB logicaldrive 1 (67.8 GB, RAID 1+0, OK) Stripe Size: 128 KB Array Accelerator: Enabled </code> <code> box6:~# cat bonnie_box6 Version 1.03d ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP box6 8G 33252 99 39801 20 19400 7 40641 96 61625 12 823.0 2 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ box6,8G,33252,99,39801,20,19400,7,40641,96,61625,12,823.0,2,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ </code>