Difference: HundredGigabitTestingLog (5 vs. 6)

Revision 62011-11-08 - igable

Line: 1 to 1
 
META TOPICPARENT name="HundredGigabit"

November 7, 2011

Changed:
<
<
All nodes are now configured with the Write Through on the SSD logical disk.
>
>
All nodes are now configured with the Write Through on the SSD logical disk. SNMP polling to the Brocade now done in 1 min intervals.

cacti_notes_5x5_2011-011-07.png

Figure 3: We are now seeing above 9 Gbps disk to disk on all boxes. The write on scdemo03 is the slowest in the cluster by about 1 Gb/s, it's not immediately obvious what the problem is.

  Completed a 5 to 5 test Disk test:
Deleted:
<
<
Transfer Rate Reverse Rate
scdemo00->scdemo05 Avg: 9.174 Gb/s Avg: 9.435 Gb/s
scdemo01->scdemo06 Avg: 9.172 Gb/s Avg: 9.175 Gb/s
scdemo02->scdemo07 Avg: 9.121 Gb/s Avg: 9.173 Gb/s
scdemo03->scdemo08 Avg: 9.225 Gb/s Avg: 8.087 Gb/s
scdemo04->scdemo09 Avg: 9.382 Gb/s Avg: 9.170 Gb/s
 
Added:
>
>
  CFQ Scheduler   NOOP Sceduler  
Transfer Rate Reverse Rate Rate Reverse Rate
scdemo00->scdemo05 Avg: 9.174 Gb/s Avg: 9.435 Gb/s Avg: 9.544 Gb/s Avg: 9.489 Gb/s
scdemo01->scdemo06 Avg: 9.172 Gb/s Avg: 9.175 Gb/s Avg: 9.490 Gb/s Avg: 9.492 Gb/s
scdemo02->scdemo07 Avg: 9.121 Gb/s Avg: 9.173 Gb/s Avg: 9.490 Gb/s Avg: 9.549 Gb/s
scdemo03->scdemo08 Avg: 9.225 Gb/s Avg: 8.087 Gb/s Avg: 9.382 Gb/s Avg: 8.332 Gb/s
scdemo04->scdemo09 Avg: 9.382 Gb/s Avg: 9.170 Gb/s Avg: 9.545 Gb/s Avg: 9.545 Gb/s

Table 1: Switching to the noop scheduler has added about another 5 percent improvement in performance.

Switching to no noop:

echo noop > /sys/block/sdb/queue/scheduler

cacti_notes__noop_2011-11-07.png

 
Added:
>
>
Figure 4: Shows improvement when moving from CFQ to NoOp Kernel disk scheduler.
 

November 6, 2011

Line: 124 to 142
  Figure 2: After changing the raid configuration to be write through and using large 10G files created with 'dd' we see a much improved disk to disk throughput (as shown in the two FDT outputs immediately above). Strangely we see that one direction is nearly 0.8 Gbps faster then the other. I don't understand the reason for this yet.
Changed:
<
<
  • Shows some asymetric throughput from one node:
    cacti_notes_5x5_2011-011-07.png
>
>
 
META FILEATTACHMENT attachment="cacti_notes_2011-011-06.png" attr="" comment="" date="1320622186" name="cacti_notes_2011-011-06.png" path="cacti_notes_2011-011-06.png" size="80579" user="igable" version="1"
META FILEATTACHMENT attachment="cacti_notes_good_rate_2011-11-06.png" attr="" comment="" date="1320640987" name="cacti_notes_good_rate_2011-11-06.png" path="cacti_notes_good_rate_2011-11-06.png" size="69346" user="igable" version="2"
META FILEATTACHMENT attachment="cacti_notes_5x5_2011-011-07.png" attr="" comment="Shows some asymetric throughput from one node" date="1320713240" name="cacti_notes_5x5_2011-011-07.png" path="cacti_notes_5x5_2011-011-07.png" size="126763" user="igable" version="1"
Added:
>
>
META FILEATTACHMENT attachment="cacti_notes__noop_2011-11-07.png" attr="" comment="" date="1320725234" name="cacti_notes__noop_2011-11-07.png" path="cacti_notes__noop_2011-11-07.png" size="88878" user="igable" version="1"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback