Difference: SuperComputing2012 (9 vs. 10)

Revision 102012-11-05 - igable

Line: 1 to 1
 

SuperComputing 2012

Line: 341 to 341
 tcp 14390168 0 ::ffff:10.20.3.101:54321 ::ffff:10.20.3.104:58235 ESTABLISHED 5898/java %ENDCONSOLE%
Changed:
<
<

Testing with drive subsets ( Nov 4)

>
>

Kernel 3.2 testing ,and independent raid testing (Nov 3-4).

 
Changed:
<
<
Testing the first 7 drives we still finish with things in the sent-q (4 streams).
>
>
Testing the first 7 drives we still finish with things in the send-q (4 streams).
 %STARTCONSOLE% tcp 0 0 ::ffff:10.20.3.104:35078 ::ffff:10.20.3.101:54321 ESTABLISHED 3663/java tcp 0 11200000 ::ffff:10.20.3.104:35081 ::ffff:10.20.3.101:54321 ESTABLISHED 3663/java tcp 0 13251840 ::ffff:10.20.3.104:35080 ::ffff:10.20.3.101:54321 ESTABLISHED 3663/java %ENDCONSOLE%
Added:
>
>
2 streams looks to work reliably.
 
Added:
>
>
Testing with 3.2.32 kernel from shawn we see some interesting behavior with mem to mem right after the start then it stabalizes at ~38:

%STARTCONSOLE% 04/11 20:04:53 Net In: 39.153 Gb/s Avg: 39.153 Gb/s 04/11 20:04:58 Net In: 38.660 Gb/s Avg: 38.906 Gb/s 04/11 20:05:03 Net In: 38.836 Gb/s Avg: 38.883 Gb/s 04/11 20:05:08 Net In: 34.049 Gb/s Avg: 37.673 Gb/s 04/11 20:05:13 Net In: 39.013 Gb/s Avg: 37.939 Gb/s 04/11 20:05:18 Net In: 25.254 Gb/s Avg: 35.824 Gb/s 04/11 20:05:23 Net In: 13.737 Gb/s Avg: 32.669 Gb/s 04/11 20:05:28 Net In: 30.079 Gb/s Avg: 32.345 Gb/s 04/11 20:05:33 Net In: 34.175 Gb/s Avg: 32.547 Gb/s 04/11 20:05:38 Net In: 38.890 Gb/s Avg: 33.181 Gb/s 04/11 20:05:43 Net In: 23.152 Gb/s Avg: 32.269 Gb/s 04/11 20:05:48 Net In: 35.668 Gb/s Avg: 32.552 Gb/s %ENDCONSOLE%

Disk to disk with 7 disks we see pretty wild fluctuations in the throughput, but no sockets get stuck (with 4 streams):

%STARTCONSOLE% 04/11 20:21:44 Net In: 0.000 b/s Avg: 12.011 Gb/s 100.00% ( 00s )

FDTWriterSession ( bdb2c737-6d7d-41cf-bd3d-3b1ceed254ea ) final stats: Started: Sun Nov 04 20:13:23 PST 2012 Ended: Sun Nov 04 20:21:46 PST 2012 Transfer period: 08m 22s TotalBytes: 750906707600 TotalNetworkBytes: 750906707600 Exit Status: OK %ENDCONSOLE%

Repeat the above with 10 streams much better (using 7 disks same raid controller, still some fluctuations):

Complete log at: https://gist.github.com/0bc3087b37ea26cff999 %STARTCONSOLE% 04/11 21:11:12 Net Out: 3.376 Gb/s Avg: 19.598 Gb/s 100.00% ( 00s )

FDTReaderSession ( 26051cb0-ebe3-4000-86ef-2bb23c9e62f2 ) final stats: Started: Sun Nov 04 21:05:22 PST 2012 Ended: Sun Nov 04 21:11:17 PST 2012 Transfer period: 05m 54s TotalBytes: 858179094400 TotalNetworkBytes: 858179094400 Exit Status: OK %ENDCONSOLE%

Very nice Stable reads with the 3.2.32 kernel: %STARTCONSOLE% 04/11 22:05:03 Net Out: 1.515 Gb/s Avg: 35.881 Gb/s 100.00% ( 00s )

FDTReaderSession ( f5ca4066-2fa0-4a8a-9ab7-374c1aaaeed3 ) final stats: Started: Sun Nov 04 22:00:37 PST 2012 Ended: Sun Nov 04 22:05:03 PST 2012 Transfer period: 04m 25s TotalBytes: 1179996254800 TotalNetworkBytes: 1179996254800 Exit Status: OK %ENDCONSOLE%

 
META FILEATTACHMENT attachment="transfer-notes-2012-11-01.png" attr="" comment="" date="1351841497" name="transfer-notes-2012-11-01.png" path="transfer-notes-2012-11-01.png" size="128899" user="igable" version="1"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback