Difference: SuperComputing2012 (2 vs. 3)

Revision 32012-10-29 - igable

Line: 1 to 1
 

SuperComputing 2012

Added:
>
>

Memory to Memory

No problems with memoty to memory: 37.806 Gb/s

[root@sc02 ~]# fdtClient -P 7 -c 192.168.100.4  /dev/zero -d /dev/null
Oct 28, 2012 11:49:59 PM lia.util.net.common.Config <init>
INFO: Using lia.util.net.copy.PosixFSFileChannelProviderFactory as FileChannelProviderFactory
Oct 28, 2012 11:49:59 PM lia.util.net.common.Config <init>
INFO: FDT started in client mode
FDT uses *blocking* I/O mode.
INFO: Requested window size -1. Using window size: 49360
28/10 23:50:09   Net Out: 38.130 Gb/s   Avg: 38.130 Gb/s
28/10 23:50:14   Net Out: 38.128 Gb/s   Avg: 38.129 Gb/s
28/10 23:50:19   Net Out: 36.775 Gb/s   Avg: 37.678 Gb/s
28/10 23:50:24   Net Out: 38.197 Gb/s   Avg: 37.806 Gb/s
 

Disk to Disk within a machine

MegaCli -CfgLdAdd -r0 [252:1] WT NORA DIRECT -strpsz 1024 -a0
Line: 8 to 28
 [Sun Oct 28 20:56:57 PDT 2012] Current Speed = 441.648 MB/s Avg Speed: 436.479 MB/s Total Transfer: 4.277 GB
Changed:
<
<

Network transfer with 7 seperate Virtual disks

>
>

Network transfer with 7 virtual disks and 1 fdtServers, 7 parallel streams

Grand total with 7 disks, 1 FDT Server: 10.533 Gb/s

[root@sc02 ssd6]# fdtClient -P 7 -c 192.168.100.4 -fl /ssd6/filelist.txt -d /
Avg: 10.533 Gb/s 100.00% ( 00s )
FDTReaderSession ( 13f62162-4fb5-41c5-b4fb-db9af9c453f3 ) final stats:
 Started: Sun Oct 28 23:33:07 PDT 2012
 Ended:   Sun Oct 28 23:42:42 PDT 2012
 Transfer period:   09m 34s
 TotalBytes: 751619276800
 TotalNetworkBytes: 751619276800
 Exit Status: OK

Network transfer with 7 virtual disks and 7 fdtServers

The test was set up with 1 virtual disk per physical disk and 1 FDT server for every disk.

Grand total with 7 disks, 7 FDT Servers: 22.196 Gb/s

fdtClient -c 192.168.100.4 -p 54321 -d /ssd1/  /ssd1/100Gfile_x.dat > /root/fdt1.log &
fdtClient -c 192.168.100.4 -p 54322 -d /ssd2/  /ssd2/100Gfile_x.dat > /root/fdt2.log &
fdtClient -c 192.168.100.4 -p 54323 -d /ssd3/  /ssd3/100Gfile_x.dat > /root/fdt3.log &
fdtClient -c 192.168.100.4 -p 54324 -d /ssd4/  /ssd4/100Gfile_x.dat > /root/fdt4.log &
fdtClient -c 192.168.100.4 -p 54325 -d /ssd5/  /ssd5/100Gfile_x.dat > /root/fdt5.log &
fdtClient -c 192.168.100.4 -p 54326 -d /ssd6/  /ssd6/100Gfile_x.dat > /root/fdt6.log &
fdtClient -c 192.168.100.4 -p 54327 -d /ssd7/  /ssd7/100Gfile_x.dat > /root/fdt7.log &
 
Changed:
<
<
fdtClient -P 7 -c 192.168.100.4 -fl /ssd7/filelist.txt -d / <28/10 21:44:58 Net In: 12.912 Gb/s Avg: 12.912 Gb/s 28/10 21:45:03 Net In: 12.062 Gb/s Avg: 12.487 Gb/s 28/10 21:45:08 Net In: 11.944 Gb/s Avg: 12.305 Gb/s 28/10 21:45:13 Net In: 11.654 Gb/s Avg: 12.142 Gb/s 42.00% ( 28s ) 28/10 21:45:18 Net In: 9.740 Gb/s Avg: 11.661 Gb/s 50.10% ( 25s ) 28/10 21:45:23 Net In: 9.751 Gb/s Avg: 11.343 Gb/s 58.21% ( 22s ) 28/10 21:45:28 Net In: 9.956 Gb/s Avg: 11.145 Gb/s 66.49% ( 18s ) 28/10 21:45:33 Net In: 9.199 Gb/s Avg: 10.901 Gb/s 74.13% ( 14s ) 28/10 21:45:38 Net In: 9.302 Gb/s Avg: 10.724 Gb/s 81.87% ( 10s ) 28/10 21:45:43 Net In: 6.399 Gb/s Avg: 10.291 Gb/s 87.19% ( 07s ) 28/10 21:45:48 Net In: 7.503 Gb/s Avg: 10.038 Gb/s 93.43% ( 03s ) 28/10 21:45:53 Net In: 6.156 Gb/s Avg: 9.714 Gb/s 98.55% ( 00s ) Oct 28, 2012 9:45:56 PM lia.util.net.copy.FDTWriterSession handleEndFDTSession INFO: [ FDTWriterSession ] Remote FDTReaderSession for session [ 496370fc-e428-4985-a588-8856e8c03774 ] finished ok. Waiting for our side to finish. 28/10 21:45:58 Net In: 1.746 Gb/s Avg: 9.101 Gb/s 100.00% ( 00s )
>
>
Avg: 3.067 Gb/s 100.00% ( 00s ) FDTWriterSession ( 9920c20c-6378-4ef1-b14b-8393b5c1eafb ) final stats: Started: Sun Oct 28 22:57:04 PDT 2012 Ended: Sun Oct 28 23:01:48 PDT 2012 Transfer period: 04m 43s TotalBytes: 107374182400 TotalNetworkBytes: 107374182400 Exit Status: OK

Avg: 2.962 Gb/s 100.00% ( 00s ) FDTWriterSession ( 2cc841b1-0ce5-4f09-b773-794e59d0d35e ) final stats: Started: Sun Oct 28 22:57:04 PDT 2012 Ended: Sun Oct 28 23:01:58 PDT 2012 Transfer period: 04m 53s TotalBytes: 107374182400 TotalNetworkBytes: 107374182400 Exit Status: OK

Avg: 3.159 Gb/s 100.00% ( 00s ) FDTWriterSession ( 183111ea-8c54-4247-870f-e1f7eb8440b7 ) final stats: Started: Sun Oct 28 22:57:04 PDT 2012 Ended: Sun Oct 28 23:01:42 PDT 2012 Transfer period: 04m 37s TotalBytes: 107374182400 TotalNetworkBytes: 107374182400 Exit Status: OK

Avg: 3.232 Gb/s 100.00% ( 00s ) FDTWriterSession ( 9bf985f6-9260-466d-b775-99f4df5931a6 ) final stats: Started: Sun Oct 28 22:57:04 PDT 2012 Ended: Sun Oct 28 23:01:33 PDT 2012 Transfer period: 04m 28s TotalBytes: 107374182400 TotalNetworkBytes: 107374182400 Exit Status: OK

Avg: 3.297 Gb/s 100.00% ( 00s ) FDTWriterSession ( 45f42c87-44c8-4db8-8d29-fcc2b33a12a1 ) final stats: Started: Sun Oct 28 22:57:04 PDT 2012 Ended: Sun Oct 28 23:01:31 PDT 2012 Transfer period: 04m 26s TotalBytes: 107374182400 TotalNetworkBytes: 107374182400 Exit Status: OK

Avg: 3.238 Gb/s 100.00% ( 00s ) FDTWriterSession ( 5dedbe6a-949b-47ec-9d8a-2e9c0b32e5f3 ) final stats: Started: Sun Oct 28 22:57:04 PDT 2012 Ended: Sun Oct 28 23:01:36 PDT 2012 Transfer period: 04m 31s TotalBytes: 107374182400 TotalNetworkBytes: 107374182400 Exit Status: OK

Avg: 3.241 Gb/s 100.00% ( 00s ) FDTWriterSession ( 90247407-4dfd-417b-8022-bc3925e0f078 ) final stats: Started: Sun Oct 28 22:57:04 PDT 2012 Ended: Sun Oct 28 23:01:35 PDT 2012 Transfer period: 04m 30s TotalBytes: 107374182400 TotalNetworkBytes: 107374182400 Exit Status: OK

 
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback