Difference: WiP1 (24 vs. 25)

Revision 252011-07-18 - crlb

Line: 1 to 1
 
META TOPICPARENT name="ColinLeavettBrown"
-- ColinLeavettBrown - 2010-07-20

NEP-52 Lustre file system notes:

Line: 95 to 95
 
    • Lustre: 6455:0:(socklnd_cb.c:421:ksocknal_txlist_done()) Deleting packet type 1 len 368 206.12.154.1@tcp->10.200.201.4@tcp
    • Lustre: 6460:0:(socklnd_cb.c:915:ksocknal_launch_packet()) No usable routes to 12345-10.200.201.3@tcp
Changed:
<
<
To change the network (in this example we will change from bond0 (10.200.201.0/24) to eth3 (206.12.154.0/26), the following procedure should be adopted:
>
>
To change the network (in this example we will change from eth3 (206.12.154.0/26) to bond0 (10.200.201.0/24), the following procedure should be adopted:
 
  • Stop the file system (see Step 3).
Changed:
<
<
  • On e1 through e6: Update the /etc/modprob.d/lustre-lnet.conf on e1 through e5, eg. options lnet networks=tcp(eth3)
  • On e1 through e6: Request log file regeneration via the command "tunefs.lustre --writeconf /dev/vg00/lv00".
  • On e1 through e6: Update MDT/OST filesystem parameters via the command "tunefs.lustre --erase-params --mgsnode=206.12.154.1@tcp /dev/vg00/lv00"
  • On e1 through e6: Update iptables to reflect the new network configuration.
  • On e1 through e3: Unload the lnet module thereby purging the active module parameters. Issuing the "rmmod lnet" command generally results in "module in use by ....". The "rmmod" command can be issued repetitively for each of the identified modules until the "lnet" module is successfully unloaded. Alternatively, each node can be rebooted.
>
>
  • On e1 through e7: Update the /etc/modprob.d/lustre-lnet.conf, eg. options lnet networks=tcp(bond0)
  • On e1:
    • Request log file regeneration for the MDT with the command "tunefs.lustre --writeconf /dev/vg00/MDT0000".
    • Update filesystem parameters for the MDT with the command "tunefs.lustre --erase-params --mgsnode=10.200.201.1@tcp /dev/vg00/MDT0000"
  • On e2 through e7:
    • Request log file regeneration for each OST with the command "/usr/local/sbin/OSTsWriteconf".
    • Update the filesystem parameters for each OST with the command "/usr/local/sbin/OSTsMsgnode 10.200.201.1"
  • On e1 through e7: Update iptables to reflect the new network configuration.
  • On e1 through e7: Unload the lnet module thereby purging the active module parameters. Issuing the "rmmod lnet" command generally results in "module in use by ....". The "rmmod" command can be issued repetitively for each of the identified modules until the "lnet" module is successfully unloaded. Alternatively, each node can be rebooted.
 
  • Restart/remount the file system (see Step 3).

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback