Run Belle2 jobs using UVIC-SE from a beaver VM

RandallSobie

Boot a VM on beaver

Belle2 prefers an SL6 VM
cernvm3-micro-3.0-6.hdd

# Add ssh keys, select private IP and then add floating IP
# Need to log into a machine in the physics department (e.g. fate) that has my ssh keys
alias vm_ssh='ssh -A -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -l root '
vm_ssh  206.12.154.XX

# add user certificate files to .globus directory

# may need to install wget
yum install wget

Set up gbasf2 on the VM

mkdir gbasf2KEK && cd gbasf2KEK
wget -N http://dirac.cc.kek.jp/dirac/dirac-install.py
python dirac-install.py -V Belle-KEK
source bashrc
dirac-proxy-init -x
dirac-configure defaults-Belle-KEK.cfg

source /root/gbasf2KEK/BelleDIRAC/gbasf2/tools/setup
gb2_proxy_init -g belle
gb2_check_release
gb2_ds_list /belle/user/rsobie/

# replicate file set to UVIC (better to have job write to UVIC-SE)
gb2_ds_rep -d UVic-TMP-SE /belle/user/rsobie/prod00012385

Set up vomes belle2 proxy

cat /etc/vomses/belle
"belle" "voms.cc.kek.jp" "15020" "/C=JP/O=KEK/OU=CRC/CN=host/voms.cc.kek.jp" "belle" "24"

cat /etc/grid-security/vomsdir/belle/voms.cc.kek.jp.lsc
/C=JP/O=KEK/OU=CRC/CN=host/voms.cc.kek.jp
/C=JP/O=KEK/OU=CRC/CN=KEK GRID Certificate Authority

# create voms proxy (copy usercert.pem and user key files to .globus directory with 644 and 400 permissions)
voms-proxy-init --voms belle --cert $HOME/.globus/usercert.pem --key $HOME/.globus/userkey.pem

Logging into an existing VM

source /root/gbasf2KEK/BelleDIRAC/gbasf2/tools/setup
voms-proxy-init --voms belle --cert $HOME/.globus/usercert.pem --key $HOME/.globus/userkey.pem
/usr/bin/gfal-copy  -r srm://charon01.westgrid.ca:8443/srm/managerv2?SFN=/pnfs/westgrid.uvic.ca/data/belle/belledisk/TMP/belle/user/rsobie/prod00009635/ .

Set up root using ATLAS set up

export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase
alias setupATLAS='source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh'
setupATLAS

lsetup "root 6.14.04-x86_64-slc6-gcc62-opt"

root -b (only works in batch mode)
    Welcome to ROOT 6.14/04                http://root.cern.ch 

Need to create "root files" directory for output
root -b 
.x testload.C
ee.Process(    "tt.C+", "20");

Set up gfal commands in the new CERN VM (cernvm3-micro-2020.04-1.hdd). After the "setupATLAS" command in the previous section.

lsetup rucio

Set up emacs on the VM

dd to your init file (~/.emacs):
(global-font-lock-mode 0)