Tags:
create new tag
view all tags
RandallSobie

Submitting Belle2 analysis jobs on the grid using gbasf2 from KEK

Running grid jobs (3.0.0)

Initialization of Belle2 environment at KEK

source /sw/belle2/gbasf2/BelleDIRAC/gbasf2/tools/setup
gb2_proxy_init g belle

Change to gbasf2 working directory (matching basf2 directory is release-03-00-00):

cd gbasf2-03-00-00

Check for (hard) link to shared libraries, if not create them (soft links will not work):

ln /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.b2modmap librelease-03-00-00.b2modmap
ln /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.so librelease-03-00-00.so

Confirm existing links point to the latest file:

ls -i /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.b2modmap
91970119 /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.b2modmap

ls -i librelease-03-00-00.b2modmap
91970119 librelease-03-00-00.b2modmap

ls -i /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.so
91970115 /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.so

ls -i librelease-03-00-00.so
91970115 librelease-03-00-00.so

Check that python submission scripts have correct (basf2 to gbasf2) changes: Add library path and ntuple name to python script

# configure the tau module
#mytau = b2.register_module('tausteer')
mytau = b2.register_module('tausteer', shared_lib_path='./librelease-03-00-00.so')

# ntuple output name
#mytau.param('ntupleName','/group/belle2/users/rsobie/taupair.root')
mytau.param('ntupleName','taupair-jan2019.root')

Submit a tau pair MC analysis job.

The jobs are submitted to any site with the data. Add (--site DIRAC.UVic-local.ca) or (--site DIRAC.UVic.ca) to specify local UVIC system.

The output is written to the SE of the site. Note that the tau pair MC is currently located at KEK and UVIC SE's.

With one file

gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap \ 
-i /belle/MC/release-01-00-03/DB00000294/MC10/prod00004783/s00/e1002/4S/r00000/taupair/mdst/sub00/mdst_000001_prod00004783_task10010000001.root

With 5 MC files (data files are located in the "files" directory)

gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap \ 
--input_dslist  files/files_taupair_5.data

Using all the tau pair MC files (62 files)

gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap \ 
--input_dslist  files/files_taupair_all.data 

Submit a qqbar MC analysis job.

The python script should work for all qqbar MC samples. The qqbar MC is at KEK and BNL. There are files with 5/all input data files. (Limited to 2 files per job as a job cannot have more than 5GB of input data)

gbasf2 runQQ.py -p uubar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap \
--basf2opt="uu-jan2019.root" -n 2 --input_dslist files/files_uu_5.data

Process full samples

gbasf2 runQQ.py -p uubar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="uu-jan2019.root" -n 2 --input_dslist files/files_uu_all.data
gbasf2 runQQ.py -p ddbar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="dd-jan2019.root" -n 2 --input_dslist files/files_dd_all.data
gbasf2 runQQ.py -p ssbar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="ss-jan2019.root" -n 2 --input_dslist files/files_ss_all.data
gbasf2 runQQ.py -p ccbar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="cc-jan2019.root" -n 2 --input_dslist files/files_cc_all.data
gbasf2 runQQ.py -p bbm   -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="bbm-jan2019.root" -n 2 --input_dslist files/files_bbm_all.data
gbasf2 runQQ.py -p bbc   -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="bbc-jan2019.root" -n 2 --input_dslist files/files_bbm_all.data

General commands

# job status
gb2_job_status -p jan2019

# retrieve output of project (will not retrieve previously retrieved jobs)
gb2_job_output -p jan2019

# list job output (ntuples) (can use long option "-l")
gb2_ds_list  /belle/user/rsobie/jan2019

# get ntuples (stores output in /gpfs/home/belle2/rsobie/gbasf2KEK/jan2019)
gb2_ds_get  /belle/user/rsobie/jan2019

Installing gbasf2 at KEK (only needed once).

Following https://confluence.desy.de/display/BI/Computing+GBasf2
mkdir gbasf2KEK 
cd gbasf2KEK
wget -N http://belle2.kek.jp/~dirac/dirac-install.py
python dirac-install.py -V Belle-KEK
source bashrc
dirac-proxy-init -x 
dirac-configure defaults-Belle-KEK.cfg
Edit | Attach | Watch | Print version | History: r4 < r3 < r2 < r1 | Backlinks | Raw View | More topic actions
Topic revision: r4 - 2019-01-31 - rsobie
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback