Difference: RunGridJob (1 vs. 4)

Revision 42019-01-31 - rsobie

Line: 1 to 1
 
META TOPICPARENT name="RandallSobie"
RandallSobie
Line: 77 to 77
 --input_dslist files/files_taupair_all.data
Added:
>
>

Submit a qqbar MC analysis job.

The python script should work for all qqbar MC samples. The qqbar MC is at KEK and BNL. There are files with 5/all input data files. (Limited to 2 files per job as a job cannot have more than 5GB of input data)

gbasf2 runQQ.py -p uubar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap \
--basf2opt="uu-jan2019.root" -n 2 --input_dslist files/files_uu_5.data

Process full samples

gbasf2 runQQ.py -p uubar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="uu-jan2019.root" -n 2 --input_dslist files/files_uu_all.data
gbasf2 runQQ.py -p ddbar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="dd-jan2019.root" -n 2 --input_dslist files/files_dd_all.data
gbasf2 runQQ.py -p ssbar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="ss-jan2019.root" -n 2 --input_dslist files/files_ss_all.data
gbasf2 runQQ.py -p ccbar -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="cc-jan2019.root" -n 2 --input_dslist files/files_cc_all.data
gbasf2 runQQ.py -p bbm   -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="bbm-jan2019.root" -n 2 --input_dslist files/files_bbm_all.data
gbasf2 runQQ.py -p bbc   -s release-03-00-00   -f librelease-03-00-00.so librelease-03-00-00.b2modmap --basf2opt="bbc-jan2019.root" -n 2 --input_dslist files/files_bbm_all.data
 

General commands

# job status
Line: 91 to 109
 # get ntuples (stores output in /gpfs/home/belle2/rsobie/gbasf2KEK/jan2019) gb2_ds_get /belle/user/rsobie/jan2019
Added:
>
>

Installing gbasf2 at KEK (only needed once).

Following https://confluence.desy.de/display/BI/Computing+GBasf2
mkdir gbasf2KEK 
cd gbasf2KEK
wget -N http://belle2.kek.jp/~dirac/dirac-install.py
python dirac-install.py -V Belle-KEK
source bashrc
dirac-proxy-init -x 
dirac-configure defaults-Belle-KEK.cfg

Revision 32019-01-30 - rsobie

Line: 1 to 1
 
META TOPICPARENT name="RandallSobie"
RandallSobie
Line: 13 to 13
 gb2_proxy_init g belle
Changed:
<
<
Copy shared libraries to gbasf2 directory (should test using full path name)
>
>
Change to gbasf2 working directory (matching basf2 directory is release-03-00-00):
 
Changed:
<
<
cp /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/lib* . (librelease-03-00-00.so librelease-03-00-00.b2modmap)
>
>
cd gbasf2-03-00-00
 
Changed:
<
<
Add library path and ntuple name to python script
>
>
Check for (hard) link to shared libraries, if not create them (soft links will not work):
 
Added:
>
>
ln /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.b2modmap librelease-03-00-00.b2modmap ln /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.so librelease-03-00-00.so

Confirm existing links point to the latest file:

ls -i /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.b2modmap
91970119 /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.b2modmap

ls -i librelease-03-00-00.b2modmap
91970119 librelease-03-00-00.b2modmap

ls -i /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.so
91970115 /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.so

ls -i librelease-03-00-00.so
91970115 librelease-03-00-00.so

Check that python submission scripts have correct (basf2 to gbasf2) changes: Add library path and ntuple name to python script

 # configure the tau module #mytau = b2.register_module('tausteer') mytau = b2.register_module('tausteer', shared_lib_path='./librelease-03-00-00.so')
Line: 32 to 54
 

Submit a tau pair MC analysis job.

Changed:
<
<
The jobs are submitted to any site with the data. The output is written to the SE of the site. Note that the tau pair MC is currently located at KEK and UVIC SE's.
>
>
The jobs are submitted to any site with the data. Add (--site DIRAC.UVic-local.ca) or (--site DIRAC.UVic.ca) to specify local UVIC system.
 
Changed:
<
<
First, make a hard link to the librelease-03-00-00.so librelease-03-00-00.b2modmap files
>
>
The output is written to the SE of the site. Note that the tau pair MC is currently located at KEK and UVIC SE's.
 
Deleted:
<
<
ln /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.b2modmap librelease-03-00-00.b2modmap
ln /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.so librelease-03-00-00.so
  With one file
Line: 47 to 65
 -i /belle/MC/release-01-00-03/DB00000294/MC10/prod00004783/s00/e1002/4S/r00000/taupair/mdst/sub00/mdst_000001_prod00004783_task10010000001.root
Changed:
<
<
With the MC files (5 files)
>
>
With 5 MC files (data files are located in the "files" directory)
 
gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap \ 
Changed:
<
<
--input_dslist files_taupair_5.data
>
>
--input_dslist files/files_taupair_5.data
 

Using all the tau pair MC files (62 files)

gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap \ 
Changed:
<
<
--input_dslist files_taupair_all.data
>
>
--input_dslist files/files_taupair_all.data
 

General commands

Revision 22019-01-29 - rsobie

Line: 1 to 1
 
META TOPICPARENT name="RandallSobie"
RandallSobie

Submitting Belle2 analysis jobs on the grid using gbasf2 from KEK

Changed:
<
<

Running grid jobs (3.0.0)

>
>

Running grid jobs (3.0.0)

  Initialization of Belle2 environment at KEK
Line: 30 to 30
 mytau.param('ntupleName','taupair-jan2019.root')
Changed:
<
<
Submit a tau pair MC analysis job with one file
gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap -i /belle/MC/release-01-00-03/DB00000294/MC10/prod00004783/s00/e1002/4S/r00000/taupair/mdst/sub00/mdst_000001_prod00004783_task10010000001.root
>
>

Submit a tau pair MC analysis job.

The jobs are submitted to any site with the data. The output is written to the SE of the site. Note that the tau pair MC is currently located at KEK and UVIC SE's.

First, make a hard link to the librelease-03-00-00.so librelease-03-00-00.b2modmap files

ln /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.b2modmap librelease-03-00-00.b2modmap
ln /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/librelease-03-00-00.so librelease-03-00-00.so
 
Changed:
<
<
Submit a tau pair MC analysis job using an input file with the MC files (5 files)
>
>
With one file
 
Changed:
<
<
gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap --input_dslist files_taupair_5.data
>
>
gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap \ -i /belle/MC/release-01-00-03/DB00000294/MC10/prod00004783/s00/e1002/4S/r00000/taupair/mdst/sub00/mdst_000001_prod00004783_task10010000001.root
 
Changed:
<
<
Submit a tau pair MC analysis job using all the tau pair MC files (62 files) and writing the output to KEK-SE
>
>
With the MC files (5 files)
 
Changed:
<
<
gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap --input_dslist files_taupair_all.data
>
>
gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap \ --input_dslist files_taupair_5.data
 
Changed:
<
<
General commands
>
>
Using all the tau pair MC files (62 files)
 
Added:
>
>
gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap \ --input_dslist files_taupair_all.data

General commands

 # job status gb2_job_status -p jan2019

Revision 12019-01-29 - rsobie

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="RandallSobie"
RandallSobie

Submitting Belle2 analysis jobs on the grid using gbasf2 from KEK

Running grid jobs (3.0.0)

Initialization of Belle2 environment at KEK

source /sw/belle2/gbasf2/BelleDIRAC/gbasf2/tools/setup
gb2_proxy_init g belle

Copy shared libraries to gbasf2 directory (should test using full path name)

 cp /home/belle2/rsobie/release-03-00-00/modules/Linux_x86_64/opt/lib* .
(librelease-03-00-00.so librelease-03-00-00.b2modmap)

Add library path and ntuple name to python script

# configure the tau module
#mytau = b2.register_module('tausteer')
mytau = b2.register_module('tausteer', shared_lib_path='./librelease-03-00-00.so')

# ntuple output name
#mytau.param('ntupleName','/group/belle2/users/rsobie/taupair.root')
mytau.param('ntupleName','taupair-jan2019.root')

Submit a tau pair MC analysis job with one file

gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap -i /belle/MC/release-01-00-03/DB00000294/MC10/prod00004783/s00/e1002/4S/r00000/taupair/mdst/sub00/mdst_000001_prod00004783_task10010000001.root

Submit a tau pair MC analysis job using an input file with the MC files (5 files)

gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap --input_dslist  files_taupair_5.data

Submit a tau pair MC analysis job using all the tau pair MC files (62 files) and writing the output to KEK-SE

gbasf2 runTauMC.py -p jan2019 -s release-03-00-00 -f librelease-03-00-00.so librelease-03-00-00.b2modmap --input_dslist  files_taupair_all.data 

General commands

# job status
gb2_job_status -p jan2019

# retrieve output of project (will not retrieve previously retrieved jobs)
gb2_job_output -p jan2019

# list job output (ntuples) (can use long option "-l")
gb2_ds_list  /belle/user/rsobie/jan2019

# get ntuples (stores output in /gpfs/home/belle2/rsobie/gbasf2KEK/jan2019)
gb2_ds_get  /belle/user/rsobie/jan2019
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback