Tags:
create new tag
view all tags

KEK GHI file/tape system

RandallSobie

KEC CC documentation

How to tell if a file is on disk or tape (Note that a slash (/) is required at the end when specifying a directory)

ghils /ghi/fs02/test/
  H /ghi/fs02/test/hpss_ghi_ls.10
  B /ghi/fs02/test/hpss_ghi_ls.11
  G /ghi/fs02/test/hpss_ghi_ls.12

The status codes:

G: The file exists only on the GHI disk.
B: The file exists both on the GHI disk and the HPSS.
BP: The file exists both on the GHI disk and the HPSS. This file is not GHI-purged.
H: The file exists only on the HPSS and not on the GHI disk.

In my KEKtape directory (in the release directory), use the python script to get a list of files (this list should not change with time)

python makeList.py <filename>  > <output file>

Then run the check tape script (the number is the file set identifier for the tau pair skim data). Copy the ontape file to the tape staging directory (see below).

source checkTape.sh <#>
(this produces a file ontape#.out)

Tape staging

To stage a few files from tape, use the "od" command (od is octal dump) and check the file status with the ghils command. Use fs01 to match the location of the files; other options are fs02 and fs03.

 od /ghi/fs01/path/to/file | tail -n 1

To stage lots of files, use the hstage utility (it is not a command). Make a list of files to stage in a file. Put file in the /ghi/fs0x/hstage/requests directory.

The result is output in the /ghi/fs0x/hstage/results/yyyymmdd directory.

To find your request files, use the find command

find /ghi/fs01/hstage/requests/done/*/ -user username
Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | More topic actions
Topic revision: r2 - 2019-01-28 - rsobie
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback