Difference: KekccTape (1 vs. 2)

Revision 22019-01-28 - rsobie

Line: 1 to 1
 
META TOPICPARENT name="RandallSobie"

KEK GHI file/tape system

Changed:
<
<
KEC CC documentation
>
>
RandallSobie
 
Added:
>
>
KEC CC documentation
 

How to tell if a file is on disk or tape (Note that a slash (/) is required at the end when specifying a directory)

Line: 22 to 23
 H: The file exists only on the HPSS and not on the GHI disk.
Added:
>
>
In my KEKtape directory (in the release directory), use the python script to get a list of files (this list should not change with time)
python makeList.py <filename>  > <output file>

Then run the check tape script (the number is the file set identifier for the tau pair skim data). Copy the ontape file to the tape staging directory (see below).

source checkTape.sh <#>
(this produces a file ontape#.out)

 

Tape staging

Changed:
<
<
To stage a few files from tape, use the "od" command (od is octal dump) and check the file status with the ghils command
>
>
To stage a few files from tape, use the "od" command (od is octal dump) and check the file status with the ghils command. Use fs01 to match the location of the files; other options are fs02 and fs03.
 
 od /ghi/fs01/path/to/file | tail -n 1
Line: 33 to 47
  The result is output in the /ghi/fs0x/hstage/results/yyyymmdd directory.
Changed:
<
<
To find your request files, use the find command.
>
>
To find your request files, use the find command
 
Changed:
<
<
find /ghi/fs0?/hstage/requests/done/*/ -user username
>
>
find /ghi/fs01/hstage/requests/done/*/ -user username
 

Revision 12019-01-25 - rsobie

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="RandallSobie"

KEK GHI file/tape system

KEC CC documentation

How to tell if a file is on disk or tape (Note that a slash (/) is required at the end when specifying a directory)

ghils /ghi/fs02/test/
  H /ghi/fs02/test/hpss_ghi_ls.10
  B /ghi/fs02/test/hpss_ghi_ls.11
  G /ghi/fs02/test/hpss_ghi_ls.12

The status codes:

G: The file exists only on the GHI disk.
B: The file exists both on the GHI disk and the HPSS.
BP: The file exists both on the GHI disk and the HPSS. This file is not GHI-purged.
H: The file exists only on the HPSS and not on the GHI disk.

Tape staging

To stage a few files from tape, use the "od" command (od is octal dump) and check the file status with the ghils command

 od /ghi/fs01/path/to/file | tail -n 1

To stage lots of files, use the hstage utility (it is not a command). Make a list of files to stage in a file. Put file in the /ghi/fs0x/hstage/requests directory.

The result is output in the /ghi/fs0x/hstage/results/yyyymmdd directory.

To find your request files, use the find command.

find /ghi/fs0?/hstage/requests/done/*/ -user username
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback