Tags:
create new tag
view all tags
Discussion Forum » testing »

another test

this is the first multi-line post

-- crlb - 2017-11-27

And this is the first multi-line reply

-- crlb - 2017-11-27

After two blank lines, here is another multi-line reply

-- crlb - 2017-11-27

Cloud/object storage should be observed as a reliable service (they check data integrity on their own). How about we ignore the checksum until the data is transferred to a regular grid storage when we can/should keep track of it's adler32.

Discussion with Belle-II for using S3/Ceph+Dynafed as normal Site SE:

If a site choose Ceph/S3 as their site storage, assume it is reliable site responsibility, same as for any other site storage Assume as soon as file is correct on storage, then the file stays safe (e.g. no undetected bit changes) MD5 checksum only needed when copying a file to the storage for new files created on WN, checksum needs to be calculated anyway calculate adler32 and md5, storing adler32 in catalog would be enough use calculated md5 when transferring files to storage when copying file back from S3/Ceph storage as input file or to other sites, no need to check checksum on source (=reliable storage) but only on destination (adler32 is ok here) Open Issues gfal-copy/davix-lib should get option to send checksum together with file to storage Does FTS need changes to support it? For gfal-sum: Could Dynafed be changed to deliver the (md5) checksum directly by query the header/etag/metadata? Metadata can have user defined fields. Could davix-/gfal-tools get the option to store a checksum in the metadata (adler32+md5)?

-- crlb - 2017-11-27

hello

-- crlb - 2017-11-28

hello hello

-- crlb - 2017-11-28

hello hello hello

-- crlb - 2017-11-28

This is a demo for Justin.

-- crlb - 2017-11-28

DiscussionTopicForm
Title another test
Forum ForumTesting
Edit | Attach | Watch | Print version | History: r3 < r2 < r1 | Backlinks | Raw View | More topic actions
Topic revision: r3 - 2017-11-28 - crlb
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback