Tags:
create new tag
view all tags

Recent Changes in HEPrc Web retrieved at 04:34 (GMT)

Summary of B2 Storage MonitoringPages RandallSobie B2 Storage in Victoria
Summary of monitoring pages (27 links and counting) RandallSobie Accounting and benchmarks Version 2.0: EsAcc20, EsBenchmarks20 Cloud specific...
Computing documentation MonitoringPages Private page General services CloudScheduler OpenstackCommandLine FindDefunctVMs...
Monthly summary of cloud accounting from elastic search using Acc V2.0 MonitoringPages RandallSobie 2020 data Delivered kilo CPU hours and efficiency for each cloud...
Benchmarks from elastic search using Bmk V2020 MonitoringPages RandallSobie 2020 (since April 1 2020) 2019
Run Belle2 jobs using UVIC SE from a beaver VM RandallSobie Boot a VM on beaver Belle2 prefers an SL6 VM cernvm3 micro 3.0 6.hdd # Add ssh keys, select private IP...
MC13a samples RandallSobie See the DIRAC web site for its datasearcher option. qqbar MC samples There are more production samples (e.g. prod000XXX) but the run numbers...
Belle2 Good runs RandallSobie List of good runs (4S only) /group/belle2/dataprod/Data/OfficialReco/proc10/e0007/4S/GoodRuns /group/belle2/dataprod/Data/OfficialReco...
Declaring an outage for bellecs RandallSobie If you ban the CE from the web app, then the ban would expire after 24 hours. The `standard` way in DIRAC to ban a CE...
RandallSobie Latest update Jan 23 2020 (back off to 04 00 03; no gbasf2 for 04 00 04) Login into KEK (login and computer systems) ssh sshcc1.kek.jp ssh login.cc...
Docker on CernVM Since the latest CernVM image, a modern docker version is available. Time to re visit the docker universe in HTCondor. With being able to run docker...
Rolfs Random Collection of Stuff ElasticSearchTips CernvmDocker
Root Selector RandallSobie The new version of root uses a different method for the ntuple selection code. To use the legacy method, do the following: t1 MakeSelector...
proc 10 data RandallSobie Experiment 7 rsobie@cw09 ~ $ gb2 ds list /belle/Data/release 04 01 00/DB00000748/proc10/ /e0007 /belle/Data/release 04 01 00/DB...
Data samples (Feb 1 2020) RandallSobie Tau pair data (release 04 00 03 and runs 9441, 9561) on HSM system at KEK /hsm/belle2/bdata/MC/release 04 00 03/DB00000757/MC13a...
RandallSobie Submitting Belle2 analysis jobs on the grid using gbasf2 from KEK Running grid jobs (04.01.01) January 2020 Initialization of Belle2 environment at...
Monthly summary of ECDF GridPP accounting from elastic search MonitoringPages RandallSobie
Monthly summary of Innsbruck accounting from elastic search MonitoringPages RandallSobie
Monthly summary of ECDF accounting from elastic search MonitoringPages RandallSobie
Monthly summary of LRZ accounting from elastic search MonitoringPages RandallSobie
LHCONE plots RandallSobie and MonitoringPages Other plots in https://weathermap.canarie.ca/ntn/ KEK (week, month, year) https://weathermap.canarie.ca/ntn/lhcone kek...
Opportunistic computing Define configurable parameters (set via the GUI): Q cloud quota (set on the cloud) of a tenant Not always the `true` quota on many...
VM Benchmarks using 2019 HEPIX suite (see https://gitlab.cern.ch/hep benchmarks) See the CHEP2019 talk by Valassi (https://indico.cern.ch/event/773049/contributions...
CSV2 journal paper Introduction review of cloud provisioning systems (vcycle, vmdirac, htcondor, commercial systems, ..) opportunistic computing CS first...
Hugo heprc.phys.uvic.ca and rjs.heprc.uvic.ca web sites How to use Development is done on my desktop in the Desktop/Htest directory. Files are also archived...
Monthly summary of cloud accounting from elastic search MonitoringPages RandallSobie Note that the elastic search data started in mid January 2018 Delivered kilo...
bellecs.heprc VM benchmarks from elastic search MonitoringPages RandallSobie Csv2Benchmarks, BellecsBenchmarks, Aiatlas009Benchmarks, CondorBenchmarks Amazon Compute...
aiatlas009 VM benchmarks from elastic search MonitoringPages RandallSobie Csv2Benchmarks, BellecsBenchmarks, Aiatlas009Benchmarks, CondorBenchmarks Cern plots...
Monthly summary for 2018 of cloud accounting from elastic search MonitoringPages RandallSobie Note that these tables are no longer updated Delivered kilo CPU hours...
Daily summary of Amazon EC2 usage MonitoringPages RandallSobie Current month (note first bin is the cost deducted from the AWS credit):
Monthly summary of Amazon EC2 usage MonitoringPages RandallSobie Note that the Totals do not include the period before June 2018 (start of current grant)
RandallSobie Submitting Belle2 jobs from KEK and UVIC Login into KEK (login and computer systems) or the belleuser VM on beaver ssh sshcc1.kek.jp ssh login.cc.kek...
RandallSobie Get the free space on the UVIC Belle II storage element See the ES web page UVIC SE From the belleuser machine 206.12.154.170 (as user rsobie) $ source...
KEK GHI file/tape system RandallSobie KEC CC documentation How to tell if a file is on disk or tape (Note that a slash (/) is required at the end when specifying...
condor.heprc VM benchmarks from elastic search (only good for 2018) MonitoringPages RandallSobie Csv2Benchmarks, BellecsBenchmarks, Aiatlas009Benchmarks, CondorBenchmarks...
csv2.heprc VM benchmarks from elastic search MonitoringPages RandallSobie Csv2Benchmarks, BellecsBenchmarks, Aiatlas009Benchmarks, CondorBenchmarks
Monthly summary of Google accounting from elastic search MonitoringPages RandallSobie
Monthly summary of Amazon (west and east) accounting from elastic search MonitoringPages RandallSobie
HEP support icon:searchtopic Web search advanced search icon:index Web topic list all topics icon:mail Web notify subscribe to e mail alerts...
VM benchmarks from elastic search MonitoringPages RandallSobie Fast benchmark plots for each cloud scheduler system. Points (or green histograms) are for this month...
Cloud accounting from elastic search on aiatlas009.cern.ch (CERN CS) MonitoringPages RandallSobie
Cloud accounting from elastic search on bellecs.heprc.uvic.ca MonitoringPages RandallSobie
Cloud accounting from elastic search on condor.heprc.uvic.ca MonitoringPages RandallSobie
Atlas Job Monitoring We are running ATLAS payloads on many clouds. We have only little influence what type of jobs are submitted to our worker nodes. We can select...
General accounting information MonitoringPages RandallSobie Note that February 2018 had a 5 day outage (Feb 16 21) in the log accounting system
Cloud accounting from LOG files on CERN CS MonitoringPages RandallSobie Note that February 2018 had a 5 day outage (Feb 16 21) in the log accounting system
Cloud accounting from LOG files on Belle CS MonitoringPages RandallSobie Note that February 2018 had a 5 day outage (Feb 16 21) in the log accounting system
Cloud accounting on condor.heprc MonitoringPages RandallSobie Note that February 2018 had a 5 day outage (Feb 16 21) in the log accounting system
Jobs on Sim@P1 system MonitoringPages RandallSobie
Tips when running and using elasticsearch, logstack and kibana et al. Note that below I am running the curl commands on the private network interface on the normal...
Belle2 DIRAC Site Director (SD) configuration The DIRAC software is located the following directories (bellecs.heprc.uvic.ca) /opt/dirac/pro /home/dirac Frank`s documentation...
Definition of VM states Orphaned VM: VM is not registered in HTCondor and is also not registered with Cloudscheduler Note one must check both condor...
Adding your Squid to Shoal This page describes how to configure a Squid server with shoal agent. Squid Installation If you already have a squid installed, skip to...
Epoch time date date `Nov 1 2016 00:00:00` %s date d @1477983600
Set up CVMFS Modify the site.conf and default.local in /etc/cvmfs directory cat site.config CVMFS HTTP PROXY `auto;http://kraken01.westgrid.ca:3128;DIRECT` CVMFS...
Network Logging Network monitoring from bellecs.heprc.uvic.ca or condor.heprc.uvic.ca sudo /usr/local/sbin/monitor chameleon network summary less /var/log/monitor...
Dynafed installation and user authentication copy tools tested with dynafed can be found here manual installation start with minimal CentOS 7 enable...
Test of copy tools with dynafed Version of tools needed to have it working on the source site (at least if DPM) latest certificates for the sites involved...
s3cmd Get pip curl O https://bootstrap.pypa.io/get pip.py python get pip.py Install s3cmd (currently installed on rjs1 VM at CERN) sudo pip install s3cmd s3cmd...
davix CERN (these both work) They also work from the belleuser VM 206.12.154.170 davix ls s3accesskey xx s3secretkey xx https://rjsBucket.cs3.cern.ch davix ls s3accesskey...
Set up root Set up CVMFS Modify the site.conf and default.local in /etc/cvmfs directory cat site.config CVMFS HTTP PROXY `auto;http://kraken01.westgrid.ca:3128;DIRECT...
RJS Dynafed documentation Installation on beaver.heprc VM (using cernvm3 micro 2.7 7.hdd): yum install epel release yum install dynafed yum install dynafed dmlite...
How to login to an Azure VM In the Azure portal, click on the VM. Go to `All Settings` Go to `Properties` Copy address and port number from `SSH` ssh p root@ Usually...
How to retire Azure VMs that are not registered in CS Two step process: Step 1: Find running VMs on condor (but not registered in CS) condor status wide grep...
Log into OpenStack VM with nova commands On macsob2.phys, cd Desktop/Nova, and issue nova set up script for required cloud and tenant nova floating ip associate...
Find VM`s with defunct processes (java) Hourly reporting of VM`s with defunct process in /var/log/vm defunct.log with entry (`defunct`: `1`). List all VM`s with a...
AmazonWebServices The instructions on the CernVM website use the 2009 java based release of the Amazon EC2 documented here. The current release of the java based...
VM Benchmarks CERN documentation http://bmkwg.web.cern.ch/bmkwg/docs/HowToRun.html Installation: bellecs.heprc.uvic.ca in /root/HEPbm.yaml condor.heprc.uvic...
To change the date requirement use echo $((`date %s` 86400)) Note that the query requires JSON time (multiply unix time by 1000) { `size`: 50000, `sort`:...
Documentation lcgdm dav lcgdm dav is the front end module for the federator (also used as a front end for DPM). It passes queries and responses to the federator through...
Coop WorkTerm Report Template Notes on style Co op workterm reports should take the form of a scientific report on a specific problem and a solution. Narrative style...
HTCondor Mips HTCondor makes a measurement of the MIPS when a VM is booted and puts the value into the class ad of the VM. There is an entry per VM and the entry for...
CPU efficiency of each running job Show VM image size, load average, wall clock time and CPU efficiency for each job. (need to manually change the cloud name) cd...
Fast LHCb HS06 Benchmark List files in specified day with non zero file size (all files later than April 1st 2016): ( the output redirection only works from /root...
Cloud Scheduler REST API The APIs provided by admin server.py and info server.py and consumed by cloud admin and cloud status have been transitioned from XML...
Setting up the Elliott 219 Kyocera printer on your Mac OSX workstation Download and save one of the following PPD files (corresponding to the project you are...
See also CloudSchedulerAdminGuide . CloudScheduler commands List the status of the Belle2 Cloud Schdeduler (bellecs.heprc.uvic.ca and condor.heprc.uvic.ca) cloud...
This documentation describes a simple recommended frontier squid configuration, for use with Shoal. It is a simplified subset of information from https://twiki.comp...
ColinLeavettBrown 2015 01 23 HEP Support Check out the topics below for answers to your query. If you still have issues with Linus, Mac OS X or the wiki, send...
ColinLeavettBrown 2013 08 28 NEP52 Shared Software Repository Overview If you just want to use Shared Software Repository Service skip to the Shared Software Repository...
ColinLeavettBrown 2015 10 29 NEP 101: Final Technical Review (Sustaining) Date: 30 October 2015, 10:30 11:30 Location: University of Victoria, Elliott 105...
Glint Login Glint Server: ssh centos #64;glint.heprc.uvic.ca Login Glint Web Portal User Interface: https://glint.heprc.uvic.ca:8483/project/ Processes: Glint...
ColinLeavettBrown 2015 09 14 NEP 101: Fifth Technical Review (Sustaining) Date: 17 September 2015, 10:30 11:00 Location: University of Victoria, Elliott...
ColinLeavettBrown 2015 06 11 NEP 101: Third Technical Review (Sustaining) Date: 12 June 2015, 10:00 10:30 Location: University of Victoria, Elliott 105 Agenda...
ColinLeavettBrown 2015 04 22 NEP 101: Second Technical Review (Sustaining) Date: 24 April 2015, 10:00 10:30 Location: University of Victoria, Elliott 105...
Compute Canada Cloud Project Meetings 27 January 2015, 10:30 PST, Elliott 105 VC. (Randy)
ColinLeavettBrown 2015 01 27 NEP 101: Sixth Technical Review Date: 27 January 2015, 09:00 10:00 Location: University of Victoria, Elliott 105 Agenda...
NEP 101: Fifth Technical Review Date: 16 December 2014, 09:00 10:00 Location: University of Victoria, Elliott 105 Agenda (Randy) Complete Project...
ColinLeavettBrown 2014 11 04 Temporary Paris Presentation Page.
SC 2014 100G Server Development Stand Alone chef for R920 ssh A root #64;yourR920.uni.edu cd ~ curl L https://www.opscode.com/chef/install.sh bash git clone git...
Proxy expiration on condor.heprc.uvic.ca (should run in a cron job) sudo /usr/sbin/fetch crl Location of the DIRAC code /opt/dirac/pro/DIRAC/Resources/Computing...
Running Belle2 in a VM (sobie belle) image Login into the VM (Image Checksum ef895936a9e82f48a946bd1608312cfd) source /cvmfs/belle.cern.ch/tools/setup belle2.sh...
NEP 101: Second Technical Review Date: 14 July 2014, 10:00 11:00 Location: University of Victoria, Elliott 105 Agenda Percentage Complete Project...
Managing VMs on the UVIC Mouse OpenStack Cloud There is documentation at CERN http://information technology.web.cern.ch/book/cern private cloud user guide/openstack...
ColinLeavettBrown 2013 09 09 NEP 3 Objectives ATLAS production on the cloud is currently restricted to workloads requiring modest amounts of input and output...
If clouds would follow this standard it would make it easier to contextualize images: http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AESDG chapter instancedata...
Supercomputing 2012 Documentation. MegaRaid Upgrade The following IBM provided software was saved on our repository for easy distribution: ibm fw sraidmr...

«Previous   1  2   Next»

Show 10, 20, 50, 100, 500, 1000 results per page, or show all.

Related topics: RSS feed, rounded corners RSS feed, ATOM feed, WebNotify, site changes, site map

Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | More topic actions
Topic revision: r1 - 2006-11-15 - TWikiContributor
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback