(r14) CloudHowToForCC < HEPrc

Tags: view all tags
-- Main.ColinLeavettBrown - 2015-06-22

---++ Cloud howto: running batch jobs with HTCondor/Cloud Scheduler

   * Obtain images - three methods:
      1 Use cloud provided default images (installed as public images by sysadmins) - easiest method.
      1 Download an existing image (see [[http://docs.openstack.org/image-guide/content/ch_obtaining_images.html][OpenStack image guide, section 2]]):
         * Select and image and copy its' URL
         * Use the horizon "Create Image" dialog and copied URL to upload the required image to your cloud account.
      1 Create image with virt-install (and cobbler):
         1 [[%ATTACHURL%/CobblerInstallVM.png][Hardware confguration]]
         1 On hypervisor node:
            * create and run [[%ATTACHURL%/mk-cc-demo][/root/qemu/mk-cc-demo]]. This will create a virtual machine with a vnc console that will fail to boot. At this point, the vnc console can be closed.
            * Issue "virsh edit cc-demo" and copy the "MAC" address.
            * Modify  /root/qemu/mk-cc-demo to include the copied MAC address.
            * "virsh destroy cc-demo"
            * "virsh undefine cc-demo"
         1 On cobbler server:
            * Create a public/private ssh key: *ssh-keygen -f /root/.ssh/id_rsa_cc-demo*
            * Create a [[%ATTACHURL%/cc-demo.cfg][/var/lib/cobbler/kickstarts/cc-demo.cfg]] suitable to your application needs. You can create an encrypted root password following [[][these instructions]].
               * Copy your new public key to the end of your kickstart file.
            * Create [[%ATTACHURL%/add-cc-demo][/root/cobbler/add-cc-demo]] specifying the kickstart file and the copied MAC address. Run the shell script and then "cobbler sync"
         1 On the hypervisor node:
            * Re-run the "mk-cc-demo" shell script. This will recreate the VM with a vnc console, but this time it will boot/install.
            * After the reboot, prepare the VM for other network connections:
               * ssh login from the cobbler server: *ssh -i ~/.ssh/id_rsa_cc-demo 192.168.1.11*
               * /etc/sysconfig/network (no host or gateway, nozeroconf=yes)
               * /etc/sysconfig/network-scripts/ifcfg-eth0
               * /etc/inittab
               * halt
               * *virsh edit cc-demo* and change the network bridge to br3 (public network)
               * virsh start cc-demo (*virsh start cc-demo; virt-viewer cc-demo*)
            * Which public IP did it get?
               * reboot in single user mode
               * ifup eth0 and ifconfig
               * reboot  
            * Log in through ssh and make any required customizations (see, [[http://docs.openstack.org/image-guide/content/ch_creating_images_manually.html][OpenStack image guide, section 5]]):
               * *yum -y update*
               * *yum -y install epel-release*
               * *yum -y install cloud-init* (may complain about not having [[ftp://ftp.pbone.net/mirror/ftp.pramberger.at/systems/linux/contrib/rhel6/i386/python-six-1.9.0-1.el6.pp.noarch.rpm][python-six]])
               * Batch jobs? Need to install HTCtcondor:
                  * *(cd /etc/yum.repos.d; wget http://research.cs.wisc.edu/htcondor/yum/repo.d/htcondor-stable-rhel6.repo)*
                  * *yum -y install condor*
                  * Modify the daemon list in /etc/condor/condor_config to include only the MASTER and STARTD daemons.
               * Authenticating condor server/workers with GSI?:
                  * Create [[%ATTACHURL%/igtf.repo][/etc/yum.repos.d/igtf.repo]] and install the following package:
                  * ca_policy_igtf-classic
               * rm -fv /etc/udev/rules.d/70-persistent-net.rules
            * shutdown the VM
            *  Use the horizon "Create Image" dialog to upload the image to your cloud account.

   * Customizing images interactively on the cloud:
      * Interractive instantiation:
         * Images->Actions->Launch
         * Provide name, flavor, key pair, network - then Launch
         * Instances->actions->associate floating IP
      * Modifying an image:
         * Login as root
         * Make changes
         * Snapshot:
            * Instances->Actions->Snapshot, provide snapshot name.

   * Running batch jobs:
      * Prepare [[%ATTACHURL%/batch-demo.tar.gz][batch control files]]:
         * cc-demo.sh - executable
         * cc-demo.job - Job Description Language (JDL) file
         * *IAAS.yaml* - required VM contextualization file:
            * configuration files  
               * job wrapper script
               * condor_config.local
               * condor initd script
            * Commands:
               * Set timezone
               * Establish swap space
               * Start condor
      * Submit jobs: condor_submit
      * Monitoring jobs: watch example
      * Retrieving job output:
      * Custom VM contextualization: [[https://wiki.heprc.uvic.ca/twiki/bin/view/HEPrc/CloudInitMerging][merge-type]], custom.yaml example:
         * Other files
         * Groups and users
         * Other commands
         * ssh keys
         * see [[http://cloudinit.readthedocs.org/en/latest/topics/examples.html][cloud-init]] documentation
Attachments
Topic attachments
I	Attachment	History	Action	Size	Date	Who
png	CobblerInstallVM.png	r2 r1	manage	85.8 K	2015-07-06 - 19:10	UnknownUser
EXT	add-cc-demo	r1	manage	0.4 K	2015-07-06 - 18:17	UnknownUser
cfg	cc-demo.cfg	r2 r1	manage	2.6 K	2015-07-06 - 19:55	UnknownUser
EXT	mk-cc-demo	r2 r1	manage	0.5 K	2015-07-06 - 19:12	UnknownUser
repo	igtf.repo	r2 r1	manage	0.2 K	2015-07-29 - 20:35	UnknownUser
gz	batch-demo.tar.gz	r3 r2 r1	manage	8.9 K	2015-08-21 - 18:38	UnknownUser
Topic revision: r14 - 2015-08-24 - crlb
~~Edit~~
~~Attach~~