--
ColinLeavettBrown - 2015-06-22
Cloud howto: running batch jobs with HTCondor/Cloud Scheduler
- Obtain images - three methods:
- Use cloud provided default images (installed as public images by sysadmins) - easiest method.
- Download an existing image (see OpenStack image guide, section 2
):
- Select and image and copy its' URL
- Use the horizon "Create Image" dialog and copied URL to upload the required image to your cloud account.
- Create image with virt-install (and cobbler):
- Hardware confguration
- On hypervisor node,
- create and run /root/qemu/mk-cc-demo. This will create a virtual machine with a vnc console that will fail to boot. At this point, the vnc console can be closed.
- Issue "virsh edit cc-demo" and copy the "MAC" address.
- Modify /root/qemu/mk-cc-demo to include the copied MAC address.
- "virsh destroy cc-demo"
- "virsh undefine cc-demo"
- On cobbler server:
- Create a public/private ssh key: ssh-keygen -f /root/.ssh/id_rsa_cc-demo
- Create a /var/lib/cobbler/kickstarts/cc-demo.cfg suitable to your application needs. You can create an encrypted root password following [[][these instructions]].
- Copy your new public key to the end of your kickstart file.
- Create /root/cobbler/add-cc-demo specifying the kickstart file and the copied MAC address. Run the shell script and then "cobbler sync"
- On the hupervisor node:
- Re-run the "mk-cc-demo" shell script. This will recreate the VM with a vnc console, but this time it will boot/install.
- After the reboot, log in and make any required customizations (see, OpenStack image guide, section 5
).
- Remove any UDEV network rules that exist (ie. "rm -f /etc/udev/rules.d/70-persistent-net.rules), the hardware address from the network interface, and halt the VM.
- Convert the image to qcow2 format: "qemu-img convert -O qcow2 cc-demo.img cc-demo.qcow2".
- Use the horizon "Create Image" dialog to upload the image to your cloud account.
- Customizing images:
- Interractive instantiation:
- login as root and modify image
- Snapshot
- Running batch jobs:
- Prepare executable
- Prepare JDL
- Prepare data souces and repositories
- Submit jobs
- Monitoring jobs
- Retrieving job output
This topic: HEPrc
> WebHome > CloudHowToForCC
Topic revision: r5 - 2015-07-06 - crlb