Difference: CloudHowToForCC (25 vs. 26)

Revision 262015-10-19 - crlb

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Added:
>
>
<-- 
 -->
<-- 
-->
 -- ColinLeavettBrown - 2015-06-22

Cloud howto: running batch jobs with HTCondor/Cloud Scheduler

Changed:
<
<

Obtain images - three methods:

>
>

A. Obtain images - three methods:

(click to show/hide)
 
  1. Use cloud provided default images (installed as public images by sysadmins) - easiest method.
  2. Download an existing image (see OpenStack image guide, section 2):
    • Select and image and copy its' URL
    • Use the horizon "Create Image" dialog and copied URL to upload the required image to your cloud account.
  3. Create image with virt-install (and cobbler):
Changed:
<
<
    1. Hardware confguration
    2. On hypervisor node:
>
>
 
      • create and run /root/qemu/mk-cc-demo. This will create a virtual machine with a vnc console that will fail to boot. At this point, the vnc console can be closed.
      • Issue "virsh edit cc-demo" and copy the "MAC" address.
      • Modify /root/qemu/mk-cc-demo to include the copied MAC address.
      • "virsh destroy cc-demo"
      • "virsh undefine cc-demo"
Changed:
<
<
    1. On cobbler server:
>
>
    • On cobbler server:
 
      • Create a public/private ssh key: ssh-keygen -f /root/.ssh/id_rsa_cc-demo
      • Create a /var/lib/cobbler/kickstarts/cc-demo.cfg suitable to your application needs.
        • Create an encrypted root password (make sure cipher matches passalgo) and insert in kickstart: mkpasswd -m sha-512 following [[][these instructions]].
        • Copy your new public key to the end of your kickstart file.
      • Create /root/cobbler/add-cc-demo specifying the kickstart file and the copied MAC address. Run the shell script and then "cobbler sync"
Changed:
<
<
    1. On the hypervisor node:
>
>
    • On the hypervisor node:
 
      • Re-run the "mk-cc-demo" shell script. This will recreate the VM with a vnc console, but this time it will boot/install. * ( 5 minutes) *
      • After the reboot, prepare the VM for other network connections:
        • ssh login from the cobbler server: ssh -i ~/.ssh/id_rsa_cc-demo 192.168.1.11
Line: 35 to 51
 
      • Use the horizon "Create Image" dialog to upload the image to your cloud account:
        • May need to scp the image to your desktop.
        • Images->Create Image, provide name file path, and format RAW.
Added:
>
>
 
Changed:
<
<

Customizing images interactively on the cloud:

>
>

B. Customizing images interactively on the cloud:

(click to show/hide)
 
  • Interractive instantiation:
    • Images->Actions->Launch
    • Provide name, flavor, key pair, network - then Launch
Line: 44 to 64
 
Changed:
<
<
      • *yum -y install epel-release
>
>
      • yum -y install epel-release
 
Line: 57 to 77
 
    • Snapshot:
      • My personal preference, rename currently running image: Images->Actions->Edit, change the image name.
      • Instances->Actions->Snapshot, provide snapshot name.
Added:
>
>
 
Changed:
<
<

Running batch jobs:

>
>

C. Running batch jobs:

(click to show/hide)
 
  • OpenStack security groups: 9614, 9618, 20000-25000, and 40000-50000, TCP ports open.
  • On CC (litai08) demonstrate the necessity for grid credentials:
    • condor_q
Line: 83 to 107
 
    • condor_submit
    • condor_release
    • The job log.
Added:
>
>
 
Changed:
<
<
(pre-reorganized)
>
>
<-- (pre-reorganized) -->
 
META FILEATTACHMENT attachment="CobblerInstallVM.png" attr="" comment="" date="1436209811" name="CobblerInstallVM.png" path="CobblerInstallVM.png" size="87856" user="crlb" version="2"
META FILEATTACHMENT attachment="add-cc-demo" attr="" comment="" date="1444925509" name="add-cc-demo" path="add-cc-demo" size="450" user="crlb" version="3"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback