• The instructions on the CernVM website use the 2009 java-based release of the Amazon EC2 documented here.
• The current release of the java-based Amazon EC2 tools are from 2015, and are documented here.

aws configure
AWS Access Key ID [None]: <ID>
AWS Secret Access Key [None]: <key>
Default region name [None]: us-west-2
Default output format [None]:

Upload the image you want to create the VM Image from onto S3:

wget http://cernvm.cern.ch/releases/production/cernvm-3.6.5.hdd
aws s3 cp cernvm-3.6.5.hdd s3://ucernvm-us-west-2/cernvm-3.6.5.hdd
aws s3 cp cernvm-3.6.5.hdd s3://ucernvm-us-east-1/cernvm-3.6.5.hdd

When you are ready to run aws ec2 import-image I suggest proceeding as follows. First run aws ec2 import-image --generate-cli-skeleton to get the structure of JSON we'll use to describe the image. I then filled it like this:

{
  "DryRun": false,
  "Description": "The micro CernVM version 3.6.5 running CerntOS 6",
  "DiskContainers": [
    {
      "Description": "CernVM disk image",
      "Format": "raw",
      "UserBucket": {
        "S3Bucket": "ucernvm-us-west-2",
        "S3Key": "cernvm-3.6.5.hdd"
      }
    }
  ],
  "Hypervisor": "xen",
  "Architecture": "x86_64",
  "Platform": "Linux"
}

aws ec2 import-image --cli-input-json file://cernvm-import.json

That will give you a message like this:

{
    "Status": "active",
    "Description": "The micro CernVM version 3.6.5 running CerntOS 6",
    "Hypervisor": "xen",
    "Platform": "Linux",
    "Architecture": "x86_64",
    "Progress": "2",
    "SnapshotDetails": [
        {
            "UserBucket": {
                "S3Bucket": "ucernvm-us-west-2",
                "S3Key": "cernvm-3.6.5.hdd"
            },
            "DiskImageSize": 0.0,
            "Format": "RAW"
        }
    ],
    "StatusMessage": "pending",
    "ImportTaskId": "import-ami-fh29lusp"
}

You can then check on the progress of your request like so:

aws ec2 describe-import-image-tasks --import-task-ids import-ami-fh29lusp

Unfortunately this one, just as all my previous attempts failed with the following:

    "StatusMessage": "ClientError: Unknown OS / Missing OS files."

AmazonWebServices

Uploading CernVM

aws s3 mb --region us-west-2 s3://ucernvm-us-west-2
aws s3 mb --region us-east-1 s3://ucernvm-us-east-1

And then you'll need to add the VM image into each of these buckets - once for each region you care to maintain an image in. I really hope that this will go away at some point ... but it makes me think hat S3 is in fact not replicated between the amazon sites.

Preparing the image

website

here

quick reference sheet

wget http://cernvm.cern.ch/releases/production/cernvm-3.6.5.fat
ec2-bundle-image -u <account_id> -c cert-*.pem -k pk-*.pem -i cernvm-3.6.5.fat --debug --arch x86_64

Now upload the manifests you created above to your S3 buckets:

ec2-upload-bundle -a <ID> -s <key> -m /tmp/cernvm-3.6.5.fat.manifest.xml -b ucernvm-us-west-2
ec2-upload-bundle -a <ID> -s <key> -m /tmp/cernvm-3.6.5.fat.manifest.xml -b ucernvm-us-east-1

Paravirtualized Image

%IMAGE{"EC2_Management_Console.png" type="frame" align="center" caption="finding the Kernel ID" }%

Here are the AKI's I've looked up so far:

OK, armed with those kernel IDs we can now make our para-virtualized image. You have to set up the correct service endpoint for ec2, you can look them up here. So for Oregon:

export EC2_URL=https://ec2.us-west-1.amazonaws.com
ec2-register -O <ID> -W <key> -a x86_64 --kernel aki-fc8f11cc ucernvm-us-west-2/cernvm-3.6.5.fat.manifest.xml -d "CernVM 3.6.5"

For N. Virginia note that the service endpoint and the kernel ID are different:

export EC2_URL=ec2.us-east-1.amazonaws.com
ec2-register -O <ID> -W <key> -a x86_64 --kernel aki-919dcaf8 ucernvm-us-east-1/cernvm-3.6.5.fat.manifest.xml -d "CernVM 3.6.5"

Hypervirtualized (HVM) Images

ec2-register

export EC2_URL=https://ec2.us-west-1.amazonaws.com
ec2-register -O <ID> -W <key> -a x86_64 --virtualization-type hvm --kernel aki-fc8f11cc ucernvm-us-west-2/cernvm-3.6.5.fat.manifest.xml -d "CernVM 3.6.5"

New(ish) AWS Command Line Interface

amazon cli

pip install awscli

here

Filesystem

RAW

IAM Users and Policies

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "s3:ListAllMyBuckets"
            ],
            "Resource": "*"
        },
        {
            "Effect": "Allow",
            "Action": [
                "s3:CreateBucket",
                "s3:DeleteBucket",
                "s3:DeleteObject",
                "s3:GetBucketLocation",
                "s3:GetObject",
                "s3:ListBucket",
                "s3:PutObject"
            ],
            "Resource": [
                "arn:aws:s3:::ucernvm",
                "arn:aws:s3:::ucernvm/*",
                "arn:aws:s3:::ucernvm-us-west-2",
                "arn:aws:s3:::ucernvm-us-west-2/*",
                "arn:aws:s3:::ucernvm-us-east-1",
                "arn:aws:s3:::ucernvm-us-east-1/*"
            ]
        },
        {
            "Effect": "Allow",
            "Action": [
                "ec2:CancelConversionTask",
                "ec2:CancelExportTask",
                "ec2:CreateImage",
                "ec2:CreateInstanceExportTask",
                "ec2:CreateTags",
                "ec2:DeleteTags",
                "ec2:DescribeConversionTasks",
                "ec2:DescribeExportTasks",
                "ec2:DescribeInstanceAttribute",
                "ec2:DescribeInstanceStatus",
                "ec2:DescribeInstances",
                "ec2:DescribeTags",
                "ec2:ImportInstance",
                "ec2:ImportVolume",
                "ec2:StartInstances",
                "ec2:StopInstances",
                "ec2:TerminateInstances",
                "ec2:ImportImage",
                "ec2:ImportSnapshot",
                "ec2:DescribeImportImageTasks",
                "ec2:DescribeImportSnapshotTasks",
                "ec2:CancelImportTask"
            ],
            "Resource": "*"
        }
    ]
}

Conventions:

This background colour denotes terminal input

This background colour denotes file content

-- frank - 2016-10-11

Comments

<--/commentPlugin-->