Difference: LustrePlusXen (1 vs. 10)

Revision 102010-02-03 - crlb

Line: 1 to 1
 
META TOPICPARENT name="CanarieProjectNEP52"

Installing Lustre and Xen on Scientific Linux 5

Line: 7 to 7
 We are targeting Scientific Linux 5.X kernels with the latest release of Lustre and the version of Xen present in SL5.

The basic steps are as follows:

Changed:
<
<
  1. Download the Luster patched RHEL 5 kenel from sun in the form of src rpm.
>
>
  1. Download the Luster patched RHEL 5 kenel from Oracle or (sun) in the form of src rpm.
 
  1. Configure and build the source RPM into regular rpms containing both the Lustre and Xen patches.
  2. Install the Luste Xen Kernel from rpm.
  3. Download the source tarball for Lustre that matches the kernel you have just built.
Line: 26 to 26
 
$ cd ~
$ mkdir -p rpmbuild/{BUILD,RPMS,SOURCES,SPECS,SRPMS}
Added:
>
>
$ echo '%_topdir /hepuser/igable/rpmbuild' >./.rpmmacros
 $ rpm -i kernel-lustre-2.6.18-128.7.1.el5_lustre.1.8.1.1.src.rpm

Revision 92010-01-13 - crlb

Line: 1 to 1
 
META TOPICPARENT name="CanarieProjectNEP52"

Installing Lustre and Xen on Scientific Linux 5

Line: 36 to 36
  As root install the RPMS:
Changed:
<
<
# rpm -ivh kernel-lustre-xen-devel-2.6.18-128.7.1.el5_lustre.1.8.1.1.x86_64.rpm
>
>
# rpm -ivh kernel-lustre-xen-2.6.18-128.7.1.el5_lustre.1.8.1.1.x86_64.rpm
 # rpm -ivh kernel-lustre-xen-devel-2.6.18-128.7.1.el5_lustre.1.8.1.1.x86_64.rpm

Revision 82010-01-12 - crlb

Line: 1 to 1
 
META TOPICPARENT name="CanarieProjectNEP52"

Installing Lustre and Xen on Scientific Linux 5

Line: 7 to 7
 We are targeting Scientific Linux 5.X kernels with the latest release of Lustre and the version of Xen present in SL5.

The basic steps are as follows:

Changed:
<
<
  1. Download the Luster patched RHEL 5 kenel from sun in the form of src rpm.
>
>
  1. Download the Luster patched RHEL 5 kenel from sun in the form of src rpm.
 
  1. Configure and build the source RPM into regular rpms containing both the Lustre and Xen patches.
  2. Install the Luste Xen Kernel from rpm.
  3. Download the source tarball for Lustre that matches the kernel you have just built.

Revision 72010-01-11 - igable

Line: 1 to 1
 
META TOPICPARENT name="CanarieProjectNEP52"

Installing Lustre and Xen on Scientific Linux 5

Line: 7 to 7
 We are targeting Scientific Linux 5.X kernels with the latest release of Lustre and the version of Xen present in SL5.

The basic steps are as follows:

Changed:
<
<
  1. Download the Luster patched RHEL 5 kenel from sun in the form of src rpm
>
>
  1. Download the Luster patched RHEL 5 kenel from sun in the form of src rpm.
 
  1. Configure and build the source RPM into regular rpms containing both the Lustre and Xen patches.
  2. Install the Luste Xen Kernel from rpm.
  3. Download the source tarball for Lustre that matches the kernel you have just built.
Line: 16 to 16
 
  1. Install the rpms.
Changed:
<
<

Rough notes (in progress)

Follow this:
>
>

Step by Step

Most of the follow was derived from reading this:

 http://wiki.centos.org/HowTos/Custom_Kernel
Added:
>
>
Create a place to build rpms not as the root user and install the downloaded source rpms:
$ cd ~
$ mkdir -p rpmbuild/{BUILD,RPMS,SOURCES,SPECS,SRPMS}
$ rpm -i kernel-lustre-2.6.18-128.7.1.el5_lustre.1.8.1.1.src.rpm
 
Changed:
<
<
solution is to add
>
>
Build the source RPMS into the complete set of kernel RPMS:
$ rpmbuild -bb --without kabichk --target=x86_64 kernel-2.6.spec
 
Changed:
<
<
http://ftp1.scientificlinux.org/linux/scientific/5x/SRPMS/vendor/
>
>
As root install the RPMS:
# rpm -ivh kernel-lustre-xen-devel-2.6.18-128.7.1.el5_lustre.1.8.1.1.x86_64.rpm
# rpm -ivh kernel-lustre-xen-devel-2.6.18-128.7.1.el5_lustre.1.8.1.1.x86_64.rpm
 
Changed:
<
<
e2fsprogs-1.39-23.el5.x86_64
>
>
Clean up you build are in preparation for building RPMS for lustre from the Lustre Source:
$ mv rpmbuild rpmbuild-2.6.18.128_lustre_xen
$ mkdir -p rpmbuild/{BUILD,RPMS,SOURCES,SPECS,SRPMS}

Untar luster and configure it pointing to the correct kernel source:

$ cd lustre-1.8.1.1
$ ./configure --with-linux=/usr/src/kernels/2.6.18-128.7.1.el5_lustre.1.8.1.1-xen-x86_64
 
Added:
>
>
Make and install the lustre RPMS:
$ make rpms
$ rpm -ivh lustre-modules-1.8.1.1-2.6.18_128.7.1.el5_lustre.1.8.1.1xen_200912081130.x86_64.rpm
$ rpm -ivh lustre-ldiskfs-3.0.9-2.6.18_128.7.1.el5_lustre.1.8.1.1xen_200912081131.x86_64.rpm
$ rpm -ivh lustre-1.8.1.1-2.6.18_128.7.1.el5_lustre.1.8.1.1xen_200912081130.x86_64.rpm
 
Deleted:
<
<
warning about ldiskfs stuff WARNING: /lib/modules/2.6.18-128.7.1.el5_lustre.1.8.1.1xen/kernel/fs/lustre/fsfilt_ldiskfs.ko needs unknown symbol ldiskfs_bread
 
Added:
>
>

Original History Dump

 
$ cd ~
$ mkdir -p rpmbuild/{BUILD,RPMS,SOURCES,SPECS,SRPMS}
Line: 51 to 81
 $ cat /proc/fs/lustre/devices

\ No newline at end of file

Added:
>
>

Garbage

solution is to add

http://ftp1.scientificlinux.org/linux/scientific/5x/SRPMS/vendor/

e2fsprogs-1.39-23.el5.x86_64

warning about ldiskfs stuff WARNING: /lib/modules/2.6.18-128.7.1.el5_lustre.1.8.1.1xen/kernel/fs/lustre/fsfilt_ldiskfs.ko needs unknown symbol ldiskfs_bread

Revision 62009-12-09 - igable

Line: 1 to 1
 
META TOPICPARENT name="CanarieProjectNEP52"

Installing Lustre and Xen on Scientific Linux 5

Line: 48 to 48
 $ rpm -ivh lustre-modules-1.8.1.1-2.6.18_128.7.1.el5_lustre.1.8.1.1xen_200912081130.x86_64.rpm $ rpm -ivh lustre-ldiskfs-3.0.9-2.6.18_128.7.1.el5_lustre.1.8.1.1xen_200912081131.x86_64.rpm $ rpm -ivh lustre-1.8.1.1-2.6.18_128.7.1.el5_lustre.1.8.1.1xen_200912081130.x86_64.rpm
Added:
>
>
$ cat /proc/fs/lustre/devices
 

Revision 52009-12-09 - igable

Line: 1 to 1
 
META TOPICPARENT name="CanarieProjectNEP52"
Added:
>
>

Installing Lustre and Xen on Scientific Linux 5

In order to have the advantages of both Xen and Lustre on the same box it necessary to do little bit of work at the moment. Since both projects require kernel patches you need to have a kernel with both. There are several different approaches for doing this. I present only the one I followed that worked for me.

We are targeting Scientific Linux 5.X kernels with the latest release of Lustre and the version of Xen present in SL5.

The basic steps are as follows:

  1. Download the Luster patched RHEL 5 kenel from sun in the form of src rpm
  2. Configure and build the source RPM into regular rpms containing both the Lustre and Xen patches.
  3. Install the Luste Xen Kernel from rpm.
  4. Download the source tarball for Lustre that matches the kernel you have just built.
  5. Run the configure script for the lustre sources pointing at the kernel you have just installed
  6. Build the Lustre kernel modules, ldiskfs kernel modules, and lustre rpms.
  7. Install the rpms.

Rough notes (in progress)

 Follow this: http://wiki.centos.org/HowTos/Custom_Kernel
Changed:
<
<
Watch out for this bug when building: https://bugzilla.redhat.com/show_bug.cgi?id=512275
>
>
  solution is to add

Revision 42009-12-08 - igable

Line: 1 to 1
 
META TOPICPARENT name="CanarieProjectNEP52"
Follow this: http://wiki.centos.org/HowTos/Custom_Kernel
Line: 16 to 16
 warning about ldiskfs stuff WARNING: /lib/modules/2.6.18-128.7.1.el5_lustre.1.8.1.1xen/kernel/fs/lustre/fsfilt_ldiskfs.ko needs unknown symbol ldiskfs_bread
Added:
>
>
$ cd ~
$ mkdir -p rpmbuild/{BUILD,RPMS,SOURCES,SPECS,SRPMS}
$ rpm -i kernel-lustre-2.6.18-128.7.1.el5_lustre.1.8.1.1.src.rpm
$ rpmbuild -bb --without kabichk --target=x86_64 kernel-2.6.spec
# rpm -ivh kernel-lustre-xen-devel-2.6.18-128.7.1.el5_lustre.1.8.1.1.x86_64.rpm
# rpm -ivh kernel-lustre-xen-devel-2.6.18-128.7.1.el5_lustre.1.8.1.1.x86_64.rpm

$ mv rpmbuild rpmbuild-2.6.18.128_lustre_xen
$ mkdir -p rpmbuild/{BUILD,RPMS,SOURCES,SPECS,SRPMS}
$ cd lustre-1.8.1.1
$ ./configure --with-linux=/usr/src/kernels/2.6.18-128.7.1.el5_lustre.1.8.1.1-xen-x86_64
$ make rpms
$ rpm -ivh lustre-modules-1.8.1.1-2.6.18_128.7.1.el5_lustre.1.8.1.1xen_200912081130.x86_64.rpm
$ rpm -ivh lustre-ldiskfs-3.0.9-2.6.18_128.7.1.el5_lustre.1.8.1.1xen_200912081131.x86_64.rpm
$ rpm -ivh lustre-1.8.1.1-2.6.18_128.7.1.el5_lustre.1.8.1.1xen_200912081130.x86_64.rpm 

Revision 32009-12-08 - igable

Line: 1 to 1
 
META TOPICPARENT name="CanarieProjectNEP52"
Follow this: http://wiki.centos.org/HowTos/Custom_Kernel
Line: 11 to 11
 http://ftp1.scientificlinux.org/linux/scientific/5x/SRPMS/vendor/

e2fsprogs-1.39-23.el5.x86_64 \ No newline at end of file

Added:
>
>

warning about ldiskfs stuff WARNING: /lib/modules/2.6.18-128.7.1.el5_lustre.1.8.1.1xen/kernel/fs/lustre/fsfilt_ldiskfs.ko needs unknown symbol ldiskfs_bread

Revision 22009-12-04 - igable

Line: 1 to 1
 
META TOPICPARENT name="CanarieProjectNEP52"
Follow this: http://wiki.centos.org/HowTos/Custom_Kernel
Line: 7 to 7
 https://bugzilla.redhat.com/show_bug.cgi?id=512275

solution is to add

Added:
>
>
http://ftp1.scientificlinux.org/linux/scientific/5x/SRPMS/vendor/

e2fsprogs-1.39-23.el5.x86_64

 \ No newline at end of file

Revision 12009-12-03 - igable

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="CanarieProjectNEP52"
Follow this: http://wiki.centos.org/HowTos/Custom_Kernel

Watch out for this bug when building: https://bugzilla.redhat.com/show_bug.cgi?id=512275

solution is to add

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback