openqrm uec ec2 howto
TRANSCRIPT
-
7/28/2019 Openqrm Uec Ec2 Howto
1/83
The perfect server: openQRM, UEC and EC2 on Ubuntu 10.10
This documentation is brought to you by openQRM Enterprise
http://www.openqrm-enterprise.com
Document Version : 27.10.2010openQRM Enterprise GmbHBerrenrather Strae 188c50937 Kln / GermanyTelefon : +49 (0) 221 995589-10
Fax : +49 (0) 221 995589-20Mail : [email protected]
Table of Contents
The perfect server: openQRM, UEC and EC2 on Ubuntu 10.10 ..............................................................1Hybrid Cloud Computing with openQRM.................................................................................................2
Requirements.........................................................................................................................................2
Install the system with Ubuntu 10.10 (64bit) as a "Node Controller" ..................................................2Install openQRM from the source repository........................................................................................3Install the Ubuntu Enterprise Cloud Controller in a KVM VM............................................................8Configure the Ubuntu Enterprise Cloud .............................................................................................43Import an AMI from the Ubuntu Enterprise Cloud (or Amazon EC2) ..............................................50Run the imported AMI on a local KVM VM .....................................................................................64Export an openQRM Image to Amazon EC2 .....................................................................................76Thanks.................................................................................................................................................83Urls......................................................................................................................................................83
http://www.openqrm-enterprise.com/http://www.openqrm-enterprise.com/ -
7/28/2019 Openqrm Uec Ec2 Howto
2/83
Hybrid Cloud Computing with openQRM
The goal of this HowTo is to have a single system setup with the Ubuntu Enterprise Cloud(UEC) and the openQRM Cloud. This system will allow to migrate services from the UEC andAmazon EC2 to the openQRM Cloud and from openQRM Cloud to UEC and Amazon EC2.
Requirements
- 1 64bit system having the VT (Virtualization Technology) CPU extension- 2 GB RAM (or more)
- 200 GB disk space (or more)
Install the system with Ubuntu 10.10 (64bit) as a "Node Controller"
Boot the system from the Ubuntu CD
Select "Install Ubuntu Enterprise Cloud"
Set a static ip-address
in this Howto it will be 192.168.88.100, hostname will be "perf"
Continue with an empty (blank) Cloud Controller address
During the Cloud package selection just select "Node Controller"
deselect everything else
In the partitioning screen Create a partiton (primary) for /
in this Howto it will be /dev/sda1
Create a partition (primary) for swap
in this Howto it will be /dev/sda2
Create a partition (primary) to be used by lvm
this should be huge, in this Howto it will be /dev/sda3
After the installation finished reboot into the fresh Ubuntu 10.10 system.
Now create a iso image from the Ubuntu 10.10 CD. Insert the CD, open a terminal and run :
sudo bashmkdir /isosdd if=/dev/cdrom of=/isos/ubuntu-10.10.iso
-
7/28/2019 Openqrm Uec Ec2 Howto
3/83
Install openQRM from the source repository
Installing openQRM from the projects subversion repository will include the latest features.
sudo bash
apt-get install subversion nfs-kernel-servercdmkdir openqrmcd openqrmsvn co https://openqrm.svn.sourceforge.net/svnroot/openqrm openqrmcd trunk/openqrm/srcmake && make install && make start
Then point your browser to http://192.168.88.100/openqrm to finalize the openQRM Serverconfiguration. The default username and password after a fresh installation is "openqrm" (foruser + pass). Please make sure you update this default password after first login !
In the first setup screen please select "br0" as the openQRM interface.
-
7/28/2019 Openqrm Uec Ec2 Howto
4/83
In the following screen pick "mysql"
-
7/28/2019 Openqrm Uec Ec2 Howto
5/83
and in the final screen provide the mysql connection parameters.
-
7/28/2019 Openqrm Uec Ec2 Howto
6/83
After successful initialization it will forward you to the Datacenter Dashboard.
-
7/28/2019 Openqrm Uec Ec2 Howto
7/83
Now we are going to enable the required openQRM plugins for this HowTo.
Enable and start the following plugins :
kvm, kvm-storage, lvm-storage, hybrid-cloud, tftpd
Just enable the "dhcpd" plugin. Do not start it (yet) !
-
7/28/2019 Openqrm Uec Ec2 Howto
8/83
We are mpw going to install the Ubuntu Enterprise Cloud Controller within a virtual machinemanaged by openQRM. The virtual-machine type for the UEC CC will be "kvm-storage".
Install the Ubuntu Enterprise Cloud Controller in a KVM VMFirst we need to prepare the partition dedicated as our image store (/dev/sda3).Open a terminal and run the following commands :
sudo bashpvcreate /dev/sda3vgcreate lvols /dev/sda3
-
7/28/2019 Openqrm Uec Ec2 Howto
9/83
Now we are going to prepare the volume to install the UEC CC on.
Goto Base -> Components -> Storage -> New Storage
-
7/28/2019 Openqrm Uec Ec2 Howto
10/83
Create a new kvm-storage server (type KVM LVM Storage) using the openQRMsystem as the resource
-
7/28/2019 Openqrm Uec Ec2 Howto
11/83
Provide a name for the kvm-storage server, here we will use "kvmstorageserver"
-
7/28/2019 Openqrm Uec Ec2 Howto
12/83
Goto Base -> Components -> Storage and click on "Mgmt" of the kvm-storage
Select the "lvols" volume group
-
7/28/2019 Openqrm Uec Ec2 Howto
13/83
Create a new volume for the UEC "Cloud Controller" on the kvm-storage server.
Name it "ubuntucc" and give it at least 40GB volume size.
-
7/28/2019 Openqrm Uec Ec2 Howto
14/83
From this volume we now need to create an openQRM "image"
-
7/28/2019 Openqrm Uec Ec2 Howto
15/83
Goto Base -> Components -> Image -> New Image
Select the kvm-storage server "kvmstorageserver"
-
7/28/2019 Openqrm Uec Ec2 Howto
16/83
Povide a name for the "image" object, here we will use "ubuntucc"
-
7/28/2019 Openqrm Uec Ec2 Howto
17/83
Here the Image list after we have created the Image object.
Now we are going to prepare the VM resource for the UEC CC.
-
7/28/2019 Openqrm Uec Ec2 Howto
18/83
Create the kvm-storage Hosts
Goto Base -> Appliance -> Create and create a new kvm-storage Host applianceusing the openQRM system as the resource
-
7/28/2019 Openqrm Uec Ec2 Howto
19/83
Provide a name for the appliance, here we will use "kvmstoragehost"
Select "KVM-Storage Host" as the resource type
-
7/28/2019 Openqrm Uec Ec2 Howto
20/83
Here the fresh created KVM-Storage Host in the Appliance overview.
-
7/28/2019 Openqrm Uec Ec2 Howto
21/83
Create a new kvm-storage VM:
Goto Plugins -> Virtualization -> kvm-storage -> VM-Manager
Select the kvm-storage Host
-
7/28/2019 Openqrm Uec Ec2 Howto
22/83
Create a new kvm-storage VM on the Host by clicking on the + icon
-
7/28/2019 Openqrm Uec Ec2 Howto
23/83
Provide a name for the VM, here we will use "kvmstoragevm1"
Set the VMs memory to at least 1024 MB
Select "iso image" as the boot-medium and fill in the path to the ubuntu-10.10.iso
/isos/ubuntu-10.10.iso
-
7/28/2019 Openqrm Uec Ec2 Howto
24/83
Creating the VM will reserve the VMs components and create a new, idle resource.
-
7/28/2019 Openqrm Uec Ec2 Howto
25/83
Here the resource overview after creating the VM
-
7/28/2019 Openqrm Uec Ec2 Howto
26/83
Now we will put the "image" and the "resource" we have created together via an "appliance".
Goto Base -> Appliance -> Create
Select the new created "idle" resource (the kvm-storage VM)
-
7/28/2019 Openqrm Uec Ec2 Howto
27/83
Provide a Name for the appliance, here we will use "ubuntucc"
Leave the default kernel
Select the "ubuntucc" image
Select the resource type "KVM-Storage VM"
-
7/28/2019 Openqrm Uec Ec2 Howto
28/83
Save and start the appliance
-
7/28/2019 Openqrm Uec Ec2 Howto
29/83
Here the started appliance
The idle resouce will now boot into the Ubuntu installation accessible via VNC .
Install vncviewer :
sudo bash apt-get install xtightvncviewer
-
7/28/2019 Openqrm Uec Ec2 Howto
30/83
You can access the Install screen via "vncviewer" on the openQRM Server.
vncviewer 192.168.88.100:50
Hints
For kvm-storage VMs the first VNC id will be 50
If you are logged in via ssh you need to have X-forwarding enabled
e.g. ssh -X openqrm
A remote VM console integrated into openQRM is available from openQRM Enterprise http://www.openqrm-enterprise.com
-
7/28/2019 Openqrm Uec Ec2 Howto
31/83
For the Ubuntu Enterprise Cloud Controller installation follow the steps below :
Select "Install Ubuntu Enterprise Cloud"
Manually configure the network device. Set a static ip-address
in this HowTo it will be 192.168.88.101, hostname ubuntucc)
-
7/28/2019 Openqrm Uec Ec2 Howto
32/83
Otherwise go with the defaults installation parameters
Later in the installation setup the ip-addresses to be used by UEC
In this Howto this will be 192.168.88.102-192.168.88.122
Rebot after the installation of the Ubuntu Enterprise Cloud Controller.
Please notice : The VM will now still try to boot from the CD and fail !This is because the VM is still configured to boot from the iso image.
Please see the next part how to re-configure the VM to boot from local disk.
-
7/28/2019 Openqrm Uec Ec2 Howto
33/83
Before we will boot the now ready installed Ubuntu Enterprise Cloud Controller we will createa snapshot of its disk. Then we will re-configure the "ubuntucc" appliance to use the snapshotinstead of the origing volume. This enables you to roll-back at any time in case you need afresh Cloud Controller.
Here how to create the snapshot : Goto Base -> Appliance and stop the ubuntucc appliance
-
7/28/2019 Openqrm Uec Ec2 Howto
34/83
Goto Base -> Components -> Storage and click on "Mgmt" of the kvm-storage
Select the "lvols" volume group
Fill in a snapshot name (here "ccsnapshot1" and provide a size, here 20GB).
Click on "snap"
-
7/28/2019 Openqrm Uec Ec2 Howto
35/83
Here the volume list after we have created the snapshot
-
7/28/2019 Openqrm Uec Ec2 Howto
36/83
Now we have to create a new Image from the snapshot volume:
Goto Base -> Components -> Image -> New Image
Select the kvm-storage server "kvmstorageserver"
Povide a name for the new "image" object, here we will use "ccsnapshot1" and
select the "ccsnapshot1" volume as the root-device
-
7/28/2019 Openqrm Uec Ec2 Howto
37/83
Goto Base -> Appliance and edit the ubuntucc appliance
Adjust the Root-device to the ccsnapshot1 image and save
-
7/28/2019 Openqrm Uec Ec2 Howto
38/83
Now re-configure the VM to do a localboot :
Goto Plugins -> Virtualization and stop the VM
-
7/28/2019 Openqrm Uec Ec2 Howto
39/83
When the VM is stopped click on "Config"
In the config screen edit the boot-order
-
7/28/2019 Openqrm Uec Ec2 Howto
40/83
Set the boot-order to "local boot"
Click on back to go to the Virtual Machine list
-
7/28/2019 Openqrm Uec Ec2 Howto
41/83
Start the VM again
-
7/28/2019 Openqrm Uec Ec2 Howto
42/83
Goto Base -> Appliance and start the ubuntucc appliance again
You can now access the VM again via "vncviewer" on the openQRM Server.
vncviewer 192.168.88.100:50
to check its boot-up from local disk.
-
7/28/2019 Openqrm Uec Ec2 Howto
43/83
Configure the Ubuntu Enterprise Cloud
You can now access the UEC Configuration Panel at https://192.168.88.101:8443
The first time when connecting it will tell in the browser "This Connection is Untrusted".Add an exception for it and it will forward you to the login panel.
The default login for the UEC is user "admin" with the password "admin".
-
7/28/2019 Openqrm Uec Ec2 Howto
44/83
Now it is a good time to download your UEC Cloud credentials.
-
7/28/2019 Openqrm Uec Ec2 Howto
45/83
Here how to install the credentials on your openQRM Server. Please open a terminal andrun :
mkdir .eucamv euca2-admin-x509.zip .euca/cd .euca/unzip euca2-admin-x509.zip. eucarc
-
7/28/2019 Openqrm Uec Ec2 Howto
46/83
After that you are able to use the UEC commandline tools e.g. euca-describe-availability-zones
Next step is to set the password for user "eucalyptus" on the openQRM server which is also aUEC Node Controller.
sudo bashpasswd eucalyptus
We need to have this in the following step on the UEC system itself to discover the NodeController.
Login to the UCE Cloud Controller (the VM at 192.168.88.101) and run :
sudo euca_conf --discover-nodes
This will automatically rsync the ssh-keys and add the Node Controller to the UEC cluster.
-
7/28/2019 Openqrm Uec Ec2 Howto
47/83
Now we go back to the UEC Admin UI and download one of the pre-made UEC Images.For this HowTo we selected the Ubuntu Karmic 10.04 64bit. Clicking on Download willdownload and install the image in the UEC Cloud.
Before we actually start an instance of this AMI we need to create a ssh keypair an open port22 on the UEC firewall to enable ssh login.On the openQRM Server open a terminal and run :
. .euca/eucarc
euca-add-keypair mykey > ~/.euca/mykey.priveuca-authorize -P tcp -p 22 -s 0.0.0.0/0 default
-
7/28/2019 Openqrm Uec Ec2 Howto
48/83
Starting an instance on the UEC Cloud
Now we are going to start an instance on the Ubuntu Enterprise Cloud via the euca-run-
instances command.
Open a terminal on the openQRM server and follow the steps below :
. .euca/eucarceuca-run-instances -k mykey emi-DEBF106A -t m1.small
Please notice that you need to get the AMI name (here emi-DEBF106A) from the imageoverview in UEC.
After a short while the instances is running and we can login via ssh.
ssh -i .euca/mykey.priv [email protected]
-
7/28/2019 Openqrm Uec Ec2 Howto
49/83
To prepare the Import of this AMI into openQRM we now need to adjust the/root/.ssh/authorized_keys file on the AMI.
Simply cat the /home/ubuntu/.ssh/authorized_keys to /root/.ssh/authorized_keys to enablepasswordless ssh login for the root user too.
-
7/28/2019 Openqrm Uec Ec2 Howto
50/83
Import an AMI from the Ubuntu Enterprise Cloud (or Amazon EC2)
First step to import from the Ubuntu Enterprise Cloud is to define the UEC credentials in
openQRM.
Goto Plugins -> Components -> Deployment -> Hybrid-Cloud -> Accounts
Provide an Account name (you can choose any name)
Set the path to the UEC rc-config file
Set the path to the ssh-key file
Set the type of the account
-
7/28/2019 Openqrm Uec Ec2 Howto
51/83
Second step for importing the AMI of the running instance is to create a volume on storageserver in openQRM.
Create a lvm-storage (NFS) server in openQRM Goto Base -> Components -> Storage -> New Storage
Create a new lvm-storage server (type LVM Storage NFS) using the openQRMsystem as the resource
-
7/28/2019 Openqrm Uec Ec2 Howto
52/83
Provide a name for the lvm-storage server, here we will use "lvmstorageserver"
-
7/28/2019 Openqrm Uec Ec2 Howto
53/83
Here the Storage list in openQRM after we added the new storage
-
7/28/2019 Openqrm Uec Ec2 Howto
54/83
Goto Base -> Components -> Storage and click on "Mgmt" of the lvm-storage
Select the "lvols" volume group
-
7/28/2019 Openqrm Uec Ec2 Howto
55/83
Create a new volume to import the AMI to.
Name it "uecubuntuimport" and give it at least 2000MB volume size.
-
7/28/2019 Openqrm Uec Ec2 Howto
56/83
Here the volume list after we have created the volume
-
7/28/2019 Openqrm Uec Ec2 Howto
57/83
Now we have to create a new Image from the new empty volume:
Goto Base -> Components -> Image -> New Image
Select the lvm-storage server "lvmstorageserver"
-
7/28/2019 Openqrm Uec Ec2 Howto
58/83
Povide a name for the new "image" object, here we will use "uecubuntuimport" andselect the "uecubuntuimport" volume as the root-device
Everything is prepared for the import.
-
7/28/2019 Openqrm Uec Ec2 Howto
59/83
Import the AMI
Goto Plugins -> Deployment -> Hybrid-Cloud -> Import
Select your UEC account
-
7/28/2019 Openqrm Uec Ec2 Howto
60/83
On the next screen select the running instance on the UEC
-
7/28/2019 Openqrm Uec Ec2 Howto
61/83
On the next screen select the Image to transfer the AMI to and click on "put"
-
7/28/2019 Openqrm Uec Ec2 Howto
62/83
-
7/28/2019 Openqrm Uec Ec2 Howto
63/83
openQRM will now import the AMI. You can check the Event list for the progress.
-
7/28/2019 Openqrm Uec Ec2 Howto
64/83
Run the imported AMI on a local KVM VM
For running the imported AMI please now start the dhcpd plugin
Please notice that you make sure to only have one dhcp-server running in your setup!Eiher have openQRM serving dhcp or the UEC Cloud Controller.
-
7/28/2019 Openqrm Uec Ec2 Howto
65/83
Now create a kvm Hosts:
Goto Base -> Appliance -> Create and create a new kvm Host appliance using theopenQRM system as the resource
-
7/28/2019 Openqrm Uec Ec2 Howto
66/83
Provide a name for the appliance, here we will use "kvmhost"
Select "KVM Host" as the resource type
-
7/28/2019 Openqrm Uec Ec2 Howto
67/83
Create a new KVM VM:
Goto Plugins -> Virtualization -> kvm -> VM-Manager, select the kvm Host
-
7/28/2019 Openqrm Uec Ec2 Howto
68/83
Create a new kvm VM on the Host by clicking on the + icon
-
7/28/2019 Openqrm Uec Ec2 Howto
69/83
Provide a name for the VM, here we will use "kvmvm1"
-
7/28/2019 Openqrm Uec Ec2 Howto
70/83
Creating the VM will reserve the VMs components and create a new, idle resource.
-
7/28/2019 Openqrm Uec Ec2 Howto
71/83
Now we will put the "image" (the imported AMI) and the "resource" we have created (the newKVM VM) together via an "appliance".
Goto Base -> Appliance -> Create Select the new created "idle" resource (the idle kvm VM)
-
7/28/2019 Openqrm Uec Ec2 Howto
72/83
Provide a Name for the appliance, here we will use "uecubuntuimport"
Leave the default kernel
Select the "uecubuntuimport" image
Select the resource type "KVM VM"
-
7/28/2019 Openqrm Uec Ec2 Howto
73/83
Save and start the appliance
The idle resouce will now reboot and start the "uecubuntuimport" image. The VM is nowaccessible via VNC
vncviewer 192.168.88.100:1
Hints- For kvm VMs the first VNC id will be 1
-
7/28/2019 Openqrm Uec Ec2 Howto
74/83
Here a screenshot of the started appliance in openQRM
-
7/28/2019 Openqrm Uec Ec2 Howto
75/83
You can ssh to the running appliance in the same way as we did for the AMI.
ssh -i .euca/mykey.priv [email protected]
Please get the ip of the appliance in the openQRM resource overview.
The imported AMI, now available in openQRM as an Image, can be easily made available inthe openQRM Cloud.
HowTo setup and use the openQRM Cloud is covered in another Howto at :http://www.openqrm-enterprise.com/news/details/article/howto-setup-your-own-openqrm-cloud-with-kvm-on-ubuntu-lucid-lynx.html
http://www.openqrm-enterprise.com/news/details/article/howto-setup-your-own-openqrm-cloud-with-kvm-on-ubuntu-lucid-lynx.htmlhttp://www.openqrm-enterprise.com/news/details/article/howto-setup-your-own-openqrm-cloud-with-kvm-on-ubuntu-lucid-lynx.htmlhttp://www.openqrm-enterprise.com/news/details/article/howto-setup-your-own-openqrm-cloud-with-kvm-on-ubuntu-lucid-lynx.htmlhttp://www.openqrm-enterprise.com/news/details/article/howto-setup-your-own-openqrm-cloud-with-kvm-on-ubuntu-lucid-lynx.html -
7/28/2019 Openqrm Uec Ec2 Howto
76/83
Export an openQRM Image to Amazon EC2
To export an openQRM Image to Amazon EC2 (or to an Ubuntu Enterprise Cloud) we firsthave to install the Amazon ec2-ami-tools and ec2-api-tools.
Download the Amazon EC2 API Tools from http://aws.amazon.com/developertools/351Download the Amazon EC2 AMI Tools from http://aws.amazon.com/developertools/368
Install both tools on the openQRM Server at /home/[username]/aws
cdmkdir -p aws .ec2cp ec2-ami-tools.zip ec2-api-tools.zip awscd awsunzip ec2-ami-tools.zipunzip ec2-api-tools.zip
Please make sure to have a java jdk installed. Also you need to install ruby and curl.
sudo apt-get install ruby curl
The ec2-tools require this.
Next step is to create a Amazon rc-config file allowing the ec2-tools to work seamlessly.A sample ec2rc config file looks like this (of course this example contains random user data):
# for java to work ok
export JAVA_HOME=/home/matt/java/jdk1.6.0_14# aws api toolsexport EC2_HOME=/home/matt/aws/ec2-api-tools-1.3-57419# aws ami toolsexport EC2_AMITOOL_HOME=/home/matt/aws/ec2-ami-tools-1.3-57676export EC2_PRIVATE_KEY=/home/matt/.ec2/pk-123456.pemexport EC2_CERT=/home/matt/.ec2/cert-123456.pem# EUexport EC2_URL=https://ec2.eu-west-1.amazonaws.com# US#export EC2_URL=https://us-east-1.ec2.amazonaws.com
# keysexport EC2_ACCESS_KEY='123456'export EC2_SECRET_KEY='123456'
export PATH=$JAVA_HOME/bin:$PATH:$EC2_HOME/bin:$EC2_AMITOOL_HOME/bin:/usr/games:/home/matt/scripts
# aws user id for the cmdline toolsexport EC2_USER_ID="123456"
-
7/28/2019 Openqrm Uec Ec2 Howto
77/83
Please save content as /home/[username]/.ec2/ec2rc
Also please download your AWS Private-key and your AWS Certificate to /home/[username]/.ec2/
After that please source the ec2rc and check the functionality of the ec2-tools by runningec2-describe-regions.
-
7/28/2019 Openqrm Uec Ec2 Howto
78/83
With the Amazon account credentials installed we are now setting up another Hybrid-Cloudaccount.
Goto Plugins -> Components -> Deployment -> Hybrid-Cloud -> Accounts
Provide an Account name (you can choose any name)
Set the path to the EC2 rc-config file
Set the path to the ssh-key file
Set the type of the account
-
7/28/2019 Openqrm Uec Ec2 Howto
79/83
Now we are ready to export the openQRM Image.
Goto Plugins -> Deployment -> Hybrid-Cloud -> Import
Select your EC2 account
-
7/28/2019 Openqrm Uec Ec2 Howto
80/83
On the next screen select the Image to transfer to Amazon
-
7/28/2019 Openqrm Uec Ec2 Howto
81/83
On the next screen provide a S3 bucket name for the AMI and configureregion, size and architecture.
-
7/28/2019 Openqrm Uec Ec2 Howto
82/83
Clicking on "export" will start the migration.
openQRM is now transferring the Image to the Amazon Cloud as a new AMI.It will be available for deployment after bundling and uploading the AMI finished.
You can get a detailed log about the migration at /tmp/uecubuntuexport.export.debug.log.
tail -f /tmp/uecubuntuexport.export.debug.log
Same as for the Import you can also check the Event list for the progress.
As soon as the migration finished the exported openQRM Image will be available at theAmazon EC2 Cloud. You can start it e.g. via the EC2 commadline tools on the openQRMServer. Open a terminal an run :
. /home/[username]/.ec2/ec2rcec2-run-instances [ami-name] -k [ssh-keypair]
-
7/28/2019 Openqrm Uec Ec2 Howto
83/83
Thanks
We hope you enjoyed this Howto with the focus on the hybrid-cloud features of openQRM !
Urls
UEC Installation Howto - https://help.ubuntu.com/community/UEC/CDInstallThe openQRM Project http://www.openqrm.comopenQRM Enterprise http://www.openqrm-enterprise.comopenQRM Documentation - http://www.openqrm-enterprise.com/news/details/article/in-depth-documentation-of-openqrm-available.htmlopenQRM Cloud HowTo - http://www.openqrm-enterprise.com/news/details/article/howto-setup-your-own-openqrm-cloud-with-kvm-on-ubuntu-lucid-lynx.html
This documentation is brought to you by openQRM Enterprise
http://www.openqrm-enterprise.com
https://help.ubuntu.com/community/UEC/CDInstallhttp://www.openqrm.com/http://www.openqrm-enterprise.com/http://www.openqrm-enterprise.com/news/details/article/in-depth-documentation-of-openqrm-available.htmlhttp://www.openqrm-enterprise.com/news/details/article/howto-setup-your-own-openqrm-cloud-with-kvm-on-ubuntu-lucid-lynx.htmlhttp://www.openqrm-enterprise.com/http://www.openqrm-enterprise.com/http://www.openqrm-enterprise.com/news/details/article/in-depth-documentation-of-openqrm-available.htmlhttps://help.ubuntu.com/community/UEC/CDInstallhttp://www.openqrm.com/http://www.openqrm-enterprise.com/http://www.openqrm-enterprise.com/news/details/article/howto-setup-your-own-openqrm-cloud-with-kvm-on-ubuntu-lucid-lynx.html