How *Not* to Upgrade to Ubuntu 9.10 Karmic on Amazon EC2

| 7 Comments | 0 TrackBacks

WARNING!

Though most Ubuntu 9.04 Jaunty systems can upgrade to 9.10 Karmic in place, this is not possible on EC2 and should not be attempted. If you do try this, your system will become unusable on reboot and there will be no recovery and no access to any of the data on the boot disk or ephemeral storage.

Here’s why:

  • Ubuntu 9.10 Karmic has a version of udev which requires a newer kernel than you would be running for Ubuntu 9.04 Jaunty (especially on EC2).

  • You cannot upgrade the kernel used by a running instance on Amazon EC2 (not even rebooting).

  • When an EC2 instance cannot boot (as in the case of the udev/kernel mismatch) your only option is to terminate it, losing the local storage.

How To Upgrade

In order to upgrade to Karmic you will need to start a new EC2 instance running a fresh copy of the appropriate Karmic AMI. I post the latest AMI ids for Karmic in the second table on http://alestic.com/.

Keep your old instance(s) running while you configure and test the new Karmic instances. EC2 makes it easy to have multiple sets of servers running in parallel instead of upgrading in place. When you are confident your new servers are functioning properly, you can discard the old ones.

The Ubuntu 9.10 Karmic AMIs released by Canonical have a number of differences from the community Ubuntu AMIs which have been published on http://alestic.com.

One of the biggest differences is that you will ssh to ubuntu@ instead of to root@ on your instance. You can then sudo to perform commands as the root user. Back in April I wrote a guide about Using sudo, ssh, rsync on the Official Ubuntu Images for EC2.

The Ubuntu server team has put a lot of work into making Ubuntu 9.10 Karmic function beautifully on Amazon EC2 and it’s been a pleasure to have a small part in the process. I’m already using the Karmic AMIs on EC2 for one of my production processes. Please give these AMIs a spin and give feedback.

No TrackBacks

TrackBack URL: http://alestic.com/mt/mt-tb.cgi/55

7 Comments

Eric-

I noticed you retweeted somebody the other day claiming that Jaunty was "kicking Hardy's a**." And now I see you're using Karmic for at least one production scenario.

I'm running 2 medium instances on Alestic's Hardy: 1 for a basic webserver (Apache and Nginx) and 1 for MySQL. They boot up fast, and your latest fancy auto-snapshot stuff seems to be working great (funny that they released DBS just a week later... oh well).

So the question is, am I missing out on something fantastic that's in Jaunty or Karmic? I'd love your opinion!

Thanks,
-Jed

Jed: I run Jaunty on my laptop and experience a number of very serious very frequent problems (freezing, cold shutdowns, wireless network dropping out). I run Hardy on most of my EC2 servers and am very happy with its stability. I plan to upgrade to Karmic for my desktop and Lucid (the next LTS release in 10.04) for my servers.

For folks who are just starting out on EC2, I recommend trying Karmic first to see if it meets your needs given that Karmic has a modern Ubuntu kernel and is well maintained.

Great, thanks for the response Eric. Sticking with Hardy until Lucid sounds like a great idea (at least for my production servers).

Keep up all the great work! As several others have mentioned, you make it so that hacks like me can actually run a pretty decent operation through AWS.

Eric,
we have been very pleased with your 9.04 Ubuntu AMIs; we are using them on all of our test and production servers here at Extrabux at the moment. Are you planning on releasing 9.10 AMIs soon or would you recommend that we start using the Canonical AMIs instead? I'm a bit hesitant to make that switch since all of our tools and automation has been designed around the Alestic AMIs and it looks like the transition to the Canonical AMIs could introduce the need for tweaks that require more extensive testing.

Patrick: Glad to hear that the AMIs have been working for you. I have no plans to release base Karmic server AMIs at this time. Instead I have applied my efforts towards working with the Ubuntu server team in the development of the excellent Karmic AMIs that are now available. A big part of my work was to help make sure that the transition from the existing AMIs to the new AMIs would be as smooth as possible.

Eric,
thanks a lot for your reply. Do you have a post anywhere or could you give us an overview of the most important differences between your alestic AMIs and the Karmic AMIs that would affect integration with a current production system in particular as they relate to startup scripts, authentication, installed base packages, interaction with EC2, etc? (I know that the Karmic AMIs require you to log in as ubuntu instead of root, but do they handle startup scripts in the same way?)
Thanks!

--Patrick
http://www.extrabux.com

Patrick: Here's an overview of the differences I know about:
http://alestic.com/2009/04/official-ubuntu-ec2
Please post comments there if you find more.

Leave a comment

Stay Updated

Subscribe with email address:
 Subscribe with a reader
Join the EC2 Ubuntu Google Group
Follow Eric Hammond on Twitter

More Entries

Listing Recent Prices for EC2 Spot Instances
The new spot instances on EC2 are a great way to get some extra compute power at a price you…
Increasing Root Disk Size of an "EBS Boot" AMI on EC2
Amazon EC2’s new EBS Boot feature not only provides persistent root disks for instances, but also supports root disks larger…
Ubuntu Karmic Desktop on EC2
As Thilo Maier pointed out in comments on my request for UDS input, I have been publishing both server and…
Ubuntu Developer Summit - EC2 Lucid
For the last year I have been working with Canonical and the Ubuntu server team, helping to migrate over to…
New --mysql-stop option for ec2-consistent-snapshot
The ec2-consistent-snapshot software tries its best to flush and lock a MySQL database on an EC2 instance while it initiates…
Understanding Access Credentials for AWS/EC2
Amazon Web Services (AWS) has a dizzying proliferation of credentials, keys, ids, usernames, certificates, passwords, and codes which are used…
How *Not* to Upgrade to Ubuntu 9.10 Karmic on Amazon EC2
WARNING! Though most Ubuntu 9.04 Jaunty systems can upgrade to 9.10 Karmic in place, this is not possible on EC2…
1 TB of Memory in 1 Minute with 1 Command
Amazon Web Services just announced the release of two new instance types for EC2. These new types have 34.2 GB…
New Releases of Ubuntu and Debian Images for Amazon EC2 (Kernel, Security, PPA, runurl, Tools)
New updates have been released for the Ubuntu and Debian AMIs (EC2 images) published on: http://alestic.com The following notes apply…
Encrypting Ephemeral Storage and EBS Volumes on Amazon EC2
Over the years, Amazon has repeatedly recommended that customers who care about the security of their data should consider encrypting…
Creating Consistent EBS Snapshots with MySQL and XFS on EC2
In the article Running MySQL on Amazon EC2 with Elastic Block Store I describe the principles involved in using EBS…
Hidden Dangers in Creating Public EBS Snapshots on EC2
Amazon EC2 recently released a feature which lets you share an EBS snapshot so that other accounts can access it.…
Solving: "I can't connect to my server on Amazon EC2"
Help! I can’t connect to my EC2 instance! Woah! My box just stopped talking to me! Hey! I can’t access…
runurl - A Tool and Approach for Simplifying user-data Scripts on EC2
Many Ubuntu and Debian images for Amazon EC2 include a hook where scripts passed as user-data will be run as…
Presentation: Building Custom Linux Images for Amazon EC2
At the end of July, I gave a presentation at O’Reilly’s Open Source Convention (OSCON 2009) in San Jose. The…
New Releases of Ubuntu and Debian Images for Amazon EC2 (Tools, Security)
New updates have been released for the Ubuntu and Debian AMIs (EC2 images) published on: http://alestic.com The following notes apply…
Poll: Verifying ssh Fingerprint on EC2 Instances
When you ssh to a new EC2 instance, you are presented with the challenge: The authenticity of host 'XXX' can't…
EBS Snapshots of a MySQL Slave Database on EC2
At our company, CampusExplorer.com, we regularly snapshot the EBS volume which holds our MySQL database using the basic procedure I…
Matching EC2 Availability Zones Across AWS Accounts
Summary: EC2 availability zone names in different accounts do not match to the same underlying physical infrastructure. This article explains…
Does Your Product Help Users Build AMIs for Amazon EC2?
I will be speaking at the O’Reilly Open Source Convention (OSCON 2009) next week, giving a presentation on building custom…