Virtualization In Linux Kernel 2.6.20 178
mcalwell writes with an article about the Kernel-based Virtual Machine (or KVM for short) in the release candidate Linux 2.6.20 kernel. From the article: "[T]he Linux 2.6.20 kernel will include a full virtualization (not para-virtualization) solution. [KVM] is a GPL software project that has been developed and sponsored by Qumranet. In this article we are offering a brief overview of the KVM for Linux as well as offering up in-house performance numbers as we compare KVM to other virtualization solutions such as QEMU Accelerator and Xen."
Comment removed (Score:3, Interesting)
Re: (Score:3, Informative)
Re: (Score:3, Informative)
If you search the kernel archives for ext3 corruption you'll find a couple long threads discussing the issue and the solution.
Re: (Score:2, Informative)
'So go get it. It's one of those rare "perfect" kernels.'
that wasn't a bad kernel (Score:2)
I think it got renamed to something like linux-1.1.44-do-not-use on the FTP site.
Re:Oddness in kernel release cycle (Score:5, Informative)
No, the attention has been drawn from people actually giving a fuck.
Kernels from 2.6.9 onwards are a disaster.
The original idea was that "distributions will fork off and maintain kernel for releases". This idea has degenerated into "only distributions can fork and maintain a kernel". Sole developers and hobbyists are being treated the same way Microsoft treats them - as a "one night stand". In fact, even distributions are unable to keep up with that. Fedora has half of these bugs in it. So does etch, so does mandriva and all other lesser distributions. Only RHELL and Suse ship something reasonably useable and it is 1 year behind on features.
Reality is that anything past 2.6.9 should be called 2.7.x and that is it. And it may be seriously worth it to consider Gentoo/BSD or Debian/BSD. While the BSD crowd has its own failings, it does not change fundamental APIs for entertainment purposes every month on the stable branch.
Re: (Score:3, Funny)
Mod... Parent... Up (Score:5, Insightful)
Anyone other than SLES or RHEL is a second class Linux citizen today. Without vendor support you can forget about trying to run a stable Linux kernel anymore. Bring back the old odd / even split!
Re: (Score:2, Interesting)
Just use Solaris. You get to run all the Lunix source and binaries and all the Solaris ones too, the ABI is stable over many years and it has many more useful feaures than Lunix. Also the virtualisation stuff has been in Solaris a lot longer. Oh, and it handles SMP and NUMA better, and it has ZFS.
Re:Mod... Parent... Up (Score:4, Informative)
Well, first off there's CentOS if you don't need the support. Secondly, while the kernel guys are happy hacking away at 2.6.x, there are other distributions like Debian and Ubuntu LTS which will support a stable API/ABI for several years.
Yes, now 2.6 keeps breaking but does anyone remember the bad old days when distros were backporting hundreds of patches from 2.5 to 2.4? What the distros are shipping now is closer to a vanilla kernel, for better and for worse. They pick one version, stay with it and stabilize it. That'll what SLES, RHEL and all the other distros do.
Re: (Score:2)
With that said, what is the cost of these distros providing long term support? Firstly, there is more and more divergence between the distros over time. The patches that each comes up with the backport specific security features will be different, if only slightly. The patches that each comes up with to backport a highly requested feature will be slightly different. Over time these slight differences will add up to become real differences between the
Re:Mod... Parent... Up (Score:5, Insightful)
The patches that each comes up with the backport specific security features will be different, if only slightly. The patches that each comes up with to backport a highly requested feature will be slightly different. Over time these slight differences will add up to become real differences between the distros.
Distros should NEVER backport features. That's the whole point of the new development system. If you want a stable kernel stay with the point release your on and just add the security/stabillity patches. If you want new features use a newer kernel.
That right there was the exact problem with the old even/odd split. The time between the two ended up being so great that people/vendors would start backporting features and destabilizing the "stable series" kernel.
Distros forking the kernel has always been an annoyance so it's nothing new either. I've been playing the "wich distro has the drivers I need" game since 2.0.x and it got to the point where I just never use distro kernels anymore I just compile my own and add that to the installer.
sometimes kernels break stuff (Score:2)
That's a fine strategy if newer kernels don't break existing features. But they do because testing is a really hard problem so it doesn't get done well enough.
Some kernel bugs get introduced in x.y.z and don't get resolved until z+4 (or longer!). Depending on th
Re: (Score:2)
I don't want to have to pay $1500 for RHEL, but that's the only way I can run an Oracle dev server on a quad box with 16GB ram.
couldn't you just download 50CentOS?
Re: (Score:3, Funny)
Then you keep getting free all that work he's paying for
Re: (Score:2)
RH wouldn't even give us a test Satellite license, so we had two choices - fork out ANOTHER 8k or do all upgrades without testing. Obviously option 2 wasn't viable (if for no other reason than audit points) so we shelled the cash.
We could just use dev mac
Re: (Score:3, Informative)
http://en.wikipedia.org/wiki/Linux_kernel#Versions [wikipedia.org]
The fact that most people don't seem to run 2.6.16 seems to indicate that people are happy to forgo some stability in exchange for having the new features in the latest 2.6.x kernel available now.
Re: (Score:2)
With 2.6.x.y, only fixes to that kernel are added. No new features are added. Ever.
With the 2.even.x tree, new features were added, but they were stabilised first. The aim (although not always achieved, see NPTL threads for example) was to NOT break the API / ABI during the life of that kernel series. So if I had a driver or a piece of software that worked on 2.4.1, it should STILL work on
quit your FUD, it's getting old (Score:5, Insightful)
I think your real complaint is that out-of-tree drivers are unsupported. Tough luck. This will never change. I suggest that you get your drivers into the tree, where other people can review them for bugs (afraid of that? embarrased?) and update them as the rest of the kernel changes.
Re: (Score:2)
Re: (Score:2)
You mean where people who don't understand them can make "suggestions". See all those rants by Hans. Whatever else you think of him, he's got a point when it comes to that.
Re: (Score:2)
Why do you think enterprises still rely so heavily on Sun? It's partly because a driver made for Solaris 8 will still work on Solaris 8 later. You don't get that guarantee with many Linux distros.
I have no drivers to be afraid or embarrassed about, but if you think that is the only thing stopping companies open sourcing their drivers then you have a lot to learn about
Indeed. Theres are reasons Slackware is still 2.4 (Score:2)
Re: (Score:3, Informative)
IDE-SCSI no longer works from 2.6.10 onwards at least up to 2.6.16
IDE-SCSI never worked properly. I've had constant problems with it since I started CD burning on Linux. Thankfully it is now obsoleted by the new ATA drivers since the ATA devices just shows up on the system as a SCSI device. If you really need to have SCSI support for IDE devices I highly suggest trying the new drivers.
Re: (Score:2)
Perhaps its time to stop the Linus-worship anyway, and go with the HURD:
http://www.gnu [gnu.org]
Re: (Score:2)
From the page you linked, under "Status of the project":
Re: (Score:2)
The linux kernel is fast becoming another piece of black-box software. Even if it remains open-source, it certainly isn't free (as in speech) software. I've even read that most Linux kernel developers don't even agree with the basic philosophy of OSS.
If we can no longer trust Linux, and HURD is practically useless, where will our kernel come from?
Re: (Score:2)
Exactly, so people went and did just that.
Changing the API was what the hacking consisted of. There's only so much you can improve while keeping everything looking the same.
Yes, we drop support for obsolete crap. (Score:3, Informative)
The IDE-SCSI abomination is a foul and evil hack that should have been removed many years ago. Back in the early days, it was needed for CD burning. Linux no longer requires IDE-SCSI. If the cdrecord author told you otherwise... well, he was lying because he damn well knows this isn't true.
Your "fundamental APIs" are not APIs at all. They are kernel-internal details. Screwing around with unmaintai
Re: (Score:2)
If the driver is broken and nobody wants to maintain it, it should be marked obsolete or simply removed.
Re: (Score:3, Informative)
It's ironic that you mention IDE-SCSI as not working. The latest excitement is that devices that used to be treated as IDE are now being treated as SCSI if you build the appropriate drivers, so people are finding that the drives they thought were "IDE" are actually "ATA", and on
Re: (Score:2, Informative)
Re:Oddness in kernel release cycle (Score:5, Insightful)
Re: (Score:3)
I really, really wish they'd go back to the "proper" even stable, odd development cycle. Distros had a chance then and could backport what they wanted from the development tree.
Re: (Score:2)
Re: (Score:2)
BSD? Hardware support is even more lacking.
OS/2 is not around any more (and for all practical purposes, has been dead for ten years now)
Windows? Not a chance, unless you want to be "pwned" by every script kiddie who discovers 1337 IRC hacking channels. Oh sure, it's quick and easy to set up, and downtime is less if you use Microsoft-Brand Downtime as your definition of downtime, but maintenance is more of a bear. Sure, you can turn to ugly hacks like VBS and making calls to CO
Re: (Score:2)
Re: (Score:3, Informative)
I'm not sure in general, but I've been happily using 2.6.19 for a while with no issues.
As for kvm, I downloaded it about a week ago and manually built and installed it (on 2.6.19), and I've had no trouble with it at all. It was very easy to build and install following the instructions [sourceforge.net], and creating images and installing a new os on them is trivial. I set up a couple of images for experimenting with ubuntu and fedora (my main os is gentoo), and I set up another image on which I installed Plan 9, just to pl
Simple Q: will this run Win XP as a guest? (Score:2, Insightful)
Re:Simple Q: will this run Win XP as a guest? (Score:5, Informative)
After playing around with paravirtualization with Xen for the past two+ years, I finally got the cash in August to buy a cheapo AMD dual-core 64-bit system (~$800 at Best Buy: an HP system with a 4200 and 2 gigs of DDR2 RAM). I've run both Xen and QEMU on it under 64-bit Gentoo Linux. The performance of Windows XP on Xen vs. QEMU is fairly close. I would have to say that it seems to me that where Xen suffers is disk I/O. Anything that's disk intensive seems to eat up the CPU. I suspect this wouldn't be the case on better hardware with a high performance SCSI/RAID system. That should, at least, make things a bit better anyway. But for the time being I'm sticking with Xen since it's just too easy to use. And I am especially interested in the live migration features. As long as you have centralized disk storage, you can move live VMs between physical hosts with less than a second of interruption (ie. your users will never notice). Keep in mind, I'm doing this all at home as I'd really like to collapse many of my machines into one or two boxes and keep everything else as simple X displays where GUIs are needed. I've currently got four VMs running on the box with two of them being fully virtualized (Windows XP SP2 for access DRMed crap and Redhat Linux 7 which still hosts some services I don't want to part with) and the other two being paravirtualized (Domain0 which is just the VM management environment and my Gentoo Asterisk "PBX"). PAravirtualized performance is damn amazing. I think if I used strictly paravirtualized OSes I could probably squeeze out 20 VMs from this guy with decent performance. I actually just added two more gigs to the system tonight, and if I assume 128 megs per virtual machine (I've allocated 512M to the Windows XP VM) I can get up to 32 VMs running simultaneously.
As far as KVM goes, I've had a good deal of experience with QEMU and it KVM is similar, there are some limitations I hope they will overcome. (For what it's worth, the hardware based virtualization in Xen is also a modified QEMU process called qemu-dm) The main one being PCI device allocation. Xen allows you to partition your PCI devices and assign individual cards to specific VMs. I don't think QEMU does this, and I expect that KVM doesn't either.
Re: (Score:2)
I don't understand why that would be. A disk is slow - glacial - by processor standards. The disk I/O subsystem should submit a request to the disk, then free up the kernel/system to go off and do other things. "other things" may eventually become "wait around for the disk subsystem", but I thought that would show up as idle time.
Asterisk in a virtual machine? (Score:2)
Asterisk is a real-time process. It expects to wake up 1000 times per second, exactly, on time every time.
Surely you're getting massive drop-out problems.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Yes, it improves significantly when using a native partition. I use Xen in the enterprise, using software raid + LVM to create partitions for Xen. There are also users on the Xen lists reporting success combining SANs, software raid, and LVM for high availability.
Re: (Score:2)
Host OS
Partitioned into
Volume Group "Xenspace" contains
Logical Volume
Guest OS
Re: (Score:2)
Article says "Yes, but not 64-bit" (Score:2)
Acronym overload (Score:5, Insightful)
Re: (Score:2, Funny)
It's opposite day again, isn't it?
Re:Acronym overload (Score:5, Informative)
Re: (Score:2)
Re: (Score:2)
I just copy/pasted the a short description from somewhere to the disambiguation page, not an entire article page.
Re: (Score:2)
Re: (Score:3, Informative)
NATO is an acronym, KVM isn't.
Re: (Score:2)
J.
Re: (Score:2)
Performance Comparisons (Score:2, Interesting)
(VMWare I can kind of see, if they were deliberately sticking to all free solutions, but no comparison to running on the host system? That's just bad reporting IMO.)
Mod me down! (Score:2, Insightful)
Though VMWare would still have been nice...
VMWare performs better - heres why (Score:3, Interesting)
Also, only AMD's SVM supports full-virtua
Re:Mod me down! (Score:4, Interesting)
Re:Mod me down! (Score:4, Informative)
Re: (Score:2)
I'm afraid you're terribly mistaken. The valid enforcement is called a civil lawsuit and it requires lots of lawyers and money to successfully defend against. Until tort reform makes frivolous lawsuits carry heavy penalties, large companies will continue to bring civil cases against anyone they don't particularly like.
Also, judges have been more than happy to uphold EULAs as binding contracts in all the cases I know of. The way to
Re: (Score:2)
Re: (Score:2)
I read this [kerneltrap.org] the other day on Kerneltrap (with their new look - love it or hate it) which seems to say that paravirtualization support has been added to KVM. They have several very impressive benchmarks which include native (but not VMWare).
Apples to Oranges (Score:4, Interesting)
Xen amd KVM utilize (require, if I remember correctly) support for virtualization-specific processor instructions. Qemu does not.
Comment removed (Score:4, Interesting)
Re: (Score:2)
It was only a few pages of text, about 10 paragraphs.
Re:Apples to Oranges (Score:5, Informative)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Try double that.
Re: (Score:2, Informative)
http://fabrice.bellard.free.fr/qemu/qemu-accel.ht
Re: (Score:2)
Re: (Score:2)
kqemu? (Score:2)
Re:kqemu? (Score:4, Informative)
Re: (Score:2)
Re: (Score:3, Insightful)
egrep '^flags.*(vmx|svm)'
if that returns anything you have VT, if it doesn't, you don't.
Here's what I get on my desktop (Intel Core 2 Duo).
alan@wopr:~$ egrep '^flags.*(vmx|svm)'
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr lahf_lm
flags : fpu vme de pse tsc msr pae mce cx8 api
Re: (Score:2)
Re: (Score:2)
Actually, the Socket 939 Athlon64 X2 processors do not have SVM enabled. The Socket AM2 ones have it enabled. DDR vs DDR2 ram is purely the difference between the 939 and AM2 CPUs... the 939 CPUs only had pinouts for DDR memory,
from about a month back ... (Score:4, Informative)
Re: (Score:2)
Call me when... (Score:2, Insightful)
Re:Call me when... (Score:5, Funny)
Re: (Score:2)
It depends what you are doing with it. WTF would I care about graphics acceleration in the data center? Or POS? Or anywhere except maybe some lab workstations with graphics heavy apps.
Re: (Score:3, Insightful)
paravirt KVM on the way (Score:5, Informative)
benchmarks (Score:3, Interesting)
Do you know why?
Xen requires some support from virtualized operating system, what about KVM?
Re: (Score:2)
Re: (Score:2)
Poor scientific practice (Score:4, Informative)
Why do they document the model of CD-ROM drive they used, but not the configuration of each emulation/simulation environment? I was shocked by the LAME compile times--and forced to wonder and guess what the filesystem configuration was. Is the filesystem located in an image file on the "host" computer's filesystem? Wouldn't it be interesting to try using a comparible medium across all benchmarks (shared NFS server, or low-level access to the same block device)?
Not enough data (CPU time vs. real time, etc.), not enough benchmarks (different filesystem media, etc.), poor documentation (configuration, anyone?), on what doesn't even amount to an official release. Correct me if I'm wrong.
The real problem (Score:2)
The 68K family was fully virtualizable back in the late '80s (from the 68020 on).
The numbers are a little deceiving (Score:2)
I suspect if they reran their benchmarks with -rc4, the KVM numbers would be much more competitive with the Xen numbers (although I do suspect Xen will still be on top--slightly).
OpenVZ is already pretty good (Score:2)
Re: (Score:2)
Whether this will get you more babes is left as an exercise to the reader.
KVM, QEMU, and Qemudo (Score:4, Interesting)
This is likely to boost QEMU's popularity, the virtualizer accelerated by KVM. An interesting coïncidence is that I released the very first version of Qemudo [sourceforge.net] on Jan 4th while being totally unaware of the existence of KVM. Then three days later the KVM project released their first version too, and I read about it on this kerneltrap article [kerneltrap.org].
I am thrilled at the idea of using KVM + QEMU + Qemudo together. To put it simply, and to quote my README, Qemudo is "a Web interface to QEMU offering a way for users to access and control multiple virtual machines running on one or more remote physical machines." Qemudo makes use of two important features in QEMU: native support of VNC, and copy-on-write disk images for instantaneous VM creation. If you are interested go check out the website (and download the tarball which contains more detailled doc). </shameless-plug>
Re: (Score:2, Insightful)
Re:KVM name is misleading (Score:5, Interesting)
5 ? 00:00:00 khelper
6 ? 00:00:00 kthread
8 ? 00:00:00 kblockd/0
9 ? 00:00:00 kacpid
102 ? 00:00:00 kseriod
105 ? 00:00:00 khubd
176 ? 00:00:00 kswapd0
784 ? 00:00:00 kpsmoused
814 ? 00:00:00 khpsbpkt
818 ? 00:00:00 knodemgrd_0
seems to fit in with the naming convention of all the kernel related processes.
Re: (Score:2)
It's fairly simple to get around the possible confusion between the Linux KVM and the hardware KVM as they have nothing to do with each other and won't be referenced in the same context.