May 25, 2009 (12:05 AM EDT)
Green IT Book Excerpt: Virtualizing Your Systems
Read the Original Article at InformationWeek
Chapter 6: Virtualizing Your IT Systems
Chapter 6: Virtualizing Your IT Systems
"Virtualization can increase hardware utilization by five to 20 times and allows organizations to reduce the number of power-consuming servers."The most-significant step most companies can make in their quest for green IT is in IT virtualization, as briefly mentioned in previous chapters. This chapter describes the significant concepts of virtual servers and virtual data storage for energy-efficient data centers. The descriptions include VMware and other server virtualization considerations. In addition, the virtual IT world of the future, via grid computing and cloud computing, is discussed.
Although the use of grid computing and cloud computing in your company's data center for mainstream computing might be in the future, some steps toward that technology for mainstream computing within your company are here now. Server clusters via VMware's VMotion and IBM's PowerVM partition mobility are here now and used in many company data centers. Both of those technologies are described in this chapter.
Based on my experience with data centers for more than ten years, I believe the most important reason to use virtualization is for IT flexibility. The cost- and energy-savings due to consolidating hardware and software are also significant benefits and nicely complement the flexibility benefits.
There are many aspects to IT virtualization. This chapter structure covers the rational, server virtualization, storage virtualization, client virtualization, grid and cloud concepts, cluster architecture for virtual systems, and conclusions.
Over the past 30 or more years, data centers have gone from housing exclusively large mainframe computers to housing hundreds of smaller servers running versions of the Windows operating system or Unix® or Linux® operating systems. Often the smaller servers were originally distributed throughout the company, with small Windows servers available for each department in a company. During the past few years, for reasons of support, security, and more-efficient operations, most of these distributed servers have moved back to the central data center.
The advent of ubiquitous high-speed networks has eliminated the need for a server in the same building. These days, network access even to our homes through high-speed networks such as DSL and cable allows network performance from our homes or distributed offices to the central data center to be about equivalent to performance when your office is in the same building as the data center.
The Internet was and remains the most-significant driving force behind the availability of high-speed networks everywhere in the world -- including to homes in most of the developed world. When we access a Web site from our home, from the airport with a wireless connection, or from the countryside using a PDA or an air card with our laptop, we have a high-speed connection to a server in some data center. If the Web site is a popular site such as Google, the connection might be routed to any one of many large data centers.
When the distributed servers that had been in office buildings were moved in the past ten years to centralized data centers, operations and maintenance became greatly simplified. With a company server at a centralized data center, you could now call the help desk on Sunday morning and find out why you had no access, and central operations could have atechnician "reboot" the server if it had gone down.
So, the centralized data center provides many advantages -- especially with high-speed networks that eliminate network performance concerns. However, with the rapid growth in servers used in business, entertainment, and communications, the typical data center grew from dozens of separate physical servers to hundreds of servers, and sometimes to thousands.
Purchasing, operating, and maintaining hundreds of separate physical servers became expensive. The innovative solution was to consolidate perhaps ten of the separate servers into one bigger physical server, but make it appear as if there were still ten separate servers. Each of the ten virtual servers could retain its own server name, its own Internet®address (IP address) and appear -- even to web developers -- to be a separate physical machine (as it had been before becoming a virtual server).
Costs go way down because one large physical box is much less expensive to buy than ten smaller physical boxes. Also, it's significantly less expensive to maintain and operate ("take care of") one big server than ten smaller servers. The analogy might be exaggerated -- but it's a bit like taking care of one big house rather than ten separate smaller houses.
In simple terms, server virtualization offers a way to help consolidate a large number of individual small machines on one larger server, easing manageability and more efficiently using system resources by allowing them to be prioritized and allocated to the workloads needing them most at any given point in time. Thus, you can reduce the need to over-provision for individual workload spikes.
In general, virtualization at the data center is applied broadly -- not just to server virtualization. It provides the capability to simulate the availability of hardware that might not be present in a sufficient amount -- or at all! Virtualization uses the available physical resources as a shared pool to emulate missing physical resources.
Virtualization is capable of fine control over how and to what extent a physical resource is used by a specific virtual machine or server. Thus, we have the concept of virtual computer memory (which is not real memory but appears to be real) and virtual data storage.
This chapter gives details on virtualization technologies at the data center and explains how those technologies are usually the first and most-important step we can take in creating energy-efficient and green data centers.
The Concepts Of Consolidation And Virtualization
In Chapter 2, "The Basics of Green IT," Figure 2.2, shows an overall strategy for moving to a green data center. The IT infrastructure energy-efficiency strategy consists of centralizing data centers, consolidating IT resources at those data centers, virtualizing the physical IT resources, and integrating applications.
Server consolidation and server virtualization both reduce energy use by reducing the number of physical servers, but they use different methods. Server virtualization enables you to keep all your servers, but they become virtual servers when many physical servers share the same physical machine. The diagrams and descriptions of the concepts of consolidation and virtualization were based on the descriptions in the IBM red paper, "The Green Data Center: Steps for the Journey."
Consolidation: A Key In Energy Efficiency
As part of the distributed computing architecture where smaller servers were distributed throughout the company, we had e-mail servers that were distributed, often one for each corporate facility with often only a couple hundred users for each server. When the e-mail servers were centralized, dozens of smaller servers could be consolidated onto one or two large mail servers.
This was more than consolidating the physical servers onto one large physical server; the large centralized e-mail servers only had one copy of the e-mail application. So, server consolidation refers to both consolidating physical servers and consolidating the application.
(click image for larger view)
Consolidation of applications from under-utilized servers to a single, more-efficient server.
It's important to note that a decrease in overall power consumption is not the only factor. Hand-in-hand with the power reduction goes the same amount of heat load reduction and another add-on for the infrastructure. This double reduction is the reason why consolidation is an enormous lever to moving to a green data center.
However, a particular drawback of consolidation is that none of systems 1 through 4 is allowed to be down during the time that the respective applications are moving to the consolidated system. So, during that migration time, higher demands on resources might occur temporarily.
Virtualization: The Greenest of Technologies
An alternate method to consolidation is virtualization, the concept of dealing with abstract systems. As discussed at the beginning of this chapter, virtualization allows consolidation of physical servers without requiring application consolidation.
So, as discussed earlier, with server virtualization we can take ten servers with completely different applications and consolidate them onto one large physical server, where each of the ten stand-alone servers can retain their server name, IP address, and so on. The virtual servers still look to users as if they are separate physical servers, but through virtualization, we can dramatically reduce the amount of IT equipment needed in a data center.
Virtualization eliminates the physical bonds that applications have to servers, storage, or networking equipment. A dedicated server for each application is inefficient and results in low utilization. Virtualization enables "car pooling" of applications on servers. The physical car (server) might be fixed, but the riders (applications) can change, be diverse (size and type), and come and go as needed.
The example in Figure 6.1 shows how specific applications were moved to another system with a better energy footprint. In the simple case illustrated, we assume all systems are running at the same operating system level. However, what if the applications require different operating system levels or even completely different operating systems? That is where virtualization comes into play.
The term "virtualization" is widely used and has several definitions:
To have real work done by a virtual system, the virtual system must run on a real system. Obviously, additional intelligence is required to do this. There are pure software solutions, or a system's firmware might offer virtualization features, or such features might be hardwired into the system. Many of the current processor architectures have virtualization features integrated, which can be taken advantage of by software solutions such as the IBM System z® and p machines. In the field, various other solutions are available, such as VMware Server, VMware ESX, Microsoft Virtual Server, and Xen.
(click image for larger view)
Virtualization enables us to consolidate systems, keep the same server names, and so on.
• Consider the three separate systems. To communicate, they require a network infrastructure such as NICs, cables, and switches. If our virtualization system supports network virtualization, this infrastructure is no longer needed. The virtualized systems can communicate using the virtualization system's capabilities, often transferring in-memory data at enormous speed. Performance and energy efficiency increase because the network components are dropped. Once again, this method reduces the need for site and facilities resources.
• Each of the separate systems has its own storage system, namely disks. The virtualized systems can now share the disks available to the virtualization system. By virtualizing its storage, the virtualization system can provide optimal disk capacity -- in terms of energy efficiency -- to the virtualized systems.
This section discusses the techniques that are available for server virtualization, the most attractive approach to consolidation. In many cases, it is the easiest and most-effective way to transfer workload from inefficient, underutilized systems to efficient, well-utilized equipment.
Of course, other restrictions apply, such as the total number of LPARs a machine can support. The power supplied to the existing physical computer system is now used for all these logical systems, yet these logical systems operate completely independently from one another. LPARs have been available on the IBM System z since the late 1980s and on System p® since approximately 2000. Although the System z and System p partitioning features differ in their technical implementations, both provide a way to divide up a physical system into several independent logical systems.
Virtualizing Your IT Systems is is an excerpt from