In the rush to slash energy consumption in power-hungry data centers, design teams, equipment manufacturers, and tech companies have been developing clever, low-energy cooling solutions—from Facebook’s open-rack server setup with exposed motherboards, to Skanska’s eOPTI-TRAX liquid refrigerant coil system, to Google’s evaporative cooling schemes.
Solutions like these have helped data center facility operators achieve unprecedented energy performance levels, with power utilization effectiveness (PUE) ratios dipping below 1.10 in some instances. This means that less than 10% of the total energy consumption in a facility is attributed to noncomputing functions, such as air-conditioning and lighting.
Now, a new technology promises to push the limits of data center energy efficiency even further. Called immersive cooling, it uses a liquid instead of air to cool the servers. LiquidCool Solutions, Green Revolution, and 3M are among the pioneers of this technology. Each system works a bit differently, but the basic idea is to submerge the motherboards in tanks filled with nonconductive fluid, which absorbs the heat generated by the processors.
LiquidCool Solutions, for example, uses an enclosed server module and pumps dielectric fluid through the server enclosure. Green Revolution uses a tub full of dielectric oil and circulates the liquid through the tubs. 3M also uses the tub approach, but the fluid boils and then is condensed to reject the heat.
By using liquid-based cooling at the server level, the need for air-conditioning is greatly reduced, or even eliminated in some climates. The same goes for traditional HVAC equipment and systems—chillers, fan units, raised floors, and so on.
The Allied Control 500 kW immersion-cooled data center in Hong Kong is capable of delivering a PUE of just 1.02. The standard, 19-inch server racks use 3M Novec Engineered Fluids to enable tight component packaging for greater computing power in less space, according to Allied. Its open-bath design permits easy access to hardware and eliminates the need for pressure vessel enclosures and charging/recovery systems. PHOTO: COURTESY ALLIED CONTROL
“In most parts of the world, compressorized cooling would not be required with immersive cooling, since the liquid temperatures can be at a level where direct heat rejection using outdoor condensers or cooling towers would be sufficient,” says Thomas Squillo, PE, LEED AP, Vice President with Environmental Systems Design, who is currently researching the technology for the firm’s data center clients. “The fan energy is also eliminated, both in the HVAC system and in the server itself. Fluid pumping energy is very low.”
Other advantages of the cooling technology, according to Squillo:
• Increased performance and service life of the computer chips by eliminating heat buildup and problems related to contaminated air and dust.
• Ability to deploy data centers in extremely harsh environments without greatly impacting energy performance.
• Potential construction cost savings by downsizing or eliminating traditional HVAC systems.
Other than a few pilot projects, including a Bitcoin mining data center in Hong Kong and a Lawrence Berkeley National Laboratory-led installation in Chippewa Falls, Wis., immersive cooling technology is largely untested. A year into the Bitcoin pilot, the data center operator reported a 95% reduction in cooling costs.
AEC professionals are starting to realize the potential for immersive cooling, especially for high-performance computing centers and consolidated, high-density data centers.
“Large data centers that have many homogenous machines at high density—like those operated by Internet and cloud providers—are a good application,” says Squillo. “Small footprint and minimal energy use are very important due to the volume of servers. These can be deployed in remote areas where space and energy are cheap, but where air quality may be a concern, without having to worry about the data center air.”
TRICKY DESIGN CONSIDERATIONS
Before the technology can be implemented, says Squillo, several nettlesome design factors specific to immersive cooling have to be addressed:
• Piping distribution to the racks and cooling units requires redundancy and valving to accommodate equipment maintenance without disrupting server performance.
• Additional equipment and space are needed to drain fluid from the tanks for server maintenance.
• Local code requirements may limit the amount of fluid that can be stored in a single room.
• For the foreseeable future, it’s unlikely that a large data center would be 100% liquid-immersion cooled. This means provisions will have to be made for both air- and liquid-cooling systems, which will require additional space in the data hall and mechanical room.
“I think that some form of this technology will definitely be the direction the data center market will take in the future,” says Squillo. “The market just needs to mature enough for owners to trust the technology and demand servers that are designed for a particular type of liquid cooling. In the short term, I see large companies and server manufacturers doing small-scale installations to test the concept, before wanting to implement it at a large scale.”
Related Stories
| Oct 13, 2010
County building aims for the sun, shade
The 187,032-sf East County Hall of Justice in Dublin, Calif., will be oriented to take advantage of daylighting, with exterior sunshades preventing unwanted heat gain and glare. The building is targeting LEED Silver. Strong horizontal massing helps both buildings better match their low-rise and residential neighbors.
| Oct 12, 2010
Holton Career and Resource Center, Durham, N.C.
27th Annual Reconstruction Awards—Special Recognition. Early in the current decade, violence within the community of Northeast Central Durham, N.C., escalated to the point where school safety officers at Holton Junior High School feared for their own safety. The school eventually closed and the property sat vacant for five years.
| Oct 12, 2010
Guardian Building, Detroit, Mich.
27th Annual Reconstruction Awards—Special Recognition. The relocation and consolidation of hundreds of employees from seven departments of Wayne County, Mich., into the historic Guardian Building in downtown Detroit is a refreshing tale of smart government planning and clever financial management that will benefit taxpayers in the economically distressed region for years to come.
| Oct 12, 2010
Richmond CenterStage, Richmond, Va.
27th Annual Reconstruction Awards—Bronze Award. The Richmond CenterStage opened in 1928 in the Virginia capital as a grand movie palace named Loew’s Theatre. It was reinvented in 1983 as a performing arts center known as Carpenter Theatre and hobbled along until 2004, when the crumbling venue was mercifully shuttered.
| Oct 12, 2010
University of Toledo, Memorial Field House
27th Annual Reconstruction Awards—Silver Award. Memorial Field House, once the lovely Collegiate Gothic (ca. 1933) centerpiece (along with neighboring University Hall) of the University of Toledo campus, took its share of abuse after a new athletic arena made it redundant, in 1976. The ultimate insult occurred when the ROTC used it as a paintball venue.
| Oct 12, 2010
Owen Hall, Michigan State University, East Lansing, Mich.
27th Annual Reconstruction Awards—Silver Award. Officials at Michigan State University’s East Lansing Campus were concerned that Owen Hall, a mid-20th-century residence facility, was no longer attracting much interest from its target audience, graduate and international students.
| Oct 12, 2010
Gartner Auditorium, Cleveland Museum of Art
27th Annual Reconstruction Awards—Silver Award. Gartner Auditorium was originally designed by Marcel Breuer and completed, in 1971, as part of his Education Wing at the Cleveland Museum of Art. Despite that lofty provenance, the Gartner was never a perfect music venue.
| Oct 12, 2010
Cell and Genome Sciences Building, Farmington, Conn.
27th Annual Reconstruction Awards—Silver Award. Administrators at the University of Connecticut Health Center in Farmington didn’t think much of the 1970s building they planned to turn into the school’s Cell and Genome Sciences Building. It’s not that the former toxicology research facility was in such terrible shape, but the 117,800-sf structure had almost no windows and its interior was dark and chopped up.
| Oct 12, 2010
The Watch Factory, Waltham, Mass.
27th Annual Reconstruction Awards — Gold Award. When the Boston Watch Company opened its factory in 1854 on the banks of the Charles River in Waltham, Mass., the area was far enough away from the dust, dirt, and grime of Boston to safely assemble delicate watch parts.
| Oct 12, 2010
Cuyahoga County Soldiers’ and Sailors’ Monument, Cleveland, Ohio
27th Annual Reconstruction Awards—Gold Award. The Cuyahoga County Soldiers’ and Sailors’ Monument was dedicated on the Fourth of July, 1894, to honor the memory of the more than 9,000 Cuyahoga County veterans of the Civil War.
