Slashdot Log In
Intel Shows Data Centers Can Get By (Mostly) With Little AC
Posted by
timothy
on Thu Sep 18, 2008 05:03 PM
from the googly-attrition dept.
from the googly-attrition dept.
Ted Samson IW writes "InfoWorld reports on an experiment in air economization, aka 'free cooling,' conducted by Intel. For 10 months, the chipmaker had 500 production servers, working at 90 percent utilization, cooled almost exclusively by outside air at a facility in New Mexico. Only when the temperature exceeded 90 degrees Fahrenheit did they crank on some artificial air conditioning. Intel did very little to address air-born contaminants and dust, and nothing at all to deal with fluctuating humidity. The result: a slightly higher failure rate — around 0.6 percent more — among the air-cooled servers compared to those in the company's main datacenter — and a potential savings of $2.87 million per year in a 10MW datacenter using free cooling over traditional cooling."
Related Stories
Submission: Intel pushes "free cooling" to a dusty 90 by Anonymous Coward
[+]
Technology: Microsoft Innovates Tent Data Centers 201 comments
1sockchuck writes "The outside-the-box thinking in data center design continues. Microsoft has tested running a rack of servers in a tent outside one of its data centers. In seven months of testing, a small group of servers ran for seven months without failures, even when water dripped on the rack. The experiment builds on Intel's recent research on air-side economizers in suggesting that servers may be sturdier than believed, leaving more room to save energy by optimizing cooling set points and other key environmental settings in the server room."
[+]
Technology: Nuke Site Converted Into Green Data Center 125 comments
1sockchuck writes "If you had 100,000 servers, would you put them on top of a former nuclear fuel facility? One of the world's largest web hosts, 1&1 Internet, is building a new data center on a site in Hanau, Germany previously used by Siemens to produce mixed oxide rods made from enriched uranium and plutonium. The site has been cleaned up, and 1&1 is converting it into a 'green' data center powered by renewable energy and using free cooling to save on air conditioning costs."
[+]
Hardware: "Heat Wheel" Could Lower Data Center Power Bills 97 comments
miller60 writes "An air conditioning technology called the 'heat wheel' is getting a test drive in data centers, and early adopters cite impressive reductions in their power bills. The heat wheel — also known as a rotary heat exchanger or Kyoto Cooling — is a refinement of cooling systems using outside air. Rather than introducing exterior air directly into the server room (the air economization we discussed recently), the heat wheel briefly mixes the outside air and exhaust air to create an air-to-air heat exchanger. A data center in the Netherlands using this approach only has to use chillers 11 days a year." The article points out that the heat wheel is not new, but it hasn't been applied to data centers until recently.
[+]
Hardware: Intel Testing Solar Power For Data Centers 66 comments
miller60 writes "Intel has installed solar panels at a New Mexico facility to test the potential for using photovoltaic solar power in data centers. Solar has proven impractical in data centers thus far for reasons of cost (too high) and capacity (too low). Intel will test the 10-KW solar array with data center containers and as supplemental power for summer capacity challenges, and says the project is a first step toward solar data centers. The project is housed at the New Mexico site of Intel's recent research in air side economizers in data center cooling."
[+]
Technology: Yahoo's "Chicken Coop" Data Center Design 111 comments
1sockchuck writes "Yahoo has come up with a data center design called the Yahoo Computing Coop, which it says will make its new data center in Lockport, NY one of the most efficient on earth. The design features 120-foot by 60-foot metal prefabricated facilities with louvers on the side to support free cooling, and a peaked roof to manage the release of waste heat from the hot aisle. Chief Yahoo David Filo said the name was adopted 'because it looks like something chickens live in.' The $150 million data center in Western New York, which was announced earlier today, will run on cheap hydro power from the Niagara River."
[+]
Technology: Google's Chiller-Less Data Center 132 comments
1sockchuck writes "Google has begun operating a data center in Belgium that has no chillers to support its cooling systems, which will improve energy efficiency but make weather forecasting a larger factor in its network management. With power use climbing, many data centers are using free cooling to reduce their reliance on power-hungry chillers. By foregoing chillers entirely, Google will need to reroute workloads if the weather in Belgium gets too warm. The facility also has its own water treatment plant so it doesn't need to use potable water from a local utility."
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading... please wait.
How about reducing the need for AC POWER as well.. (Score:5, Insightful)
How about reducing the need for AC POWER as well by cutting down on the number of AC TO DC PSU's.
Re:How about reducing the need for AC POWER as wel (Score:5, Interesting)
I asked the president of an engineering firm that I work for about this. He ships racks of boxes, each holding DSP boards on backplanes, each backplane has it's own PSU.
When I asked him why he doesn't just have one or two -big- power supplies in the unit, he said that he tried that, but the cost of the non-standard PSU was higher than all the ATX PSUs put together, and then some, and replacing the units when they eventually fail would be tricky, as opposed to just stocking more ATX PSUs.
I agree that it's a good idea, but until there's enough volume of large multi-output PSUs shipping, the cost of manufacture makes the product unworkable (unless you think big-picture and want to spend more up front for power savings over the whole unit's life).
Generally, the people who use the hardware aren't the ones building it, and buyers usually go for the lowest bid.
Parent
Re:How about reducing the need for AC POWER as wel (Score:5, Informative)
Parent
Re: (Score:3, Informative)
We have a monsoon season here, in mid summer. Gets pretty humid at times.
Re:How about reducing the need for AC POWER as wel (Score:4, Informative)
Computers run hot enough to get rid of moisture and one assumes that these data centers run around the clock.
But dust can be lethal to computers and in particular to power supplies and CPU fans. I clean my PCs guts at least twice a year and what comes out is amazing. Fans are great at collecting dust and they don't pump much air when coated with dust either.
Parent
Re:How about reducing the need for AC POWER as wel (Score:4, Informative)
Parent
48 vdc (Score:4, Informative)
Parent
Re:48 vdc (Score:5, Informative)
Having multiple of a commonly used voltage used in renewable energy also helps if, for example, you want to feed your datacenter directly from say wind or solar, in addition to a set of AC to DC converter.
Parent
Re: (Score:3, Interesting)
My brother works for the Campus-level Computing and Information Services for Texas A&M University. They have been going away from AC power for a while now. They apparently have almost no heat issues anymore. While the AC server room in my lab (we run 70 servers) with a dedicated A/C system is running at 74 degrees now with the A/C running constantly at full blast.
Re:How about reducing the need for AC POWER as wel (Score:5, Informative)
Having very large PSUs is a pain in the ass. Failures tend to be catastrophic and dangerous. They're more expensive to build and maintain. (think basic economy of scale problems) They also may not be any more efficient than distributed conversion. You also tend to distribute much lower voltages with DC than you do with AC. (240vac vs 48vdc) This gives very high amperages which requires much thicker wiring. Copper is EXPENSIVE right now, this makes it a big factor in the cap-ex of building a new DC.
This is why a lot of work is going into improving the efficiency of commodity power supplies. Groups like 80plus.org are doing great things.
Also some other links:
http://www.treehugger.com/files/2007/07/secret_efficien.php [treehugger.com]
http://services.google.com/blog_resources/PSU_white_paper.pdf [google.com]
Parent
Re:How about reducing the need for AC POWER as wel (Score:5, Interesting)
Aluminum wiring is a FIRE hazard and was BANNED in all new
houses in the US due to it.
You might be able to get away with it outdoors, but it is
most likely a bad idea based on the indoor results.
http://www.physicsforums.com/showpost.php?s=7d306106c574b8acd101e052ab90be42&p=615606&postcount=6 [physicsforums.com]
http://books.google.com/books?id=2edigWaeGPUC&pg=PA175&lpg=PA175&dq=aluminum+wiring+ban&source=web&ots=l0eE26iMkt&sig=rVIgBVl0gXGlJicEHA_qW8s4zY0&hl=en&sa=X&oi=book_result&resnum=4&ct=result [google.com]
Alot of areas you cannot even get insurance for the building
with aluminum wiring in it.
http://en.wikipedia.org/wiki/Aluminum_wiring#Hazard_insurance [wikipedia.org]
Parent
Re:How about reducing the need for AC POWER as wel (Score:4, Informative)
That's because aluminum significantly contracts and expands with temperature changes. When it does so in a residential setting, it will cause shorts and sparks and such in outlets and switches. The 1" wire (probably more like a crossbar) was probably specifically designed for electrical use, and had appropriate connectors and so on so that it was NOT a danger (as noted in the physicsforums post you linked to. Given the price of copper any more, the special work needed for aluminum is possibly worth it.
Parent
Re:How about reducing the need for AC POWER as wel (Score:5, Informative)
You're only half right. If you actually read any of the articles you linked to you'd know that.
Aluminum wire by itself is no hazard at all. It just doesn't do well when you connect it copper or other galvanically dissimilar materials that can cause corrosion. And there are some issues with dissimilar thermal expansion rates, but that's largely dependent on the terminal size and type.
You're right that the standard 14-10 AWG wiring used in homes is typically not aluminum, and that the wiring of that size that was aluminum and installed in the the 60s and 70s needs to be treated specially.
But aluminum was and still is commonly used in large-gauge wiring, starting around 8 AWG -- the ~2 AWG feed for many homes *is* aluminum. And it's entirely possible to safely wiring aluminum, even of smaller gauges, even of older alloy types, so long as you understand the limitations and use CO/ALR-rated devices.
Parent
Re:How about reducing the need for AC POWER as wel (Score:4, Informative)
If you want to go straight DC, you need to use the economies of scale, not replace AC power supplies with some alternate power scheme that still uses AC on the rack and DC into the server.
Instead, use large, very efficient AC-DC transformers and wire the rack DC.
If you convert AC to DC in bulk with more expensive but highly efficient equipment you will save significant money on the power conversion PLUS you can put that transformer outside in its own enclosure with a big metal heat exchanger for a case.
DC can be stepped down very easily and efficiently so various voltages are available from the transformer or from a seperate step-down box that doesnt create much heat because it is pretty efficient.
Now, you dont have to worry about the heat from the power supply and dont have to cool for it. You gain savings in efficiency and less AC use.
also, the transformer can very easily be cooled but an extremely simple ground loop and small pump can handle that for a few bucks per month.
Parent
Re:How about reducing the need for AC POWER as wel (Score:4, Informative)
No. The reason AC was more convenient to move around is the ability to step it up and down with transformers. But in fact line losses are higher for a given voltage with AC than DC, for various reasons (e.g. peak voltage is higher, some of the power radiates). Nowadays, converting DC to DC is about as easy (it goes through a high frequency AC step on the way, however). A switching power supply actually converts AC (60Hz) to DC to AC (tens of kilohertz) to DC.
Parent
Re:How about reducing the need for AC POWER as wel (Score:4, Interesting)
4 words "Single point of failure"
You mean like the power circuit that you are already connected to? That single point of failure has long ago been handled. Where the costs can be justified, run more than one power circuit, backup generators and UPS, etc. That's no different.
I'm personally more interested in the wasteful DC to AC and back conversion when considering small scale solar. Why in the world is the default option to run a wasteful inverter just to plug an AC to DC converter in to that? Almost everything I looked at for portable solar to power a laptop or netbook worked like that. A lot of netbooks could be run on a 10W solar panel with battery backup, or more reliably of course with more solar capacity.
Parent
Chimney effects (Score:5, Interesting)
I do wonder how things could be improved with a decently sized stack... the higher an exit chimney, the more draw you'll get from the temperature differential. If your computer rooms are near the base of a decent sized office building, and you have a 20 story stack, I'd expect you could get away without any intake or exhaust fans.
Anyone here that can confirm or deny this?
combine this with vortex effects (Score:3, Interesting)
Add some of the Dyson vacuum inspired vortex thingy's to the intake to help filter out the dust and you wouldn't have to waste as much money on filters either.
Or what if you run the incoming air through a swamp cooler? wouldn't the running water cut down on the incoming dust significantly?
Re: (Score:3, Insightful)
Re:Chimney effects (Score:4, Funny)
Just to clarify, this warm-air evacuation phenomenon is powered by the force of suck.
Actually, according to another commenter to the parent you replied to, it's gone from suck to blow.
Parent
Re: (Score:3, Funny)
I do wonder how things could be improved with a decently sized stack... ?
Apparently you haven't checked your spam folder lately; you'll find plenty of answers in there addressing just this question. :)
Simpler Tools (Score:5, Interesting)
Part of the problem is people are looking for very complicated solutions for very simple problems.
In retrofitting a standalone building, all you really need to do is reduce the amount of heat a building gains from the sun by improving it's R value and use sensible ducting to draw air through the building. I've seen some super energy efficient designs where each floor is vented, so that the building is itself a chimney, with cool air coming from vents from covered areas near the base, and enough size provided at the top to pull enough from the bottom, which is also easily aided by fans.
In building an entirely new datacenter, it would make sense to bury the server rooms, and cover the concrete structure with earth and solar panels. Combined with a flywheel load balancer, you could have an "off the grid" datacenter with the grid for backup. During the daylight hours, especially in the south, the panels can provide a good deal of the A/C and power necessary. At night the flywheel can continue powering the data center for a while, and turn fans without compressors to cool the equipment with night air.
This can all be done with existing technology. The trick is to convince people that green investment will lead to a return in the long run. I haven't personally looked at average rate increases in electricity, but the difference between efficient and additional construction expenses versus long term energy price fluctuations probably looks very good.
Parent
Re:Simpler Tools (Score:5, Informative)
We're talking less than a minute needed. In the end they couldn't use the several large and expensive flywheels because they could not provide power long enough.
If you're powering your whole data center 'for a while' with these... you must have very few servers (like a handful).
Parent
Makes Sense (Score:5, Insightful)
Re:Makes Sense (Score:5, Interesting)
I set up a datacenter at my old job in Alberta, and that's exactly what we did.
We ran exhaust ducting to the offices, and tied intake into the building's cold-air return. From September to May fans moved colder air into the data room and hot air into the office space. June to August we ran the AC, and shut off the "winter lines" with dampers.
It worked extremely well.
Parent
Re:Makes Sense (Score:5, Funny)
Parent
Re: (Score:3, Insightful)
What the fuck is heppa?
It's HEPA. It's an acronym. High-Efficiency Particulate Air.
Yeah, because the guy not knowing the acronym makes the point he's making completely useless, right? (sheesh). Only thing worse than a speeling flame is a speeling flame with attitude, dude. You might consider chilling out a bit.
Re:Makes Sense (Score:4, Funny)
Parent
And that's why (Score:4, Funny)
I leave my systems on the deck.
What a great study! (Score:4, Insightful)
The savings should be more than enough to pay for replacement hardware, and even for upgrades. And stepping back and looking at the big picture tells me that there is at least one brilliant person at Intel--whoever though of doing this study is a genius!
--MarkusQ
Re:What a great study! (Score:4, Insightful)
I'm not sure. $2.87m may be enough to pay for failures, but what if you had to add extra redundancy to the system in the first place to make up for that small amount of failures? Extra boxes to maintain, with their own MTBFs.. extra space taken up, extra electricity drawn.
I think a better solution - not as extreme, granted - would be to just turn the aircon temperature dial up a notch or two. Has anyone worked out how much money you'd save in the same datacenter by just doing that?
http://www.washingtontimes.com/news/2008/jul/30/un-takes-on-hot-air-for-good-of-the-world/ [washingtontimes.com]
Most datacenters and even little server rooms I've been in have had the dial set to something ridiculous like 65. There's no reason your server room needs to be that cold, at all. You just have to keep it at a reasonable ambient temperature somewhere below the system's maximum rating (most processors will happily run for 5 years at a die temperature of 105C, you can't blow hot air over a processor and expect it to stay cool though.
So, why not keep your server room at 80, save yourself the 0.6% extra failures, and maybe (at a guess) $1.3m a year instead of $2.87?
Parent
Re:What a great study! (Score:5, Insightful)
You lose on density, though. Aisle space in front of the racks is fixed, you need a certain amount for humans to move in. Shallow, tall equipment means fewer units per rack. With a current-format rack you need say a 3'-deep area for the rack and a 3'-wide aisle for access. That's 50% equipment and 50% access. If the racks were only 1' deep instead, you'd be using 25% for equipment and 75% for access (since you still need that 3' wide aisle). And in that 25% of space for equipment you now get perhaps 25% of the amount of equipment since each one's using 4x more vertical space in the rack and rack height can't change (it's limited by basically how high off the floor a human can reach to get to the equipment).
To make up for that, you need more square footage of data center to hold the equipment. That increases operating costs, which is what we're trying to reduce.
Parent
Outside air not so harsh (Score:5, Insightful)
Well, it makes sense. Normal PCs run on essentially ambient air, and live for years even under heavy loads (games put a lot of load on systems) despite all the dust and cruft. Servers aren't that different in their hardware, so it makes sense they'd behave similarly. And there's a lot that can be done cheaply to reduce the problems that were seen. Dust, for instance. You can filter and scrub dust from the incoming air a lot cheaper than running a full-on AC system. In fact the DX system used on the one side of the test probably scrubbed the incoming air itself, which would explain the lower failure rate there. Reduce the dust, you reduce the build-up of the thermal-insulating layer on the equipment and keep cooling effectiveness from degrading. Humidity control can also be done cheaper than full-on AC, and wouldn't have to be complete. I don't think you'd need to hold humidity steady within tight parameters, just keep the maximum from going above say 50% and the minimum from going below 5%. Again I'll bet the DX system did just that automatically. I'd bet you could remove the sources of probably 80% of the extra failures on the free-cooling side while keeping 90% of the cost savings in the process.
Only ten months? (Score:4, Interesting)
The standard replacement cycle is about three years, so until they try that, this doesn't mean a lot. Also, what was the density of the data center? I still love the story of a datacenter with some DSLAMs that cooled left to right which were put next to each other in about 12 racks and the rightmost one caught fire once a week...
Also, I don't know the climate there, but in the regular climate here where it goes between -10 and +35 celsius (that's between 14 and 95 fahrenheit) and there's a good dose of humidity, the failure rate might be somewhat bigger...
Re:Only ten months? (Score:4, Informative)
So true! Anyone with a background in unairconditioned manufacturing plants can tell you that new computers do just fine in rough conditions, but after a few years you will get power supply failure rates out the ass! Give them DC power inputs, standardized, please (but you KNOW intel won't do that - they don't even use standardized front panel connectors) and you might see the failure rate reduced even further.
Almost all data centers are designed with A/C in mind. This means that as long as A/C is pulling the load no one needs to worry about well designed buildings. As soon as you are challenged with having to design for reduced A/C usage that you end up thinking smarter and how passive systems can do the same thing. Another advantage of trying to design without A/C is that you won't find your servers frying because of an air conditioner failure.
Below are some links on passive solutions to cooling. Some of the techniques are surprisingly old, but effective:
- http://en.wikipedia.org/wiki/Passive_cooling [wikipedia.org]
- http://en.wikipedia.org/wiki/Windcatcher [wikipedia.org]
- http://www.arabrise.org/articles/A040105S.pdf [arabrise.org]
Parent
Numbers don't quite add up! (Score:3, Informative)
If they're paying ten cents a kilowatt-hour, that 10MW data center is paying about $9M/yr for power.
Cooling systems move about 15 times the power than what they draw. So the savings for a 10MW datacenter would be around $600K. Wonder how they came up with $2.9M ?
Re: (Score:3, Informative)
What kind of air-conditioning is that? Here the rule of thumb looks like this - 10KW of electricity produce 7KW of heat, and it takes one-third of that (2.333KW) in electricity to move it out. Do you have any sources on this?:)
Re: (Score:3, Informative)
Not quite. If you're thinking of SEER, it's a bastardized ratio with BTUs/hour on one side and Watts on the other. Since there's 3.413 BTUs/h in one watt, a 15 SEER AC unit moves 4.4 times as much power as it draws (that is, it has a Coefficient of Performance, or COP, of 4.4).
Humidity (Score:3, Informative)
But if you are going to allow for an arbitrarily re-locatable data center, what does it matter that it can handle 90 degree whether when you can move it somewhere cold enough that you can have a humidity controlled room that gets passive cooling from the exterior.
Re:Humidity (Score:5, Interesting)
Humidity only really matters for two reason - If too low, you get a lot of static buildup, and if too high, you get condensation.
Condensation only tends to happen on objects cooler than ambient, which doesn't really apply to running servers. Static matters a lot more, but you can raise humidity a lot cheaper than you can lower it, so, not as much of an issue there.
And as a bonus, more humid air can carry away more heat than the same volume of less humid air.
Parent
They will have to wait longer to get failures (Score:4, Insightful)
I'd say that they will have to wait longer to get failures. Try to have a server running in that enviroment for 5 years and then we will see. I would not do it without having some good filters. But for a test it is a interesting experiment.
For datacenters in colder climates, you can already get cooling systems that cools the water using air only when the temperature is below a certain temperature(just forgot the number). When it gets above that level the water gets cooled like you normally do.
At work our old AC system was old and needed to be replaced and the new one does that. The outside temperature is so low that the water will be cooled with just air for half the year.
It was more expensive to install since it needed more and bigger cooling units(I belive they also talked about bigger slower fans that used less power) when just using air but it pays itself in a few years.
Another interesting experiment would be to use the heat again. I dont know if the water temperature is high enough so that you could use heat exchangers, perhaps as the first step on heating ingoing cold water.
Antarctica (Score:5, Interesting)
More details and a correction re failure rates (Score:5, Informative)
Sun is also running a comparable experiment with Belgacom and allows you to log in to a live interface to view stats on in- and outlet temperatures and more at http://wikis.sun.com/display/freeaircooling/Free+Air+Cooling+Proof+of+Concept [sun.com] For more details and analysis see http://www.datacenterknowledge.com/archives/2008/09/18/intel-servers-do-fine-with-outside-air/ [datacenterknowledge.com] or http://securityandthe.net/2008/09/18/intel-sees-the-future-of-datacenters-and-it-does-not-include-airconditioning/ [securityandthe.net]
DC Knowledge also has a nice video of this experiment at http://www.datacenterknowledge.com/archives/2008/09/18/video-intels-air-side-economization-test/ [datacenterknowledge.com]
Why are office windows seaed shut? (Score:3, Insightful)
There is another really smart thing you can do too. When it is hot inside and not hot outside yu can open a window. That seems obvious but how many office building have openable windows? For some reason Architects like to cool office space with AC even if there is "free" cool air out doors.
This is even easier with computers. The servers would be happy to run at 95F and much of the time even in the American SW the outside air is cooler than 95F.
I've been saying this for many years. I think the reason for resistance is that no one gets a take home pay bonus based on how much power is saved.
Re:Why are office windows seaed shut? (Score:4, Insightful)
There is another really smart thing you can do too. When it is hot inside and not hot outside yu can open a window. That seems obvious but how many office building have openable windows? For some reason Architects like to cool office space with AC even if there is "free" cool air out doors.
The reasons are things like: liability issues, chimney effects, people leaving the windows open even with the heat or a/c on, people leaving the windows open in the rain, bugs in the building, increased maintenance costs for more complex windows, etc. It turns out that architects aren't actually idiots and have thought about this.
This is even easier with computers. The servers would be happy to run at 95F and much of the time even in the American SW the outside air is cooler than 95F.
Your desktop can run at 95F ambient. If it has a variable speed fan it's probably screaming like a banshee. The key is how much heat can be dissipated, and at 95F ambient you can't move enough air through a dense computer system to cool the components down to a safe temperature. Even at 68F ambient people are have a lot of trouble moving enough air through modern super-dense racks to keep computers from seeing increased failure rates.
Parent
Never play in the USA (Score:4, Interesting)
EVERYTHING _M_U_S_T_ be air-conditioned at all times. From what we heard from France during their last heat wave a few years ago, air-conditioning isn't universal in the First World. Therefore, it must sound strange that air-conditioning is a inviolate moral imperative in all offices in the US. My wife has a sweater with her at work at all times even if it is July or August. Same for me. 100% wool. When it is 95 outside and 68 inside, I want nothing more than to hibernate -- like seriously drift off to sleep. I've worn gloves with the fingers cut out in July at my keyboard. I've sneaked in an incandescent lamp to warm my hands (please, sir, just a lump of coal?). I've gotten on my chair and stuffed paper towels in air ducts.
If management can't see that they are air-conditioning some of their people into productivity loss, not to mention pain, how much more likely are they to reduce air-conditioning on their precious equipment? No, doesn't matter whether one experiment shows it would save big money. The person who suggests reducing air-conditioning in the U.S. will be about as popular at his business as if he had suggested commissioning a portrait of Karl Marx on the lunch room wall. This just isn't a technical issue.
Re:What About the Small Guys? (Score:5, Funny)
There are no small guys... especially on
Parent
Re: (Score:3, Funny)
We all run data centers with 3000 servers and program on apps with 10+ million LOC. We also all built something better than a 3d solar cell in the 5th grade.
Pfft! I achieved a technological singularity 3 years ago. I am the datacenter.
Re:What About the Small Guys? (Score:5, Insightful)
Parent
Re:What About the Small Guys? (Score:5, Informative)
Parent