“Welcome on board. I truly have been tasked with taking you to Mäntsälä — in the center of nowhere,” the minivan driver greets us in the characteristic obvious and unhurried intonations of a Finnish native speaker.
Mäntsälä is, certainly, in the center of nowhere. However this extra or much less situation will seemingly be the effect you gaze collections of about a of potentially the most extremely effective machines of at this time time, buzzing away in the abet of doorways along unpretentious corridors.
This contains Nebius’ AI files centre, taking form in the tiny neighborhood an hour’s drive or so north of Helsinki.
Amsterdam-basically based entirely Nebius is labelling itself an AI cloud infrastructure firm. Its proprietary platform, it says, has been optimised for AI training and inference with out efficiency bottlenecks.
The 💜 of EU tech
The most contemporary rumblings from the EU tech scene, a story from our wise ol’ founder Boris, and a few questionable AI artwork. Or no longer it is free, per week, to your inbox. Signal up now!
“The AI cloud is varied from the ‘contemporary’ cloud. In the placement of tools, in the applications, yes, however the of us that utilize it are additionally varied,” says Nebius’ head of product and infrastructure, Andrey Korolenko.
The would-be European AI infrastructure force has begun amassing a colossal quantity of compute. Lately, it announced that this will also triple the Mäntsälä capability to up to 60,000 Nvidia GPUs.
Exactly, this entails deployment of Nvidia’s H200 GPUs, on hand from November, moreover to already build in H100s. Nebius is additionally one of many commence partners for Nvidia’s upcoming Blackwell platform.
The Blackwell GB200 will enter mass manufacturing in December. Korolenko states that at any time when the important unit ships (at the 2nd slated for Q1 2025), Nebius will additionally have it “in a matter of weeks.”
Filling gaps in the AI training and inference market
While others are toiling away to shut the gap to Nvidia, the latter’s hardware (along with its CUDA platform) is serene the gold fashioned for AI training and inference. Nebius’ core alternate is to present time on its GPUs to all people from app developers and companies optimising foundation items for his or her have companies to AI model tuners and builders, from pre-training to inference, with varied ranges of serve for more than just a few ranges of skill.
The firm has 400+ engineers in its make utilize of, and customers already embody the likes of Mistral AIGenesis Therapeutics, Recraft, and Jetbrains.
Nebius has constructed custom racks for its Nvidia hardware. “We are doing it [building the data centre] from the bottom up,” Korolenko says. “Whenever you occur to plan it, that you just could also correct alter it,” he adds, addressing the evolving nature of chips along along with your complete infrastructure requirements this entails.
At some stage in our consult with, a colossal batch of racks has correct arrived from the manufacturer in Taiwan, and Nebius crew are in the strategy of unpacking them from their containers. At the mention of Taiwan, purple flags pertaining to present chains without delay pop up, and it is no longer long sooner than the quiz of “What’s going to occur to you in the occasion of a ‘reunification’ in the South China Sea?” arises.
“What’s going to occur to the world in this case?” Korolenko muses, sounding rather stoic.
The info centre additionally houses ISEG, which at the 2nd ranks as the nineteenth quickest supercomputer on this planet, and the quickest commercially on hand in Europe. With 35.26 GFlops per watt-2nd, it has additionally made it to quantity 24 on the Inexperienced Top500 list.
A thousand million USD in European AI infrastructure
The plan-out of Mäntsälä is piece of a plan to splurge a complete of $1bn all over Europe by mid-2025, including opening a further three files centres all around the continent (moreover to 1 in an as-of-yet undecided situation in North America).
This contains a recent addition in Paris, a colocation deployment basically based entirely at Equinix’s PA10 campus. The positioning, located in the Saint-Denis district, has an urban farm on the roof, and warmth from its servers used to be at risk of warmth the Olympic pool at some stage in the 2024 summer time games.
At its Mäntsälä files centre, Nebius offers heating for about 2,000 properties. A characteristic that, if replicable, makes the firm’s presence a heavenly proposition for more than just a few far flung locations eager to up their inexperienced credentials.
Nebius’ files centre at the 2nd easiest utilises air to chill its servers. This can switch with the addition of the later GPU items. What’s going to no longer switch is the quantity of vitality that will traipse abet in direction of heating the neighbouring town — the percentage, approximately 70%, can also even plan bigger when deploying a liquid cooling system. Certainly, with the growth, Nebius will export extra warmth than the village of Mäntsälä requires.
The Yandex legacy
You too can shock how reach you’ve no longer heard of a firm with 400 engineers ready to win a preserve of tens of hundreds of extremely coveted Nvidia GPUs up except now. Nebius currently emerged from the European remnants of Yandex (which had a protracted-term relationship with the GPU maker) following the firm’s excessive-profile divestment from Russia.
One amongst the issues to reach abet out of that laborious task, varied than the Mäntsälä files centre, used to be about a billion bucks in money. That is at the 2nd fueling the rollout of what can also end up being a world force in AI infrastructure.
As a consequence of the legacy from Yandex, Nebius Community is listed on NASDAQ. The neighborhood additionally encompasses files alternate Toloka, upskilling edtech platform TripleTen, and self reliant driving abilities unit Avride. However, its shares are no longer at the 2nd trading. Earlier this month, it announced it had enlisted Goldman Sachs as its financial advisor with a scrutinize to recommence trading additional down the line.
Yandex founder Arkady Volozh is Nebius’ CEO, who has publicly criticised Russia’s struggle in Ukraine. However, along with the Mäntsälä files centre, Nebius has seemingly additionally inherited a clear diploma of suspicion as a result of its origins. The firm has moved its workers out of Russia, truly evacuating hundreds of of us including complete families to locations outside of the nation in 2022.
The firm does no longer enable its workers to work from inner Russia can need to they traipse abet and consult with. It has additionally had to buckle down and do rigorous vetting from EU authorities to receive repute of the divestment deal.
Its professionals, who had to leave in the abet of what they had spent decades building, seem, presumably understandably, bored with answering questions connected to Russia whereas making an strive to plan one thing contemporary in varied locations. However, given the serious infrastructure nature of files centres, they could must practise endurance whereas they discipline such questions for some time to reach abet.
