BLOG · GUIDE · · UPDATED

Nutanix and GPUs: building an AI cluster

Eurokommerz, Vienna, since 2006: Private AI/ML · IT Managed Services · Enterprise Training · AI Hardware & Software

IN BRIEF
  • Six NX platforms take GPUs in Nutanix’s NX FAQ (February 2026), across the G9 and G10 generations; among them, the most per node is four L40S or H100 NVL, in the NX-9151-G9
  • GPU support cannot be read from the model code: the NX-8150G-G10 takes three cards, while the NX-8155-G9 in the same 2U1N chassis is not on Nutanix’s GPU list
  • The L40S does not split with MIG at all; the RTX PRO 6000 Server Edition splits into four 24 GB instances
  • NVIDIA supports AHV as generic Linux with KVM, and its Linux with KVM page, which names Nutanix AHV, lists MIG-backed vGPU for the RTX PRO 6000 and 4500 Server Edition; whether your AOS release runs it is for Nutanix to confirm
  • MIG instances cannot talk peer-to-peer across GPUs and NCCL does not work with MIG, so MIG slices do not suit distributed training

Which nodes take cards, and which do not

A hyperconverged node is a server that combines storage, compute and networking in one system under AOS. Drive bays and fans often leave no room for a full-size card, so some NX models take up to four accelerators and others take none.

NODEFORM FACTORGPUs
NX-9151-G92U1Nup to 4× L40S or H100 NVL 94 GB
NX-3155-G92U1Nup to 2× L40S, or up to 4× L4
NX-8150G-G102U1Nup to 3× L4, A16 or L40S
NX-8155AS-G102U1Nup to 3× L4 or A16
NX-1175S-G101U1Nup to 2× L4
NX-1150S-G92U1NGPU option for the edge (L4)
NX-8170, NX-3060, NX-3035, NX-8155, NX-8155A, NX-8173AS, NX-1120AS1U1N / 2U1N / 2U2N / 2U4Nnot on the GPU list

Platforms per Nutanix’s NX FAQ (February 2026); card counts per the node spec sheets as reprinted by resellers (G10 nodes have shipped since October 2025). Nutanix’s spec-sheet list (September 2026) also shows a 4U NX-9183-G10 for AI workloads; confirm the spec sheet of the exact model before ordering.

The model code does not tell you whether a node takes GPUs; the table above does. Two checks are reliable: the GPU line in the model’s spec sheet, and the card list validated for that chassis. The NX-9151-G9 accepts the H100 NVL; the NX-3155-G9 with the same 2U1N form factor stops at two L40S; the H100 80 GB PCIe is qualified but not sold by Nutanix. The limit is set by power and airflow rather than by the size of the case. We supply the L40S and L4 cards that Nutanix lists for these nodes. Describe your node and workload and our team will help.

Power and airflow limits for GPUs in NX nodes

The power spread across the line is large: an edge node draws a few hundred watts, while an NX-9151-G9 with four 350 W cards needs a power budget of several kVA and a matching cooling budget, a separate conversation with your data centre about the phase and row cooling.

Cooling is the second limit, because server cards are passive. The L40S and RTX PRO 6000 Server Edition have no fans of their own and depend on front-to-back chassis airflow. Without directed airflow the card overheats: on NVIDIA’s forum, an L40S in a workstation case was reported at 100 °C while idle. A passive card needs a server chassis that pushes air through it.

Passthrough, time-sliced vGPU and MIG-backed vGPU

METHODHOW IT DIVIDESISOLATION & LICENCE
Passthroughwhole card to one VMfull; no vGPU licence for compute (graphics workstations need vWS)
Time-sliced vGPUtime division, processes take turnsdedicated frame buffer per VM, shared compute, no fault isolation; licence mandatory
MIG-backed vGPUhardware slices working in parallelhardware isolation; licence mandatory

MIG has one limit that matters for multi-card node plans. According to the MIG documentation, with MIG enabled there is no peer-to-peer communication between instances on different GPUs, over PCIe or NVLink, and NCCL is not supported. NVIDIA’s position on its forum is that distributed training over MIG can in theory run through GPUDirect RDMA over the network, but more slowly than on a larger slice or with MIG disabled. Partitioning a card and fast card-to-card exchange therefore exclude each other.

MIG instances per card

CARDMAX MIG INSTANCESSMALLEST SLICE
RTX PRO 6000 Blackwell SE, 96 GB41g.24gb: 24 GB, a quarter of the SMs
RTX PRO 4500 Blackwell SE, 32 GB21g.16gb: 16 GB
H100 NVL, 94 GB71g.12gb: 12 GB
H200 NVL, 141 GB71g.18gb: 16.5 GB each by NVIDIA’s product page
L40S, L4, A2, A16no MIGpassthrough or time-sliced vGPU only

The last row matters when choosing a node: the L40S is listed for both the NX-9151-G9 and the NX-3155-G9, and it does not support MIG. Teams that choose the L40S for its compute sometimes find out later that it cannot be partitioned in hardware; on these nodes it is shared by time slicing only. The H100 NVL in the table is the one Nutanix lists for the NX-9151-G9; a reseller notice set its last-time-buy date at 1 November 2025, and we do not supply it.

vGPU and MIG support on Nutanix AHV

NVIDIA’s Nutanix AHV support page (updated 29 September 2026) supports AHV “as a generic Linux with KVM hypervisor”, and for such hypervisors NVIDIA leaves the supported GPUs and features to the hypervisor vendor. Ordinary time-sliced vGPU works. NVIDIA’s validated-platforms page for Linux with KVM (updated 29 September 2026), which names Nutanix AHV among the hypervisor vendors, lists 1:1 and time-sliced MIG-backed vGPU for the RTX PRO 6000 and RTX PRO 4500 Blackwell Server Edition and leaves the supported releases to the vendor, so ask Nutanix whether your AOS and AHV release supports it before planning MIG slices for VMs. Verify compatibility for your AOS version before ordering: NVIDIA AI Enterprise 8.2 lists Nutanix AOS 6.5 to 6.10, marked “single-node only”, and NVIDIA supports AI Enterprise only on NVIDIA-Certified Systems, a list on which the NX-9151-G9 is the only NX node as of October 2026.

Two further issues appear only after deployment. The first is live migration, which for a vGPU VM requires the identical physical card on the receiving host and a driver from the same release branch that is the same or newer, and never works across different MIG profiles. Nutanix states that AHV live-migrates vGPU VMs to a host with a matching free vGPU profile; NVIDIA’s support page treats AHV as generic Linux with KVM, so confirm with Nutanix that your AOS and vGPU release support it before you plan maintenance around it. The second is behaviour without a valid licence: NVIDIA’s current client licensing guide (updated 29 September 2026) states that a graphics vGPU’s performance is degraded if the VM has no licence after 20 minutes and further degraded after one day, without naming figures; the 15 fps and 3 fps caps come from the guide for vGPU release 16, which does not support the RTX PRO Blackwell cards. A compute (C-series) vGPU drops to idle-level compute after a 20-minute grace period, according to NVIDIA AI Enterprise’s licensing page (2 September 2026). C-series compute profiles come only with NVIDIA AI Enterprise, licensed per GPU, while graphics vWS is licensed per concurrent user, so these are two separate budget lines.

We supply the NVIDIA AI Enterprise and vGPU licences an AHV cluster needs, on the same quote as the GPUs. Tell us your nodes and the vGPU profiles you plan, and we reply within one business day.

How many VMs per card

vGPU TYPEMEMORY PER VMVMs PER CARD
DC-96C96 GB1
DC-48C48 GB2
DC-24C24 GB4
DC-12C12 GB8
DC-8C8 GB12

Compute profiles for the RTX PRO 6000 Blackwell Server Edition

For virtual desktops NVIDIA’s sizing guide gives two to four heavy users per RTX PRO 6000 (DC-12Q to DC-24Q profiles) and six to eight light users per RTX PRO 4500 Server Edition (DC-4Q). NVIDIA’s guide adds that the default best-effort scheduler often allows two to three times that user density. For monitoring, VM video-memory use should rarely exceed 90% and should average below 70%.

WHAT WAS MEASUREDNO PARTITIONINGWITH MIG
flan-t5-base on A100 40 GB (Red Hat)~4,200 tok/s~9,800 tok/s on 7 slices

Source: Red Hat blog, “Sharing is caring: How to make the most of your GPUs part 2 – Multi-instance GPU”, 6 September 2024: an A100 40 GB split into 7 × 1g.5gb; a measurement on Ampere, not on the cards discussed above.

Each slice is slower than the whole card, but a small model does not saturate an A100, so in Red Hat’s test seven slices together delivered about 2.3 times the throughput of the undivided card.

Cluster size and GPU pool: where to start

The working starting configuration is three nodes: RF2 replication runs on three, and the cluster keeps its data available when one node fails, while high availability restarts that node’s VMs on the others. A VM with a GPU restarts only on a node with a free card of the same type, which is one more reason for the next paragraph. Cards are not needed in every node; a common pattern is three nodes for general workloads, one or two of them with accelerators for inference.

Keep the GPU pool homogeneous, because live migration needs the same card on both hosts. A second node with the same card gives headroom and a place for VMs to move during maintenance. A mixed cluster with an L40S in one node and an RTX PRO 6000 in another works too, but every planned maintenance then means stopping the services on the node with the different card.

What we supply

We supply the L40S and L4 cards that Nutanix lists for NX nodes, and the RTX PRO 6000 Server Edition, with manufacturer warranty on one EU contract and invoice. The NVIDIA AI Enterprise and vGPU licences that C-series and graphics vGPU profiles need come on the same contract. Nutanix NX nodes can be quoted on request; which cards a given node takes, and whether they must ship with the node, is for Nutanix to confirm. Deployment and virtualisation engineering comes from our engineering partner Vixen.UNO under the same contract.

FAQ

Which Nutanix NX nodes support GPUs?
Six platforms across the G9 and G10 generations, in Nutanix’s NX FAQ of February 2026: NX-9151-G9 (up to four L40S or H100 NVL), NX-3155-G9 (up to two L40S or four L4), NX-8150G-G10 (up to three L4, A16 or L40S), NX-8155AS-G10 (up to three L4 or A16), NX-1175S-G10 (up to two L4) and the NX-1150S-G9 edge node. Nutanix’s spec-sheet list (September 2026) also shows the newer 4U NX-9183-G10 for AI workloads, so check its spec sheet.
How many GPUs does an NX-3155-G9 hold?
Up to two L40S or up to four L4, in a 2U single-node chassis; the H100 80 GB is qualified but not sold by Nutanix. Power and airflow, not the case, set the ceiling.
Does NX-8155-G9 support H100?
No. The NX-8155-G9 is not on Nutanix’s GPU list at all; its GPU sibling is the NX-8150G-G10 with up to three L4, A16 or L40S. The H100 NVL is limited to the NX-9151-G9.
The L40S does not support MIG. How do we divide it?
Time-sliced vGPU. The L40S-8Q profile gives six instances per card; NVIDIA’s mixed-size layout (four) does not apply on AHV, where Nutanix keeps one profile type per GPU. There is no hardware memory or fault isolation; the card switches between VMs in time.
Do we need AI Enterprise to hand a MIG instance to a VM?
For C-series compute profiles, yes: they ship only with AI Enterprise, licensed per GPU in the server, and NVIDIA supports AI Enterprise only on NVIDIA-Certified Systems. MIG itself on bare Linux needs no licence; the licence cost starts when a slice is passed to a VM through a hypervisor.
An RTX PRO 6000 Server Edition is capped at 450 W instead of 600. Is it defective?
Most often it is the cable: the 12V-2×6 sense configuration sets the power limit, and some bundled server cables are configured for 450 W. The cable for 600 W is a separate part number; put it in the bill of materials.
What do two cards in a node give over one?
They do not form one memory pool: two 48 GB cards are two separate 48 GB devices. A model too large for one card can still be split across both; for PCIe-only cards such as the L40S, vLLM’s documentation recommends pipeline rather than tensor parallelism. Otherwise they let several models stay resident side by side (reranker, embeddings, main LLM), or serve twice the users.
Can we mix L40S and RTX PRO 6000 nodes in one cluster?
It works, but where live migration of vGPU VMs is supported it requires identical cards, so each planned maintenance means stopping services on the odd node. Keep the GPU pool homogeneous where you can.

We supply the L40S, L4 and RTX PRO 6000 Server Edition, plus NVIDIA AI Enterprise and vGPU licences for AHV. Describe your task in a few lines and our team will help: we reply within one business day. The first call is free of charge.

Talk to an expert
Talk to an expert

We reply within one business day

By sending this form you agree that we process your details to answer your enquiry; see our privacy policy.

request@eurokommerz.at
Jordangasse 7, 1010 Vienna