AMD confirms CDNA3 based Instinct MI300X GPU requires 750W of power

Published: Jun 15th 2023, 08:40 GMT   Comments

AMD Instinct MI300X, a powerhouse for AI large language models

AMD discloses how much power the MI300X requires. 

The OAM-based (OCP Accelerator Module) design of the MI300X graphics processor is listed with 750W on AMD slides. This was not mentioned by early reports covering the introduction day earlier this week. This board power requirements was spotted in the footnotes after the event.

AMD developed a special version of its MI300 series accelerator exclusively with CDNA3 tiles. This accelerator will be offered alongside MI300A, the so-called data center exascale APU, which features 24 Zen4 cores combined with GPU tiles.

The MI300X has increased GPU core tiles and has more memory (192GB) thanks to the recently introduced 24GB HBM3 stacks. Raw GPU power combined with lots of memory have contributed in to higher power now reaching 750W for one OAM modules. This is more than the last-gen (CDNA2) MI250X which only went up to 560W.

Instinct MI300WX TBP, Source: AMD

Over the past few years, the power requirements for GPU data-center products have increased. NVIDIA H100 SXM GPU TDP goes up to 700W and 350W for the PCIe air-cooled version. The PCIe version of Intel Max 1550 Data Center GPU based on Ponte Vecchio silicon also requires at least 600W of power.

The naming of power requirements and designs varies depending on the manufacturer. Power characteristics like TDP, TBP or Power Envelope may not always mean the same thing. But the important thing is that the GPU rivalry in the data-center space has only just started, so who knows if we are going to see an even higher power specifications listed on official slides soon.

Source: AMD via Hoang Anh Phu

Comment Policy
  1. Comments must be written in English and should not exceed 1000 characters.
  2. Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  3. Comments and usernames containing language or concepts that could be deemed offensive will be deleted.
  4. Comments complaining about the post subject or its source will be removed.
  5. A failure to comply with these rules will result in a warning and, in extreme cases, a ban. In addition, please note that comments that attack or harass an individual directly will result in a ban without warning.
  6. VideoCardz has never been sponsored by AMD, Intel, or NVIDIA. Users claiming otherwise will be banned.
  7. VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  8. If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy