Nvidia's Blackwell Chips: Raising the Bar in Generative AI

Nvidia's Blackwell Chips: Raising the Bar in Generative AI

Equities 4 minutes to read
Charu Chanana

Chief Investment Strategist

Key points:

  • Revolutionary Performance: Nvidia's Blackwell chips offer up to 4x faster training and 30x faster inference than their predecessor, the Hopper H100, making them a game-changer in AI computing. They are also far more energy efficient, helping to reduce the carbon footprint.
  • Big Tech Adoption: Companies like Amazon, Microsoft, Google, Tesla and Oracle are integrating Blackwell into their AI infrastructure, driving innovation across various sectors.
  • Risks to Consider: Despite its potential, Blackwell faces challenges, including competition, AI spending pullbacks, regulatory scrutiny, supply bottlenecks and possible restrictions in the China market.

------------------------------------------------------------------------------------------------------

Nvidia's Blackwell chips are set to make a major impact, with billions of dollars in shipments expected to start in Q4 (quarter ending January 2025). The Blackwell family includes the B200 GPU and the GB200 system, succeeding the Hopper H100 series.

Here's how Blackwell differentiates itself:

  • Processing Power & Efficiency: Blackwell GPUs offer up to 4x faster training and 30x faster inference compared to the H100. They enable large AI models to be trained more efficiently with a lower carbon footprint by connecting multiple GPUs and incorporating accelerated decompression of data formats.
  • Scalability: The GB200 NVL72 system combines 36 GB200 Superchips into a single GPU, with each GB200 linking two B200 GPUs to a Grace CPU. This setup maximizes processing power and efficiency.
  • Energy Efficiency: Training a version of the GPT model that powered ChatGPT will require only 2,000 Blackwells and 4 megawatts of energy, compared to 8,000 Hoppers and 15 megawatts for the same task.
Source: Nvidia

Big Tech's Adoption: Driving AI Infrastructure

Leading tech giants like Alphabet, Microsoft, and Meta Platforms are set to be early adopters of Nvidia's Blackwell GPUs. These companies plan to integrate Blackwell into their AI infrastructure to power various applications—from AI-driven search and social media algorithms to advanced cloud services.

Some examples include:

  • Amazon: Blackwell will be included in AWS’s upcoming AI supercomputer, “Project Ceiba,” which will handle 414 exaflops of AI tasks. This system will support research in digital biology, robotics, and climate prediction.
  • Microsoft: GB200 will be on datacentres globally and enhance Azure instances, leveraging the GB200 and Nvidia’s Quantum-X800 InfiniBand networking for advanced AI functions.
  • Google: Google Cloud will adopt Blackwell for its cloud environment and offer DGX Cloud services. Blackwell GPU will also be used in Google DeepMind to accelerate future discoveries.
  • Oracle: Oracle will integrate Grace-Blackwell into its OCI Supercluster and OCI Computer services.

Beyond Big Tech: Sectors Poised to Benefit

Other industries stand to gain significantly from Blackwell's advancements:

  • Cybersecurity: Improved real-time threat detection and response through enhanced AI processing.
  • Healthcare: Accelerated drug discovery and enhanced medical imaging analysis.
  • Automotive: Advanced driver-assistance systems (ADAS) and autonomous driving technology.
  • Telecommunications: Optimized 5G networks and edge computing applications.
  • Energy and Electric Utilities: Enhanced grid management, renewable energy simulation, and smart infrastructure.

Risks: Navigating Competition and Constraints

Despite its potential, Blackwell faces several risks:

  • Competition: AMD remains a formidable competitor, and major clients like Amazon, Google, and Microsoft are developing their own chips.
  • AI Spending Pullback: Economic uncertainties may lead companies to scale back AI investments, affecting demand for Blackwell chips.
  • Regulation: Increased regulatory scrutiny around AI and data privacy could impact growth.
  • China Market Restrictions: Blackwell may not be sold in China due to U.S. export restrictions. Nvidia is working on compliant chips for the Chinese market.
  • Supply Chain: Ongoing constraints may affect Nvidia’s ability to meet demand. Further delays or design issues could impact Nvidia's growth.
  • Technological Shifts: Nvidia has released a new architecture approximately every two years, but rapid advancements may alter this cadence. The next architecture, Rubin R100, is expected in 2025.

Conclusion: Nvidia's Role in the AI Revolution

Nvidia's Blackwell chips represent a major leap in AI computing, positioning Nvidia as a leader in the AI “gold rush.” For long-term investors, Nvidia's role as a key enabler in AI infrastructure offers substantial potential, despite the associated risks.

Quarterly Outlook

01 /

  • Equity outlook: The high cost of global fragmentation for US portfolios

    Quarterly Outlook

    Equity outlook: The high cost of global fragmentation for US portfolios

    Charu Chanana

    Chief Investment Strategist

  • Commodity Outlook: Commodities rally despite global uncertainty

    Quarterly Outlook

    Commodity Outlook: Commodities rally despite global uncertainty

    Ole Hansen

    Head of Commodity Strategy

  • Upending the global order at blinding speed

    Quarterly Outlook

    Upending the global order at blinding speed

    John J. Hardy

    Global Head of Macro Strategy

    We are witnessing a once-in-a-lifetime shredding of the global order. As the new order takes shape, ...
  • Asset allocation outlook: From Magnificent 7 to Magnificent 2,645—diversification matters, now more than ever

    Quarterly Outlook

    Asset allocation outlook: From Magnificent 7 to Magnificent 2,645—diversification matters, now more than ever

    Jacob Falkencrone

    Global Head of Investment Strategy

  • Macro outlook: Trump 2.0: Can the US have its cake and eat it, too?

    Quarterly Outlook

    Macro outlook: Trump 2.0: Can the US have its cake and eat it, too?

    John J. Hardy

    Global Head of Macro Strategy

  • Equity Outlook: The ride just got rougher

    Quarterly Outlook

    Equity Outlook: The ride just got rougher

    Charu Chanana

    Chief Investment Strategist

  • China Outlook: The choice between retaliation or de-escalation

    Quarterly Outlook

    China Outlook: The choice between retaliation or de-escalation

    Charu Chanana

    Chief Investment Strategist

  • Commodity Outlook: A bumpy road ahead calls for diversification

    Quarterly Outlook

    Commodity Outlook: A bumpy road ahead calls for diversification

    Ole Hansen

    Head of Commodity Strategy

  • FX outlook: Tariffs drive USD strength, until...?

    Quarterly Outlook

    FX outlook: Tariffs drive USD strength, until...?

    John J. Hardy

    Global Head of Macro Strategy

  • Fixed Income Outlook: Bonds Hit Reset. A New Equilibrium Emerges

    Quarterly Outlook

    Fixed Income Outlook: Bonds Hit Reset. A New Equilibrium Emerges

    Althea Spinozzi

    Head of Fixed Income Strategy

None of the information provided on this website constitutes an offer, solicitation, or endorsement to buy or sell any financial instrument, nor is it financial, investment, or trading advice. Saxo Capital Markets UK Ltd. (Saxo) and the Saxo Bank Group provides execution-only services, with all trades and investments based on self-directed decisions. Analysis, research, and educational content is for informational purposes only and should not be considered advice nor a recommendation. Access and use of this website is subject to: (i) the Terms of Use; (ii) the full Disclaimer; (iii) the Risk Warning; and (iv) any other notice or terms applying to Saxo’s news and research.

Saxo’s content may reflect the personal views of the author, which are subject to change without notice. Mentions of specific financial products are for illustrative purposes only and may serve to clarify financial literacy topics. Content classified as investment research is marketing material and does not meet legal requirements for independent research.

Before making any investment decisions, you should assess your own financial situation, needs, and objectives, and consider seeking independent professional advice. Saxo does not guarantee the accuracy or completeness of any information provided and assumes no liability for any errors, omissions, losses, or damages resulting from the use of this information.

Please refer to our full disclaimer for more details.

Saxo
40 Bank Street, 26th floor
E14 5DA
London
United Kingdom

Contact Saxo

Select region

United Kingdom
United Kingdom

Trade Responsibly
All trading carries risk. To help you understand the risks involved we have put together a series of Key Information Documents (KIDs) highlighting the risks and rewards related to each product. Read more
Additional Key Information Documents are available in our trading platform.

Saxo is a registered Trading Name of Saxo Capital Markets UK Ltd (‘Saxo’). Saxo is authorised and regulated by the Financial Conduct Authority, Firm Reference Number 551422. Registered address: 26th Floor, 40 Bank Street, Canary Wharf, London E14 5DA. Company number 7413871. Registered in England & Wales.

This website, including the information and materials contained in it, are not directed at, or intended for distribution to or use by, any person or entity who is a citizen or resident of or located in the United States, Belgium or any other jurisdiction where such distribution, publication, availability or use would be contrary to applicable law or regulation.

It is important that you understand that with investments, your capital is at risk. Past performance is not a guide to future performance. It is your responsibility to ensure that you make an informed decision about whether or not to invest with us. If you are still unsure if investing is right for you, please seek independent advice. Saxo assumes no liability for any loss sustained from trading in accordance with a recommendation.

Apple, iPad and iPhone are trademarks of Apple Inc., registered in the U.S. and other countries. App Store is a service mark of Apple Inc. Android is a trademark of Google Inc.

©   since 1992