Nvidia's Blackwell Chips: Raising the Bar in Generative AI

Nvidia's Blackwell Chips: Raising the Bar in Generative AI

Equities 4 minutes to read
Charu Chanana

Chief Investment Strategist

Key points:

  • Revolutionary Performance: Nvidia's Blackwell chips offer up to 4x faster training and 30x faster inference than their predecessor, the Hopper H100, making them a game-changer in AI computing. They are also far more energy efficient, helping to reduce the carbon footprint.
  • Big Tech Adoption: Companies like Amazon, Microsoft, Google, Tesla and Oracle are integrating Blackwell into their AI infrastructure, driving innovation across various sectors.
  • Risks to Consider: Despite its potential, Blackwell faces challenges, including competition, AI spending pullbacks, regulatory scrutiny, supply bottlenecks and possible restrictions in the China market.

------------------------------------------------------------------------------------------------------

Nvidia's Blackwell chips are set to make a major impact, with billions of dollars in shipments expected to start in Q4 (quarter ending January 2025). The Blackwell family includes the B200 GPU and the GB200 system, succeeding the Hopper H100 series.

Here's how Blackwell differentiates itself:

  • Processing Power & Efficiency: Blackwell GPUs offer up to 4x faster training and 30x faster inference compared to the H100. They enable large AI models to be trained more efficiently with a lower carbon footprint by connecting multiple GPUs and incorporating accelerated decompression of data formats.
  • Scalability: The GB200 NVL72 system combines 36 GB200 Superchips into a single GPU, with each GB200 linking two B200 GPUs to a Grace CPU. This setup maximizes processing power and efficiency.
  • Energy Efficiency: Training a version of the GPT model that powered ChatGPT will require only 2,000 Blackwells and 4 megawatts of energy, compared to 8,000 Hoppers and 15 megawatts for the same task.
Source: Nvidia

Big Tech's Adoption: Driving AI Infrastructure

Leading tech giants like Alphabet, Microsoft, and Meta Platforms are set to be early adopters of Nvidia's Blackwell GPUs. These companies plan to integrate Blackwell into their AI infrastructure to power various applications—from AI-driven search and social media algorithms to advanced cloud services.

Some examples include:

  • Amazon: Blackwell will be included in AWS’s upcoming AI supercomputer, “Project Ceiba,” which will handle 414 exaflops of AI tasks. This system will support research in digital biology, robotics, and climate prediction.
  • Microsoft: GB200 will be on datacentres globally and enhance Azure instances, leveraging the GB200 and Nvidia’s Quantum-X800 InfiniBand networking for advanced AI functions.
  • Google: Google Cloud will adopt Blackwell for its cloud environment and offer DGX Cloud services. Blackwell GPU will also be used in Google DeepMind to accelerate future discoveries.
  • Oracle: Oracle will integrate Grace-Blackwell into its OCI Supercluster and OCI Computer services.

Beyond Big Tech: Sectors Poised to Benefit

Other industries stand to gain significantly from Blackwell's advancements:

  • Cybersecurity: Improved real-time threat detection and response through enhanced AI processing.
  • Healthcare: Accelerated drug discovery and enhanced medical imaging analysis.
  • Automotive: Advanced driver-assistance systems (ADAS) and autonomous driving technology.
  • Telecommunications: Optimized 5G networks and edge computing applications.
  • Energy and Electric Utilities: Enhanced grid management, renewable energy simulation, and smart infrastructure.

Risks: Navigating Competition and Constraints

Despite its potential, Blackwell faces several risks:

  • Competition: AMD remains a formidable competitor, and major clients like Amazon, Google, and Microsoft are developing their own chips.
  • AI Spending Pullback: Economic uncertainties may lead companies to scale back AI investments, affecting demand for Blackwell chips.
  • Regulation: Increased regulatory scrutiny around AI and data privacy could impact growth.
  • China Market Restrictions: Blackwell may not be sold in China due to U.S. export restrictions. Nvidia is working on compliant chips for the Chinese market.
  • Supply Chain: Ongoing constraints may affect Nvidia’s ability to meet demand. Further delays or design issues could impact Nvidia's growth.
  • Technological Shifts: Nvidia has released a new architecture approximately every two years, but rapid advancements may alter this cadence. The next architecture, Rubin R100, is expected in 2025.

Conclusion: Nvidia's Role in the AI Revolution

Nvidia's Blackwell chips represent a major leap in AI computing, positioning Nvidia as a leader in the AI “gold rush.” For long-term investors, Nvidia's role as a key enabler in AI infrastructure offers substantial potential, despite the associated risks.

Quarterly Outlook

01 /

  • Fixed Income Outlook: Bonds Hit Reset. A New Equilibrium Emerges

    Quarterly Outlook

    Fixed Income Outlook: Bonds Hit Reset. A New Equilibrium Emerges

    Althea Spinozzi

    Head of Fixed Income Strategy

  • Equity Outlook: Will lower rates lift all boats in equities?

    Quarterly Outlook

    Equity Outlook: Will lower rates lift all boats in equities?

    Peter Garnry

    Chief Investment Strategist

    After a period of historically high equity index concentration driven by the 'Magnificent Seven' sto...
  • FX Outlook: USD in limbo amid political and policy jitters

    Quarterly Outlook

    FX Outlook: USD in limbo amid political and policy jitters

    Charu Chanana

    Chief Investment Strategist

    As we enter the final quarter of 2024, currency markets are set for heightened turbulence due to US ...
  • Commodity Outlook: Gold and silver continue to shine bright

    Quarterly Outlook

    Commodity Outlook: Gold and silver continue to shine bright

    Ole Hansen

    Head of Commodity Strategy

  • Macro Outlook: The US rate cut cycle has begun

    Quarterly Outlook

    Macro Outlook: The US rate cut cycle has begun

    Peter Garnry

    Chief Investment Strategist

    The Fed started the US rate cut cycle in Q3 and in this macro outlook we will explore how the rate c...
  • FX: Risk-on currencies to surge against havens

    Quarterly Outlook

    FX: Risk-on currencies to surge against havens

    Charu Chanana

    Chief Investment Strategist

    Explore the outlook for USD, AUD, NZD, and EM carry trades as risk-on currencies are set to outperfo...
  • Equities: Are we blowing bubbles again

    Quarterly Outlook

    Equities: Are we blowing bubbles again

    Peter Garnry

    Chief Investment Strategist

    Explore key trends and opportunities in European equities and electrification theme as market dynami...
  • Macro: Sandcastle economics

    Quarterly Outlook

    Macro: Sandcastle economics

    Peter Garnry

    Chief Investment Strategist

    Explore the "two-lane economy," European equities, energy commodities, and the impact of US fiscal p...
  • Bonds: What to do until inflation stabilises

    Quarterly Outlook

    Bonds: What to do until inflation stabilises

    Althea Spinozzi

    Head of Fixed Income Strategy

    Discover strategies for managing bonds as US and European yields remain rangebound due to uncertain ...
  • Commodities: Energy and grains in focus as metals pause

    Quarterly Outlook

    Commodities: Energy and grains in focus as metals pause

    Ole Hansen

    Head of Commodity Strategy

    Energy and grains to shine as metals pause. Discover key trends and market drivers for commodities i...
Disclaimer

The Saxo Group entities each provide execution-only service and access to Analysis permitting a person to view and/or use content available on or via the website is not intended to and does not change or expand on this. Such access and use are at all times subject to (i) The Terms of Use; (ii) Full Disclaimer; (iii) The Risk Warning; (iv) the Rules of Engagement and (v) Notices applying to Saxo News & Research and/or its content in addition (where relevant) to the terms governing the use of hyperlinks on the website of a member of the Saxo Group by which access to Saxo News & Research is gained. Such content is therefore provided as no more than information. In particular no advice is intended to be provided or to be relied on as provided nor endorsed by any Saxo Group entity; nor is it to be construed as solicitation or an incentive provided to subscribe for or sell or purchase any financial instrument. All trading or investments you make must be pursuant to your own unprompted and informed self-directed decision. As such no Saxo Group entity will have or be liable for any losses that you may sustain as a result of any investment decision made in reliance on information which is available on Saxo News & Research or as a result of the use of the Saxo News & Research. Orders given and trades effected are deemed intended to be given or effected for the account of the customer with the Saxo Group entity operating in the jurisdiction in which the customer resides and/or with whom the customer opened and maintains his/her trading account. Saxo News & Research does not contain (and should not be construed as containing) financial, investment, tax or trading advice or advice of any sort offered, recommended or endorsed by Saxo Group and should not be construed as a record of our trading prices, or as an offer, incentive or solicitation for the subscription, sale or purchase in any financial instrument. To the extent that any content is construed as investment research, you must note and accept that the content was not intended to and has not been prepared in accordance with legal requirements designed to promote the independence of investment research and as such, would be considered as a marketing communication under relevant laws.

Please read our disclaimers:
- Notification on Non-Independent Investment Research (https://www.home.saxo/legal/niird/notification)
- Full disclaimer (https://www.home.saxo/en-hk/legal/disclaimer/saxo-disclaimer)

None of the information contained here constitutes an offer to purchase or sell a financial instrument, or to make any investments. Saxo does not take into account your personal investment objectives or financial situation and makes no representation and assumes no liability as to the accuracy or completeness of the information nor for any loss arising from any investment made in reliance of this presentation. Any opinions made are subject to change and may be personal to the author. These may not necessarily reflect the opinion of Saxo or its affiliates.

Saxo Capital Markets HK Limited
19th Floor
Shanghai Commercial Bank Tower
12 Queen’s Road Central
Hong Kong

Contact Saxo

Select region

Hong Kong S.A.R
Hong Kong S.A.R

Saxo Capital Markets HK Limited (“Saxo”) is a company authorised and regulated by the Securities and Futures Commission of Hong Kong. Saxo holds a Type 1 Regulated Activity (Dealing in Securities); Type 2 Regulated Activity (Dealing in Futures Contract); Type 3 Regulated Activity (Leveraged Foreign Exchange Trading); Type 4 Regulated Activity (Advising on Securities) and Type 9 Regulated Activity (Asset Management) licenses (CE No. AVD061). Registered address: 19th Floor, Shanghai Commercial Bank Tower, 12 Queen’s Road Central, Hong Kong.

Trading in financial instruments carries various risks, and is not suitable for all investors. Please seek expert advice, and always ensure that you fully understand these risks before trading. Trading in leveraged products may result in your losses exceeding your initial deposits. Saxo does not provide financial advice, any information available on this website is ‘general’ in nature and for informational purposes only. Saxo does not take into account an individual’s needs, objectives or financial situation. Please click here to view the relevant risk disclosure statements.

The Saxo trading platform has received numerous awards and recognition. For details of these awards and information on awards visit www.home.saxo/en-hk/about-us/awards.

The information or the products and services referred to on this site may be accessed worldwide, however is only intended for distribution to and use by recipients located in countries where such use does not constitute a violation of applicable legislation or regulations. Products and services offered on this website are not directed at, or intended for distribution to or use by, any person or entity residing in the United States and Japan. Please click here to view our full disclaimer.

Apple, iPad and iPhone are trademarks of Apple Inc., registered in the US and other countries. AppStore is a service mark of Apple Inc. Android is a trademark of Google Inc.