AI, HPC Demand Set to Boost HBM Volume by Almost 60% in 2023
June 30, 2023 | TrendForceEstimated reading time: 1 minute
High Bandwidth Memory (HBM) is emerging as the preferred solution for overcoming memory transfer speed restrictions due to the bandwidth limitations of DDR SDRAM in high-speed computation. HBM is recognized for its revolutionary transmission efficiency and plays a pivotal role in allowing core computational components to operate at their maximum capacity. Top-tier AI server GPUs have set a new industry standard by primarily using HBM. TrendForce forecasts that global demand for HBM will experience almost 60% growth annually in 2023, reaching 290 million GB, with a further 30% growth in 2024.
TrendForce's forecast for 2025, taking into account five large-scale AIGC products equivalent to ChatGPT, 25 mid-size AIGC products from Midjourney, and 80 small AIGC products, the minimum computing resources required globally could range from 145,600 to 233,700 Nvidia A100 GPUs. Emerging technologies such as supercomputers, 8K video streaming, and AR/VR, among others, are expected to simultaneously increase the workload on cloud computing systems due to escalating demands for high-speed computing.
HBM is unequivocally a superior solution for building high-speed computing platforms, thanks to its higher bandwidth and lower energy consumption compared to DDR SDRAM. This distinction is clear when comparing DDR4 SDRAM and DDR5 SDRAM, released in 2014 and 2020 respectively, whose bandwidths only differed by a factor of two. Regardless of whether DDR5 or the future DDR6 is used, the quest for higher transmission performance will inevitably lead to an increase in power consumption, which could potentially affect system performance adversely. Taking HBM3 and DDR5 as examples, the former's bandwidth is 15 times that of the latter and can be further enhanced by adding more stacked chips. Furthermore, HBM can replace a portion of GDDR SDRAM or DDR SDRAM, thus managing power consumption more effectively.
TrendForce concludes that the current driving force behind the increasing demand is AI servers equipped with Nvidia A100, H100, AMD MI300, and large CSPs such as Google and AWS, which are developing their own ASICs. It is estimated that the shipment volume of AI servers, including those equipped with GPUs, FPGAs, and ASICs, will reach nearly 1.2 million units in 2023, marking an annual growth rate of almost 38%. TrendForce also anticipates a concurrent surge in the shipment volume of AI chips, with growth potentially exceeding 50%.
Suggested Items
New Yorker, Major League Electronics Sign New Franchised Distribution Agreement
05/06/2024 | New Yorker Electronics Co.New Yorker Electronics, global distributor of electronic components, recently announced a new franchised distribution agreement with Major League Electronics, renowned manufacturer of interconnect products.
Tablet Shipments Show Signs of Recovery in Q1 2024
05/06/2024 | IDCAfter more than two years of decline, worldwide tablet shipments posted modest year-over-year growth of 0.5% in the first quarter of 2024 (1Q24), totaling 30.8 million units, according to preliminary data from the International Data Corporation (IDC) Worldwide Quarterly Personal Computing Device Tracker.
LQDX Divests Aluminum Soldering Business - Mina™ - to Taiyo America Inc.
05/02/2024 | PRNewswireLQDX, formerly known as Averatek Corp., developer of high-performance materials for advanced semiconductor manufacturing, today announced that it has divested its aluminum soldering business – known as MinaTM – to Taiyo America Inc., a global market leader in advanced electronic materials.
Arlon Electronic Materials Awarded Requalification to IPC-4101 QPL for All Polyimide Specification Sheets
04/29/2024 | IPCIPC's Validation Services Program has awarded Arlon Electronic Materials Division, an electronics material manufacturing company headquartered in Rancho Cucamonga, Calif., an IPC-4101 Qualified Products Listing (QPL) requalification for the third time.
Guerrilla RF Completes Strategic Acquisition of GaN Device Portfolio from Gallium Semiconductor
04/29/2024 | BUSINESS WIREGuerrilla RF, Inc. has finalized the acquisition of Gallium Semiconductor's entire portfolio of GaN power amplifiers and front-end modules. Effective April 26th, 2024, GUER acquired all previously released components as well as new cores under development at Gallium Semiconductor.