HBM Supply Leader SK Hynix’s Market Share to Exceed 50% in 2023 Due to Demand for AI Servers
April 20, 2023 | TrendForceEstimated reading time: 2 minutes
A strong growth in AI server shipments has driven demand for high bandwidth memory (HBM). TrendForce reports that the top three HBM suppliers in 2022 were SK hynix, Samsung, and Micron, with 50%, 40%, and 10% market share, respectively. Furthermore, the specifications of high-end AI GPUs designed for deep learning have led to HBM product iteration. To prepare for the launch of NVIDIA H100 and AMD MI300 in 2H23, all three major suppliers are planning for the mass production of HBM3 products. At present, SK hynix is the only supplier that mass produces HBM3 products, and as a result, is projected to increase its market share to 53% as more customers adopt HBM3. Samsung and Micron are expected to start mass production sometime towards the end of this year or early 2024, with HBM market shares of 38% and 9%, respectively.
AI server shipment volume expected to increase by 15.4% in 2023
NVIDIA’s DM/ML AI servers are equipped with an average of four or eight high-end graphics cards and two mainstream x86 server CPUs. These servers are primarily used by top US cloud services providers such as Google, AWS, Meta, and Microsoft. TrendForce analysis indicates that the shipment volume of servers with high-end GPGPUs is expected to increase by around 9% in 2022, with approximately 80% of these shipments concentrated in eight major cloud service providers in China and the US. Looking ahead to 2023, Microsoft, Meta, Baidu, and ByteDance will launch generative AI products and services, further boosting AI server shipments. It is estimated that the shipment volume of AI servers will increase by 15.4% this year, and a 12.2% CAGR for AI server shipments is projected from 2023 to 2027.
AI servers stimulate a simultaneous increase in demand for server DRAM, SSD, and HBM
TrendForce points out that the rise of AI servers is likely to increase demand for memory usage. While general servers have 500–600 GB of server DRAM, AI servers require significantly more—averaging between 1.2–1.7 TB with 64–128 GB per module. For enterprise SSDs, priority is given to DRAM or HBM due to the high-speed requirements of AI servers, but there has yet to be a noticeable push to expand SSD capacity. However, in terms of interface, PCIe 5.0 is more favored when it comes to addressing high-speed computing needs. Additionally, AI servers tend to use GPGPUs, and with NVIDIA A100 80 GB configurations of four or eight, HBM usage would be around 320–640 GB. As AI models grow increasingly complex, demand for server DRAM, SSDs, and HBM will grow simultaneously.
Suggested Items
Industrial PC Market Size to Record $1.75 Billion Growth from 2023-2027
05/03/2024 | PRNewswireThe global industrial pc market size is estimated to grow by USD 1.75 billion from 2023 to 2027, according to Technavio. This growth is expected to occur at a Compound Annual Growth Rate (CAGR) of almost 6.29% during the forecast period.
Real Time with… IPC APEX EXPO 2024: Direct Imaging Equipment and Quad-wave DLP Light Engine Technology
05/03/2024 | Real Time with...IPC APEX EXPOGuest Editor Kelly Dack and MivaTek's Brendan Hogan delve into the company's innovative technologies, including direct imaging equipment and quad-wave DLP light engine technology. They highlight the benefits of direct imaging, compensation, and DART technology.
LQDX Divests Aluminum Soldering Business - Mina™ - to Taiyo America Inc.
05/02/2024 | PRNewswireLQDX, formerly known as Averatek Corp., developer of high-performance materials for advanced semiconductor manufacturing, today announced that it has divested its aluminum soldering business – known as MinaTM – to Taiyo America Inc., a global market leader in advanced electronic materials.
IDTechEx Report on Quantum Technology: Nano-scale Physics for Massive Market Impact
04/30/2024 | PRNewswireThe quantum technology market leverages nano-scale physics to create revolutionary new devices for computing, sensing, and communications. Across the industry, quantum technology offers a paradigm shift in performance compared with incumbent solutions.
Guerrilla RF Completes Strategic Acquisition of GaN Device Portfolio from Gallium Semiconductor
04/29/2024 | BUSINESS WIREGuerrilla RF, Inc. has finalized the acquisition of Gallium Semiconductor's entire portfolio of GaN power amplifiers and front-end modules. Effective April 26th, 2024, GUER acquired all previously released components as well as new cores under development at Gallium Semiconductor.