Rise of cloud and edge AI applications paves way for new semiconductor opportunities; wafer foundries become crucial, says DIGITIMES Research

TAIPEI, Oct. 7, 2024 /PRNewswire/ -- With the rapid development of the global generative AI market, the semiconductor industry is undergoing unprecedented transformation. DIGITIMES Research released the latest AI Chips Special Report, which highlights that the training and inference of generative AI models rely heavily on substantial computing resources. AI chips providing computational power are becoming a focal point. Whether it's high-performance AI accelerators in cloud data centers or edge AI device chips driven by privacy concerns, these developments signal an explosive growth period for both hardware and software opportunities in AI applications. Advanced manufacturing technologies and capacities of wafer foundries will be key to realizing the accelerated computing needs of AI chips.

Generative AI development is led by cloud-based AI, with wafer foundries' advanced processes, advanced packaging, HBM capacity expansion, and strong demand for AI servers in cloud data centers. Analyst Stella Weng forecasts that from 2023 to 2028, the compound annual growth rate (CAGR) of high-end GPUs for the cloud will reach 44%, while cloud ASIC accelerators will see a CAGR of 52%. Weng further notes that 2022 to 2024 will be a high-growth period for cloud AI accelerators. As cloud service providers refine their AI application infrastructure, the growth in AI server demand is expected to slow down in the future, gradually shifting towards replacement-focused demand.

In response to the strong production demand for cloud and edge AI chips, wafer foundries are also accelerating the expansion of advanced processes and packaging capacities. Analyst Eric Chen estimates that from 2023 to 2028, the CAGR of advanced process expansion below 5 nanometers in the wafer foundry industry will reach 23%. In the field of advanced packaging, AI chips heavily rely on TSMC's CoWoS packaging technology, and thus TSMC's CoWoS capacity expansion CAGR will exceed 50% from 2023 to 2028. Chen also mentioned that to meet the shipping and performance enhancement needs of AI chips, wafer foundries are actively advancing the development of advanced processes and packaging technologies, including photolithography techniques, new transistor structures, back-end power delivery (BSPDN), 2.5D/3D advanced packaging, glass substrates, chip-on-wafer-on-substrate (CoWoS), and silicon photonics integration.

Generative AI applications are rapidly expanding, transitioning from cloud-based services to edge deployments. DIGITIMES Research believes that smartphones and PCs will be the first to adopt scaled production. The development and market changes of AI application processors (APs) in smartphones are noteworthy. Analyst Jim Chien forecasts that global shipments of generative AI smartphone APs will reach 260 million units in 2024 and could rise to 800 million units by 2028, with a shipment CAGR of 65% during this period. Benefiting from the growth in AI smartphone AP shipments, an estimated 240 million AI smartphones will be shipped in 2024, with a trend of annual increases, potentially exceeding a 50% penetration rate for AI smartphones by 2028.

In the AI PC sector, analyst Joyce Chen notes that in 2024, PC hardware and software vendors are actively testing the AI PC market. By 2025, with PC processors enhancing computational power and reducing power consumption through more advanced processes, and with Microsoft's discontinuation of Windows 10 and the introduction of Copilot products to the endpoint market, a new wave of AI PC growth will emerge. Chen predicts that AI PC processor shipments will approach 50 million units in 2024, with subsequent shipments increasing annually as PC hardware and software integration stabilizes, reaching up to 150 million units by 2028, with a shipment CAGR of 39% during this period.

Looking ahead, the deployment of AI applications will bring substantial business opportunities, not only expanding existing markets but also transforming current technology and capacity demands under new needs, further intensifying competition in the chip market and leading to unprecedented changes in the semiconductor ecosystem.

For more insights into the impact of generative AI on cloud and edge computing, read our latest AI Chip Special Report. It will guide you through the development of technologies across the supply chain, including upstream, midstream, and downstream, as well as the emergence of various AI hardware devices, providing detailed insights into market share and development blueprints for AI chips

About DIGITIMES Asia

DIGITIMES Asia is a leading professional media platform specializing in global technology industry supply chains, regional markets, technology applications, and market trends. DIGITIMES Research offers comprehensive research data, production and sales information, and expert analysis across industry sectors and end markets, providing consulting services that bring macro trends and forward-looking value to clients.

SOURCE DIGITIMES ASIA