Tech News
AI is collapsing the boundaries inside modern data centres
AI infrastructure is no longer only about the chip. Epoch AI reports that the total memory bandwidth of AI chips shipped since 2022 has reached 70 million TB/s, growing 4.1x per year [s1]. A 2025 arXiv paper cites earlier work showing up to 87% less GPU memory use from CXL offload [s2]. Data Center Knowledge names networking and memory among the decisive technologies [s3].