InfraSaudi HUMAIN is now selling compute on AMD chips, and the next step is 250 megawattsOn 31 August AMD, Cisco and HUMAIN announced that AMD Instinct MI355X systems are live in Saudi Arabia and serving customers. The next phase is a plan: up to 250 megawatts on the new MI400 generation from 2027. Their joint venture's target remains up to 1 gigawatt by 2030.InfraCloudflare rearranged one record in memory and got 100 terabytes back, and the cache got fasterThe platform behind 1.1.1.1 holds over 250 billion cache entries at any moment. Five successive changes to how they are laid out cut each entry by more than half. The memory freed is roughly the entire RAM of 130 of their servers.InfraNVIDIA moved the memory controller off the chip and put it inside the memory itselfOn 26 August NVIDIA added NVHBM to NVLink Fusion - memory whose base die now carries their own controller. The claim is up to 30 per cent more bandwidth, 15 per cent less power and up to a quarter of the compute die freed up. Amazon's Annapurna Labs goes first.InfraMeta unveils MTIA 300, its first chip built to train modelsMTIA 300 is Meta's first accelerator built to train models, not just serve answers from finished ones. It targets recommendation and ranking systems, with the network built straight into the silicon. By Meta's own numbers, total communication time drops 3.9x versus an equivalent GPU cluster.InfraMeta wrote its own AI network protocol and opened it through the Open Compute ProjectMetaRoCE is a transport protocol written from scratch for the conversations between thousands of AI accelerators over plain Ethernet. By the company's own numbers, it keeps about 86 percent of throughput even at one percent packet loss. The spec, the reference code and the compliance test are going public.InfraNVIDIA reports 30x more agentic throughput per megawatt, but the number still awaits independent reviewNVIDIA published its own measurements for Vera Rubin NVL72: 30 times more agentic throughput per megawatt and 35 times lower cost per token versus the previous generation. The numbers are theirs, on a workload they ran themselves, and by the company's own words still await review from SemiAnalysis.InfraGroq 3 LPX enters production, built together with NVIDIA's platformA rack-level inference accelerator, co-designed with Vera Rubin NVL72. It combines GPUs with dedicated fast-response modules and handles token generation in agentic systems. Already deploying at Nebius, CoreWeave and SpaceXAI.InfraAWS Glue 6.0 cuts the price by 30 percent and adds full Iceberg v3 supportAWS shipped version 6.0 of Glue, its data-processing service, at 30 percent lower cost than previous versions. Underneath is a new engine, and on top, full support for the Iceberg table format v3.
48 stories