For LLMs “GPU RAM is actually one of our most valuable commodities. It's frequently the bottleneck, not compute…”
Micron is cutting spending on memory chip fabrication by 50% in 2023 and slashing 10% of its workforce, or some 5,000 jobs, with the semiconductor firm’s CEO Sanjay Mehrotra warning the memory market is facing “the most severe imbalance between supply and demand in both DRAM and NAND