If Microsoft Get This One Thing Right, the Stock Could Explode - The Motley Fool
If Microsoft Get This One Thing Right, the Stock Could Explode The Motley Fool
Could not retrieve the full article text.
Read on GNews AI Microsoft →Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
stock![[D] The memory chip market lost tens of billions over a paper this community would have understood in 10 minutes](https://d2xsxph8kpxj0f.cloudfront.net/310419663032563854/konzwo8nGf8Z4uZsMefwMr/default-img-quantum-N2hdoEfCm2gAozJVRfL5wL.webp)
[D] The memory chip market lost tens of billions over a paper this community would have understood in 10 minutes
TurboQuant was teased recently and tens of billions gone from memory chip market in 48 hours but anyone in this community who read the paper would have seen the problem with the panic immediately. TurboQuant compresses the KV cache down to 3 bits per value from the standard 16 using polar coordinate quantization. But the KV cache is inference memory. Training memory, activations, gradients, optimizer states, is a completely different thing and completely untouched. And majority of HBM demand comes from training. An inference compression paper doesn't move that number. And the commercial inference baseline already runs at 4 to 8 bit precision. The 6x headline is benchmarked against 16 bit full precision. The real marginal gain over what's actually deployed is considerably smaller than that
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
More in Market News
Microsoft to Invest $10 Billion in Japan on AI Infrastructure, Cybersecurity - WSJ
Microsoft to Invest $10 Billion in Japan on AI Infrastructure, Cybersecurity WSJ Microsoft to invest $10 billion in Japan for AI and cyber defence expansion Reuters Japan's Sakura Internet jumps 20% as Microsoft plans $10 billion AI push with SoftBank CNBC Microsoft Drafts $10 Billion Investment Plan in AI-Hungry Japan Bloomberg.com Microsoft deepens its commitment to Japan with $10 billion investment in AI infrastructure, cybersecurity, and workforce Microsoft Source Microsoft to pour $10bn into Japan data centers, work with SoftBank on AI Nikkei Asia Microsoft to make $10 billion AI-related investment in Japan Japan Wire by Kyodo News
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!