A Khaleesi's View on Silicon Valleys's Memory Woes
As Daenerys Stormborn of the House Targaryen First of Her Name Queen of the Andals and the Rhoynar and the First Men Lady of the Seven Kingdoms and Protector of the Realm I've seen empires rise and fall. I've learned that even the mightiest dragon can be brought to its knees and the sharpest minds can also face some problems. This talk of Google making AI more efficient sounds suspiciously like Varys whispering in my ear about 'the good of the realm.' But let's see if this 'efficiency' actually benefits anyone besides the Iron Bank and Google's coffers.
TurboQuant A New Type of Dragonfire?
Google's TurboQuant promises to reduce the amount of memory required to run these large language models. They claim it can cut down memory needs by six times. Six times Does this mean I could fit six times as many Unsullied on a single ship Sounds too good to be true. Matthew Prince the CEO of Cloudflare seems to think this is a big deal comparing it to some breakthrough by a Chinese AI firm. He speaks of optimizing AI inference for speed and memory usage. I'm more concerned with optimizing my armies' speed and dragonfire usage but I suppose these things are related in a strange Westerosi sort of way. However before we all start selling our Samsung stock faster than you can say 'Dracarys,' perhaps it's worth considering whether this is truly the end of the world. Perhaps the Treasury's Market Intervention Buzz is a No Go similar to how this efficiency drive might not kill the memory market after all. Treasury's Market Intervention Buzz a No Go
The Hand's Counsel: Not All Is Lost
Ray Wang some sort of memory analyst at SemiAnalysis seems less panicked than the market. He thinks that improving model performance will inevitably lead to higher memory usage saying "When you address a bottleneck you are going to help AI hardware to be more capable." This sounds like something Tyrion would say trying to reassure me that we haven't completely ruined King's Landing with dragonfire. Maybe this TurboQuant thing is just a way to make things better not necessarily smaller. Time will tell if his analysis is as sharp as the Imp's wit.
A Perfect Storm or Just a Summer Breeze?
Despite all this hand wringing there are factors still supporting the memory market. High demand supply shortages and profits for companies like Samsung and SK Hynix are keeping things afloat. Samsung shares have risen nearly 200% over the last year. That's almost as impressive as Drogon's growth rate. Analysts are calling this week's stock drops "profit taking." In other words investors are cashing in before the winter truly comes. It reminds me of the lords of Westeros hoarding their gold while the smallfolk starve. Always a risk of that with the financial markets.
The Wisdom of the Maesters: Evolutionary Not Revolutionary
Ben Barringer head of technology research at Quilter Cheviot says that Google's innovation is "evolutionary not revolutionary." He claims it doesn't change the industry's long term demand picture. It is like when the Maesters tell me that winter is coming but I've already got three dragons ready to barbecue any White Walkers that dare show their icy faces. Still in a market "primed to de risk," even small changes can cause panic. Everyone is always looking for the next big thing to worry about.
Khaleesi's Verdict: HODL!
So what does a Dragon Queen make of all this AI and memory stock madness I say "Hold fast". If you believe in the future and the Mother of Dragons always does then remember that every empire faces challenges. This TurboQuant might be a small setback but it's hardly the Long Night. And just as I rose from the ashes of a fallen dynasty so too will the memory market likely adapt and thrive. But as with all things watch closely and be ready to unleash your own dragonfire if necessary.
Comments
- No comments yet. Become a member to post your comments.