13
TechnologyAnyone else following the commentary on Deepseek?
Nvidia has seen almost $1 trillion wiped off its value and other tech giants have been hammered.
Copy & pasting some X commentary
First, some context:
Right now, training top AI models is INSANELY expensive. OpenAI, Anthropic, etc. spend $100M+ just on computing. They need massive data centers with thousands of $40K GPUs. It's like needing a whole power plant to run a factory.
DeepSeek just showed up and said "LOL what if we did this for $5M instead?" And they didn't just talk - they actually DID it. Their models match or beat GPT-4 and Claude on many tasks. The AI world is (as my teenagers say) shook.
How? They rethought everything from the ground up. Traditional AI is like writing every number with 32 decimal places. DeepSeek was like "what if we just used 8? It's still accurate enough!" Boom - 75% less memory needed.
Then there's their "multi-token" system. Normal AI reads like a first-grader: "The... cat... sat..." DeepSeek reads in whole phrases at once. 2x faster, 90% as accurate. When you're processing billions of words, this MATTERS.
But here's the really clever bit: They built an "expert system." Instead of one massive AI trying to know everything (like having one person be a doctor, lawyer, AND engineer), they have specialized experts that only wake up when needed.
Traditional models? All 1.8 trillion parameters active ALL THE TIME. DeepSeek? 671B total but only 37B active at once. It's like having a huge team but only calling in the experts you actually need for each task.
The results are mind-blowing:
Training cost: $100M → $5M
GPUs needed: 100,000 → 2,000
API costs: 95% cheaper
Can run on gaming GPUs instead of data center hardware
"But wait," you might say, "there must be a catch!" That's the wild part - it's all open source. Anyone can check their work. The code is public. The technical papers explain everything. It's not magic, just incredibly clever engineering.
Why does this matter? Because it breaks the model of "only huge tech companies can play in AI." You don't need a billion-dollar data center anymore. A few good GPUs might do it.
For Nvidia, this is scary. Their entire business model is built on selling super expensive GPUs with 90% margins. If everyone can suddenly do AI with regular gaming GPUs... well, you see the problem.
And here's the kicker: DeepSeek did this with a team of <200 people. Meanwhile, Meta has teams where the compensation alone exceeds DeepSeek's entire training budget... and their models aren't as good.
This is a classic disruption story: Incumbents optimize existing processes, while disruptors rethink the fundamental approach. DeepSeek asked "what if we just did this smarter instead of throwing more hardware at it?"
The implications are huge:
Of course, giants like OpenAI and Anthropic won't stand still. They're probably already implementing these innovations. But the efficiency genie is out of the bottle - there's no going back to the "just throw more GPUs at it" approach.
Final thought: This feels like one of those moments we'll look back on as an inflection point. Like when PCs made mainframes less relevant, or when cloud computing changed everything.
AI is about to become a lot more accessible, and a lot less expensive. The question isn't if this will disrupt the current players, but how fast.
/end P.S. And yes, all this is available open source. You can literally try their models right now. We're living in wild times! 🚀 Momma, I'm going viral! No substack or gofundme to share but a few things to add/clarify:
1/ The DeepSeek app is not the same thing as the model. Apps are owned and operated by a Chinese corporation, the model itself is open source.
2/ Jevon's paradox is the counter argument. Thanks papa @satyanadella. Could be a mix shift in chip type, compute type, etc. but we're constrained by power and compute right now, not demand constrained.
3/ The techniques used are not ground breaking. It's the combination of them w/the relative model performance that is so exciting. These are common eng techniques that combined really fly in the face of more compute is the only answer for model performance. Compute is no longer a moat.
4/ Thanks to all for pointing out my NVIDIA market cap numbers miss and other nuances - will do better next time, coach. 🫡 • • •
"Biological woman" isn't accurate in general, you're not born as a woman lol
I came out the womb with a full face of makeup, long luscious locks of chocolate brown hair and 3 inch long nails and platform high heels 😞 I was born a bimbo /j
Wow this is.. very telling.
because they refuse to utilize language properly they’re impossible to speak to
TIPs lack of self-awareness really is something else🤣
My head hurts from trying to parse comments from people who:
Say sex and gender are different.
Say sex isn't definable, and trying to define sex is discriminatory.
Believe you can and should change your sex if you believe you are the opposite gender.
Refuse any attempt to clearly define these terms that are apparently SO IMPORTANT that people will die if we don't use the right words.
yes! but also you're stupid and falling prey to the elite by focusing on identity politics at all. people will die, sweaty, but also debating that makes you a pawn bc I say so.
I don't even know what to quote here, every single line of this post is a gem in its own way. Let's go with this one
So thus people think we're delusional saying that "cis men have cycles" When that was never the discussion
People do think you're delusional, but most of us understand what you mean. The reason you're delusional is because you refuse to admit that man/woman are anatomical terms, and saying "biological women" rather than just women is already being redundant purely to accommodate you.
But because they refuse to utilise language properly they're impossible to speak to
Oh, I know this one. It's the usual trans DARVO !
These people are exhausting.
Also, “non passing gaysian”, really? You’re just a heterosexual woman. How can you say you’re a biological man and also not pass as one.
Didn't even catch that, that makes the "I have more medically/physically in common with men" claim even more hilarious
These morons really think that they magically become real boys if they just inject enough fake testosterone into their butt cheeks. Your female biology will fucking matter if you ever go to the ER because you're dying from an ectopic pregnancy or a miscarriage. Or if your uterus atrophied and goes septic inside you (which nearly killed Buck Angel).
God help me, but I think these idiots deserve to collect their Darwin Awards
Teaching us lowly wimmenz about the difference between sex and gender is like teaching evolution to apes according to the wisdom of 'Nasal Strip'. Oh, excuse me, 'really really stupid apes'. I guess the hyperbole wasn't driven home enough by simply comparing us to apes, we must be described as the less academically gifted apes as well.
And as for Tiny Management's comment...yikes. I'm not even going to touch that. Jeez.
"AMAB people don't have cycles".
Then how exactly they decided to "assign" male to them, huh? Its almost like there is something biological about it
I'm concerned about the one in the comments claiming that, actually, some AMAB people do have periods.
I swear every TRA post anywhere is like:
OP: We know (for example) male people don’t have periods, we’re not crazy
Lots of replies: NOBODY is saying male people have periods, stop implying we’re crazy
Lots of other replies: Actually some male people do have periods, stop being a bigot
When will they learn that sex and gender are different?”
Ok, I accept they’re different. I chose to use sex to describe what category of person I am dealing with. So Mr. TIM, I am happy to refer to you according to your sex, which is male. Glad we are on the same page.
These are TIFs
Still stands, imo. TIFs are just as female as TIMs are male. TIFs have different motivations but the core of trans is misogyny for both men and women. It gives me no joy to say it either.
Even my erstwhile TIF friend, who was practically a textbook TIF (history of CSA, abuse and dysfunction, self-diagnosed autistic but in her case I think she might have traits, lesbian, thought that other women at least accepted their oppression and that she was the only little girl that didn’t want to wear a shirt and felt she was in competition with men physically and sexually) has misogyny mixed with NLOG that runs deep. I get frustrated but I still worry about her. Living a lie isn’t good for people and our sex is inescapable.
There mfs use language to combat science. Most people use thier eyes. Our brains process information 0.8 seconds later and we already know what's in front of us that's why we address without much thinking.
🤨
I bet she insists that her gynecologist covers the office in manly colors and uses a speculum shaped like a Hot Wheel. 🤣
"Excuse me, doctor, but I use MANPONS and MAXI CHADS when I MANstruate!"