this post was submitted on 28 Jan 2025
55 points (100.0% liked)
TechTakes
1583 readers
299 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless itβs amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Servers must be having a hell of a time since I can't get a verification code sent to my email π
Like, it's not even THAT much better. I mean, not so much so that everyone should flood it lmao. The main plus was no restriction on tokens used, but that's useless when it's getting overloaded all the time.
I would say it's just barely noticeably better than the free tier of GPT. Which makes it a little annoying to go back but w/e.
Can't people run it locally supposedly?
Not people who can't afford 100k to spin up their own servers. It's going to be a game changer for AI startups and such though who won't have to spend as much as previously thought.
edit: Basically, numbers out of my ass, but it's like they reduced the amount you have to spend to get chatgpt-level output from $500k to $100k. Amazing and all, definitely newsworthy, but uh... not directly relevant for us little folk, more about the ripple effects
The 671B model although 'open sourced' is a 400+GB download and is definitely not runnable on household hardware.
What? You don't have a spare $6,000 to run nonsense generators at home? Peasant...
https://xcancel.com/carrigmat/status/1884244369907278106?mx=2
Really sorry about this but this sounds like the premise to a shitty boomer joke:
βIf I wanted to spend another 6000 for a home nonsense generator, Iβd get married again!β
etc.