this post was submitted on 02 Oct 2024
110 points (93.0% liked)

Technology

59380 readers
3718 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Built on unearned hype.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 20 points 1 month ago (2 children)

Honestly, I can say I don't really get it either. I would only use the open source models anyway, but it just seems rather silly from what I can tell.

[–] [email protected] 5 points 1 month ago* (last edited 1 month ago) (1 children)

I would only use the open source models anyway, but it just seems rather silly from what I can tell.

I feel like the last few months have been an inflection point, at least for me. Qwen 2.5, and the new Command-R, really make a 24GB GPU feel "dumb, but smart," useful enough so I pretty much always keep Qwen 32B loaded on the desktop for its sheer utility.

It's still in the realm of enthusiast hardware (aka a used 3090), but hopefully that's about to be shaken up with bitnet and some stuff from AMD/Intel.

Altman is literally a vampire though, and thankfully I think he's going to burn OpenAI to the ground.

[–] [email protected] -4 points 1 month ago (3 children)

What do you think about the possibility of decentralized AI through blockchain so that you could pay some tokens or something like that to rent the GPUs to run your AI for as long as you wish to instead of having to buy all the hardware and assemble it yourself?

[–] [email protected] 13 points 1 month ago (2 children)

I cannot tell if you are being serious or just having fun with buzzwords

[–] [email protected] 1 points 1 month ago (1 children)

Oh, I'm being completely serious. I've been interested in crypto since about 2013.

[–] [email protected] 0 points 1 month ago

There is no need to use Blockchain for this. Computing pools like this have been used for ages

[–] [email protected] 1 points 1 month ago

I stopped at block chain

[–] [email protected] 0 points 1 month ago

Isn't that just cloud computing but with extra steps?

[–] [email protected] 0 points 1 month ago

Tbh it's just hard to see the value proposition in the age of cloud computing. I think aspects of the underlying technology are cool but basically every crypto project that comes to mind has been an actual scam. Sure there's eth and RDNR that was built on top of it but why should i spend what will ultimately be more money in periods of high demand (gas goes up when more people use the network) when i can just plug my credit card into amazon or microsoft AND get the benefit of infosec regulation like PCI-DSS. Crypto just doesn't ever inspire confidence because bad actors consistently shit in the punch bowl while providing no extra utility over existing cloud providers.

When distilled down crypto-compute just seems like cloud compute with extra steps, which is already just using a computer with extra steps.

We already can rent GPUs to run AIs with tokens - those tokens are just managed by govt instead of some random.

[–] [email protected] 5 points 1 month ago (1 children)

Are you trying to solve science with it or something? You are supposed to turn carefully worded sentences into funny pictures and show people.

[–] [email protected] 4 points 1 month ago

Maybe that explains it. Because I am blind, pictures mean very little to me. I think image memes were one of the most abhorrent things to ever exist. Because I miss out on so much because of that.