233
this post was submitted on 23 Nov 2024
233 points (87.9% liked)
Technology
59597 readers
3307 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It's absurd that some of the larger LLMs now use hundreds of billions of parameters (e.g. llama3.1 with 405B).
This doesn't really seem like a smart usage of ressources if you need several of the largest GPUs available to even run one conversation.
I wonder how many GPUs my brain is
I don't think your brain can be reasonably compared with an LLM, just like it can't be compared with a calculator.
LLMs are based on neural networks which are a massively simplified model of how our brain works. So you kind of can as long as you keep in mind they are orders of magnitude more simple.
At some point it becomes so “simplified” it’s arguably just not the same thing, even conceptually.