this post was submitted on 14 Jun 2024
289 points (81.1% liked)

Technology

58303 readers
11 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 13 points 5 months ago (2 children)

Android phone makers are shipping on device LLMs?

Do people actually want these?

[–] [email protected] 28 points 5 months ago* (last edited 5 months ago) (1 children)

Yes, in fact that is the only kind of ai i would ever use and entrust my data to. Not the apple one, but an open source model that is running only on my device and answering only to me; using the data I provide only for my interests? That one I would use.

[–] [email protected] 2 points 5 months ago (1 children)

I bet these LLM models wont be 100% locally hosted. I imagine some form of data will be piped back to a cloud server

[–] [email protected] 16 points 5 months ago (2 children)

LLM is AI correct? If my phone is going to do AI at all, I prefer it be done on device for sure. For privacy reasons if nothing else. But it's not anything I've really looked into. I have the S24 and the only AI feature I use is the Circle to search... which I don't consider to be AI.

[–] [email protected] 2 points 5 months ago

LLM is a form of AI, specifically the text AIs like ChatGPT that have suddenly made "AI" a dinner table term. AI in some form or another is almost definitely being used in your device - even for things like filling in gaps in low-quality voice calls, and probably has been for a while. But the problem is that unlike those "old" AIs, LLMs require some significant power to run, so running them on phones will probably require meaningful trade-offs. But the increased security is also a meaningful benefit.

[–] [email protected] 1 points 5 months ago

They add a kinda nifty "copy subject" option that is supposedly local AI stuff to the samsung gallery, fun to mess with