this post was submitted on 02 Jan 2024
39 points (95.3% liked)

ChatGPT

8935 readers
1 users here now

Unofficial ChatGPT community to discuss anything ChatGPT

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 7 points 10 months ago (1 children)

So this is basically another local LLM client? How is it different from the other ones?

[–] [email protected] 4 points 10 months ago (2 children)

I tested some of these open source projects. The main interesting points I identified in Jan were:

  • Desktop application, not web-based. No need to install or configure anything else.
  • The selection and download of the models you want to use are done entirely within the program. As easy as installing a plugin.
  • User-friendly interface, keeps a history of the "conversations".
[–] [email protected] 2 points 10 months ago (1 children)

That sounds very similar in features to LM Studio. Have you tried that one? How's it compare?

[–] [email protected] 2 points 10 months ago (1 children)

How does a non programmer know whether to trust that offerings like LM studio are truly offline and can be trusted?

[–] [email protected] 3 points 10 months ago* (last edited 10 months ago)

For a simple test that it is running offline, unplug your internet before chatting (after downloading the model). However if trust is a big concern, you might want to go with something popular and open source so you know third party devs have an eye on the code, which afaik LM Studio is not open source since there isn't much code on their github.