Firefox

18626 readers

72 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 5 years ago

MODERATORS

[email protected]

[Answered] How can I use local LLM in the firefox AI chatbot (piefed.social)

submitted 2 weeks ago* (last edited 2 weeks ago) by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

Today I saw the AI chatbot in the sidebar for the first time (I remember turning the setting of in the Labs settings, but they turned it on IG). Looking the options, it supports a number of models, but all of them seems to be on a remote servers. Is there any way to use an LLM run on my own machine?

top 2 comments

sorted by: hot top controversial new old

[–] [email protected] 9 points 2 weeks ago (1 children)

Go to about:config and set the pref browser.ml.chat.hideLocalhost to false Afterwards you can select localhost as the provider in Settings > Firefox Labs

[–] [email protected] 3 points 2 weeks ago

Thanks