this post was submitted on 27 Sep 2023
28 points (91.2% liked)
Trees
6652 readers
1 users here now
A community centered around cannabis.
In the spirit of making Trees a welcoming and uplifting place for everyone, please follow our Commandments.
- Be Cool.
- I'm not kidding. Be nice to each other.
- Avoid low-effort posts
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Surprisingly good comment on running such language models locally. Thanks, I will try to run the 70B model as well. So far I have only used up to 13B with Oobabooga.