this post was submitted on 23 Jun 2023
49 points (100.0% liked)
Actually Useful AI
2015 readers
7 users here now
Welcome! ๐ค
Our community focuses on programming-oriented, hype-free discussion of Artificial Intelligence (AI) topics. We aim to curate content that truly contributes to the understanding and practical application of AI, making it, as the name suggests, "actually useful" for developers and enthusiasts alike.
Be an active member! ๐
We highly value participation in our community. Whether it's asking questions, sharing insights, or sparking new discussions, your engagement helps us all grow.
What can I post? ๐
In general, anything related to AI is acceptable. However, we encourage you to strive for high-quality content.
What is not allowed? ๐ซ
- ๐ Sensationalism: "How I made $1000 in 30 minutes using ChatGPT - the answer will surprise you!"
- โป๏ธ Recycled Content: "Ultimate ChatGPT Prompting Guide" that is the 10,000th variation on "As a (role), explain (thing) in (style)"
- ๐ฎ Blogspam: Anything the mods consider crypto/AI bro success porn sigma grindset blogspam
General Rules ๐
Members are expected to engage in on-topic discussions, and exhibit mature, respectful behavior. Those who fail to uphold these standards may find their posts or comments removed, with repeat offenders potentially facing a permanent ban.
While we appreciate focus, a little humor and off-topic banter, when tasteful and relevant, can also add flavor to our discussions.
Related Communities ๐
General
Chat
Image
Open Source
Please message @[email protected] if you would like us to add a community to this list.
Icon base by Lord Berandas under CC BY 3.0 with modifications to add a gradient
founded 1 year ago
MODERATORS
I'm always curious about using GPT like that. Does it cost money to send requests like this into GPT?
It does unfortunately, see here:
https://openai.com/pricing
I limited it to 100 summaries / day, which adds up to about $20 (USD) per month if the input is 3000 tokens long and the answer is 1000.
Using it for personal things (I buildt a personal assistant chatbot for myself) is very cheap. But if you use it in anything public, it can get expensive quickly.
Have you considered using a self-hosted instance of GPT4All? It's not as powerful, but for something like summarizing an article it could be plenty - And importantly, much, much cheaper.
I havenโt yet looked into it, but the screencast on its website looks really promising! I have a lot on my plate right now so I think Iโll release it first with the GPT-3.5 integration, but Iโll definitely try GPT4All later!
How does GPT4ALL work exactly? Surely its no where near the quality of real GPT4.
If i check on https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard The 13B model is below some of the llama models. At this point Falcom 40B is what you want to have the best quality llm running locally
It's just an open source LLM that you can run on your own hardware; I haven't looked into it a ton tbh - but if I saw $20/month for 100 requests/day I'd be immediately looking for a way to run it on my own hardware
Its kinda debatable, while yes I wouldnt wanna pay that either, ive been following the local working llms, Gpt4all stroke me as not bad but not all that special or amazing (compared to 2021 there all magic though) the naming seems a very little bit misleading with gpt4 as the world most advanced known model. All the models on tbe huggingface page i send work can work locally but at best there gpt-3 level competitors.