AI

4151 readers

3 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

119

I'm working on a TL;DR bot for Lemmy, powered by GPT-3.5 (self.artificial_intel)

submitted 1 year ago by sisyphean to c/[email protected]

43 comments fedilink hide all child comments

cross-posted from: https://programming.dev/post/177822

It's coming along nicely, I hope I'll be able to release it in the next few days.

Screenshot:

How It Works:

I am a bot that generates summaries of Lemmy comments and posts.

Just mention me in a comment or post, and I will generate a summary for you.

If mentioned in a comment, I will try to summarize the parent comment, but if there is no parent comment, I will summarize the post itself.

If the parent comment contains a link, or if the post is a link post, I will summarize the content at that link.

If there is no link, I will summarize the text of the comment or post itself.

Extra Info in Comments:

Prompt Injection:

Of course it's really easy (but mostly harmless) to break it using prompt injection:

It will only be available in communities that explicitly allow it. I hope it will be useful, I'm generally very satisfied with the quality of the summaries.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 5 points 1 year ago (7 children)

I hope it does not get too expensive. You might want to have a look at locally hosted models.

[–] sisyphean 8 points 1 year ago* (last edited 1 year ago) (1 children)

Unfortunately the locally hosted models I've seen so far are way behind GPT-3.5. I would love to use one (though the compute costs might get pretty expensive), but the only realistic way to implement it currently is via the OpenAI API.

EDIT: there is also a 100 summaries / day limit I built into it to prevent becoming homeless because of a bot

[–] [email protected] 2 points 1 year ago (1 children)

By the way, in case it helps, I read that OpenAI does not use content submitted via API for training. Please look it up to verify, but maybe that can ease the concerns of some users.

Also, have a look at these hosted models, they should be way cheaper than OpenAI. I think that this company is related to StabilityAI and the guys from StableDiffusion and also openassistant.

https://goose.ai/docs/models

There is also openassistant, but they don't have an API yet. https://projects.laion.ai/Open-Assistant

[–] sisyphean 1 points 1 year ago

Yes, they have promised explicitly not to use API data for training.

Thank you, I’ll take a look at these models, I hope I can find something a bit cheaper but still high-quality.

load more comments (5 replies)