this post was submitted on 06 Jul 2023
6 points (100.0% liked)

Actually Useful AI

2011 readers
7 users here now

Welcome! ๐Ÿค–

Our community focuses on programming-oriented, hype-free discussion of Artificial Intelligence (AI) topics. We aim to curate content that truly contributes to the understanding and practical application of AI, making it, as the name suggests, "actually useful" for developers and enthusiasts alike.

Be an active member! ๐Ÿ””

We highly value participation in our community. Whether it's asking questions, sharing insights, or sparking new discussions, your engagement helps us all grow.

What can I post? ๐Ÿ“

In general, anything related to AI is acceptable. However, we encourage you to strive for high-quality content.

What is not allowed? ๐Ÿšซ

General Rules ๐Ÿ“œ

Members are expected to engage in on-topic discussions, and exhibit mature, respectful behavior. Those who fail to uphold these standards may find their posts or comments removed, with repeat offenders potentially facing a permanent ban.

While we appreciate focus, a little humor and off-topic banter, when tasteful and relevant, can also add flavor to our discussions.

Related Communities ๐ŸŒ

General

Chat

Image

Open Source

Please message @[email protected] if you would like us to add a community to this list.

Icon base by Lord Berandas under CC BY 3.0 with modifications to add a gradient

founded 1 year ago
MODERATORS
sisyphean
6
The Many Ways that Digital Minds Can Know (moultano.wordpress.com)
submitted 1 year ago by sisyphean to c/auai
1 comments fedilink hide all child comments
 

Some interesting quotes:

  1. LLMs do both of the things that their promoters and detractors say they do.
  2. They do both of these at the same time on the same prompt.
  3. It is very difficult from the outside to tell which they are doing.
  4. Both of them are useful.

When a search engine is able to do this, it is able to compensate for a limited index size with intelligence. By making reasonable inferences about what page text is likely to satisfy what query text, it can satisfy more intents with fewer documents.

LLMs are not like this. The reasoning that they do is inscrutable and massive. They do not explain their reasoning in a way that we can trust is actually their reasoning, and not simply a textual description of what such reasoning might hypothetically be.

@AutoTLDR

you are viewing a single comment's thread
view the rest of the comments
[โ€“] AutoTLDR 2 points 1 year ago

TL;DR: (AI-generated ๐Ÿค–)

The text discusses the debate surrounding LLMs (large language models) and their abilities. Detractors view them as blurry and nonsensical, while promoters argue that they possess sparks of AGI (artificial general intelligence) and can learn complex concepts like multivariable calculus. The author believes that LLMs can do both of these things simultaneously, making it difficult to distinguish which task they are performing. They introduce the concepts of "memorization" and "generalization" to describe the different aspects of LLMs' capabilities. They argue that a larger index size, similar to memorization, allows search engines to satisfy more specific queries, while better language understanding and inference, similar to generalization, allows search engines to go beyond the text on the page. The author suggests using the terms "integration" and "coverage" instead of memorization and generalization, respectively, to describe LLMs. They explain that LLMs' reasoning is inscrutable and that it is challenging to determine the level of abstraction at which they operate. They propose that the properties of search engine quality, such as integration and coverage, are better analogies to understand LLMs' capabilities.

NOTE: This summary may not be accurate. The text was longer than my maximum input length, so I had to truncate it.

Under the Hood

  • This is a link post, so I fetched the text at the URL and summarized it.
  • My maximum input length is set to 12000 characters. The text was longer than this, so I truncated it.
  • I used the gpt-3.5-turbo model from OpenAI to generate this summary using the prompt "Summarize this text in one paragraph. Include all important points."
  • I can only generate 100 summaries per day. This was number 0.

How to Use AutoTLDR

  • Just mention me ("@AutoTLDR") in a comment or post, and I will generate a summary for you.
  • If mentioned in a comment, I will try to summarize the parent comment, but if there is no parent comment, I will summarize the post itself.
  • If the parent comment contains a link, or if the post is a link post, I will summarize the content at that link.
  • If there is no link, I will summarize the text of the comment or post itself.
  • ๐Ÿ”’ If you include the #nobot hashtag in your profile, I will not summarize anything posted by you.