this post was submitted on 04 Oct 2023
22 points (86.7% liked)

Asklemmy

43877 readers
1399 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
22
Does Bing Chat give reliable answers to math and physics questions? If not is it possible to make it more reliable? (lemmy.ml)
submitted 1 year ago by [email protected] to c/[email protected]
16 comments fedilink hide all child comments
 

I realize and understand the criticisms of ChatGPT and I have personally seem how bad it can be. Once I asked to count the number of days till a random date giving the present date and it failed miserably, again and again. Trust me! I get the criticism. But, what about Bing Chat Bot?

Have you ever tried to ask you Physics and Maths related questions to it? I was coding a while ago and I had a pretty complex questions which could not be solved by a very popular reddit coding community but Bing Chatbot gave an answer to it in an instant! I was genuinely impressed. Apparently it checks for answers on multiple webpages on the internet, it reads and understands what it reads and it gives the answer to it after combining the knowledge it gained from it's search. Again, the question I asked was pretty complex but it was able to answer it in an instant and it was the right answer! It was coding, it's pretty hard to get the right answer in the first try, I have found it's more "trial and error".

So yeah!

  1. Can I rely partially on Bing Chatbot for math questions?
  2. If not can I ask it to form a query which encapsulates my question perfectly?
  3. If not, should I ask it to "Answer this question and site your sources"?
  4. Can I do something more? i.e., like I did in 3? What are your thoughts on this?

I won't be able to reply to each of your comments anytime soon, but know that I deeply appreciate this community and it's members and their help :')

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 42 points 1 year ago (1 children)

Language models are designed to produce responses which convince the user that they are a coherent response. They don't care about factuality, and in fact have no ability to "know" if they are correct. And they don't "care"

If you want a smart query tool that lets you ask math problems, you should try something like Wolfram Alpha. It's not perfect, but it's at least designed with the intent to produce answers to math problems.

[–] [email protected] 20 points 1 year ago (3 children)

They don’t care about factuality, and in fact have no ability to “know” if they are correct. And they don’t “care”

I suspect that most people think (maybe not even consciously) that these models answer questions by retrieving data and then writing a response which incorporates that data, rather than just generating text that may or may not contain actual facts.

It really bears repeating over and over that all these so-called AI systems do is take a prompt and output text in response to it that reads as if a human wrote it.

[–] [email protected] 4 points 1 year ago* (last edited 1 year ago)

Yeah. They may learn other stuff in the process, but at the end of the day all they are doing is predicting the next word/token.

[–] [email protected] 2 points 1 year ago

You can tell these things about API calls and they can make API calls.

I have my own GPT4 instance instructed to gather information as necessary so it asks me questions when it needs to.

You can get it to “ask questions” with specific syntax which can then be translated to API calls. This is a way you can get an LLM to consider new information in its tasks.

[–] [email protected] -3 points 1 year ago (2 children)

They definitely retrieve data too, otherwise you wouldn't be able to send ask them about news events that happened yesterday and get a summary on it.

[–] [email protected] 6 points 1 year ago (1 children)

You can also get a summary on news events that didn't happen.

[–] [email protected] -1 points 1 year ago

I guess that's on you if you're asking it something like "tell me yesterday's news". No matter your feelings on AI our current LLMs are indisputably a great tool for sending emails and summarizing large text as a draft. If you're taking the output and running with it and not relying on any other external sources or proofreading then I could see how someone could come to the conclusion it's 100% terrible awful.

[–] [email protected] 5 points 1 year ago (1 children)

Thing is they can be confidently wrong,.

[–] [email protected] 2 points 1 year ago

yeah im not denying that but it's not black and white. people either praise it as this super intelligent AI or act like it's cleverbot 2.0. if you have low expectations and use it for what it's intended and actually take a moment to review the output then it's useful for lots of things