ChatGPT

8937 readers

1 users here now

Unofficial ChatGPT community to discuss anything ChatGPT

founded 1 year ago

MODERATORS

[email protected]

ChatGPT cannot do punctuation grammar correctly even if you forced it (lemmy.world)

submitted 10 months ago* (last edited 10 months ago) by [email protected] to c/[email protected]

16 comments fedilink hide all child comments

I asked it about how to use etc with three dots in an example followed by a brand new sentence starting with a capital letter afterward.

It told me : / In standard usage, "etc." is typically followed by three dots and then continues with a lowercase letter. If you are starting a new sentence, you do not add additional dots after "etc." /

Then I begged it to give me an example of that rule. One such as:
I love swimming, soccer, etc... I also love eating animals.

And it just couldn't do that. It kept typing 4 dots or single dot or no dots at all, and it can't even recognize what it typed every single time. Lol try it yourself

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 10 months ago

Surprised nobody mentioned this: Most of these models use tokenization; they group words into groups of symbols like "ea" and "the" and "anti" - they don't pick which key to press for the text, they pick which bunch of keys to press. These are called tokens. I believe there are tokens it just can't output, or tokens that are extremely unlikely. I could imagine that "etc." and "...." are tokens with relatively high probabilities, but perhaps "etc..." doesn't break into a nice set of them? (or the tokens it can be broken into all have extremely low weights for the model).