ChatGPT3 is an unreliable narrator

For general computer discussion & help, come here

Moderators: Bakhtosh, EvilHomer3k

Post Reply
User avatar
Kasey Chang
Posts: 20753
Joined: Sat Oct 30, 2004 4:20 pm
Location: San Francisco, CA

ChatGPT3 is an unreliable narrator

Post by Kasey Chang »

Was playing with ChatGPT3 and see if it can dig up information I don't know about certain topics, and let's just say, there are severe problems with its knowledge when it comes to history, that you need to fact-check EVERYTHING it says, since there is a good chance that some of it is wrong, since its interpretation of related facts can be a bit... iffy.

Let's take history for example: William Anthony Richardson. There's wikipedia and plenty of other references. Did ChatGPT3 get it right? Not really. It got a good portion of it right, but mixed in a couple WTF ones like "he served as a captain in the Mexican army during the California Revolution of 1836" "the street that bears his name is located in the city's financial district" and "his legacy is celebrated at several museums and historical sites throughout the region". As you can guess, NONE of these three are true. AFAIK, there are only two historical sites: one tiny plaque in Chinatown on Grant, and one larger plaque in Sausalito.

But if you didn't fact check ChatGPT3, you would have never known those are false statements.
My game FAQs | Playing: She Will Punish Them, Sunrider: Mask of Arcadius, The Outer Worlds
User avatar
Posts: 17438
Joined: Mon Dec 06, 2004 3:00 pm
Location: Northern Virginia, VA

Re: ChatGPT3 is an unreliable narrator

Post by pr0ner »

There's a big discussion about ChatGPT going on in the EBG forum.
Post Reply