ChatGPT3 is an unreliable narrator
Posted: Wed Mar 15, 2023 7:17 pm
Was playing with ChatGPT3 and see if it can dig up information I don't know about certain topics, and let's just say, there are severe problems with its knowledge when it comes to history, that you need to fact-check EVERYTHING it says, since there is a good chance that some of it is wrong, since its interpretation of related facts can be a bit... iffy.
Let's take history for example: William Anthony Richardson. There's wikipedia and plenty of other references. Did ChatGPT3 get it right? Not really. It got a good portion of it right, but mixed in a couple WTF ones like "he served as a captain in the Mexican army during the California Revolution of 1836" "the street that bears his name is located in the city's financial district" and "his legacy is celebrated at several museums and historical sites throughout the region". As you can guess, NONE of these three are true. AFAIK, there are only two historical sites: one tiny plaque in Chinatown on Grant, and one larger plaque in Sausalito.
But if you didn't fact check ChatGPT3, you would have never known those are false statements.
Let's take history for example: William Anthony Richardson. There's wikipedia and plenty of other references. Did ChatGPT3 get it right? Not really. It got a good portion of it right, but mixed in a couple WTF ones like "he served as a captain in the Mexican army during the California Revolution of 1836" "the street that bears his name is located in the city's financial district" and "his legacy is celebrated at several museums and historical sites throughout the region". As you can guess, NONE of these three are true. AFAIK, there are only two historical sites: one tiny plaque in Chinatown on Grant, and one larger plaque in Sausalito.
But if you didn't fact check ChatGPT3, you would have never known those are false statements.