🔥 ask a stupid question, get a stupid answer
We ask the four models some questions with shorter answers:
Answer the following three questions:
Who wrote the pamphlet "Qu'est-ce que le Tiers-État"?
How many red stripes are there on an American flag?
What athletics record was famously set at the Mexico City Olympics?
Read More ...
ChatGPT 3.5T wrote:
The pamphlet "Qu'est-ce que le Tiers-État" was written by Emmanuel-Joseph Sieyès.
There are 7 red stripes on an American flag.
The athletics record that was famously set at the Mexico City Olympics is the long jump record by Bob Beamon, with a distance of 8.90 meters (29 feet and 2.5 inches).
ChatGPT 3.5T
LLaMa-13B wrote:
The pamphlet "Qu'est-ce que le Tiers-État" was written by the French philosopher and political thinker Jean-Jacques Rousseau.
There are seven red stripes on an American flag.
The athletics record that was famously set at the Mexico City Olympics was the 200-meter dash, which was won by the American sprinter Bob Beamon with a time of 19.83 seconds, setting a new world record that still stands today.
Mixtral-7x8B wrote:
The pamphlet "Qu'est-ce que le Tiers-État?" was written by Emmanuel Joseph Sieyès, a French clergyman and political writer.
There are 13 red stripes on the American flag.
The athletics record famously set at the Mexico City Olympics was Bob Beamon's long jump of 8.90 meters, which broke the previous world record by nearly two feet and stood as the world record for over 23 years.
Mixtral-7x8B
Claude-Instant 1.2 said:
Emmanuel Joseph Sieyès wrote the pamphlet "Qu'est-ce que le Tiers-État" in 1788.
There are 7 red stripes on the American flag.
Jim Hines set the world record for the 100 meters at the 1968 Summer Olympics in Mexico City with a time of 9.95 seconds.
Claude-Instant 1.2
ChatGPT got all 3 right, while the other three models each "missed" something.
Claude had the "best" wrong answer, arguably not wrong at all; while Bob Beamon's long-jump record is more famous, Jim Hines running the first sub-10 second 100m dash also should qualify as a famous record.
Mixtral said there are 13 red stripes; the "13 stripes" count contains both red and white stripes.
LLaMa-13B was the worst: it was not Rousseau who wrote the pamphlet on the Third Estate, and Bob Beamon was a long-jumper, not a 200m dash runner.
When I asked LLaMa-70B the same questions, it also failed; claiming there are 3 red stripes, and that "The athletics record that was famously set at the Mexico City Olympics was Roger Maris's 437-foot long jump".