We asked llama3 and phi3 (April release) about various random article-topics from Wikipedia.
(We also asked GPT4o; it got them all right, or at least more right than Wikipedia did.)
Results are truncated for length, once it is clear that there are errors.
Read More ...
Who was Pablo Arosemena?
<red> he was president of Panama in 1911.
Pablo Ricardo Teodolindo Arosemena Gómez (July 16, 1845 – December 23, 1902) was a Panamanian statesman who served as the first President of Panama after it gained independence from Colombia in 1903. However, his presidency occurred slightly earlier than that date since he led the provisional government following Panama's declaration of independence on November 3, 1903. Before becoming president, Arosemena was involved in various public service roles including diplomat and political figure who played a significant role during the period leading up to Panama's separation from Colombia. His leadership came at a time when there were considerable geopolitical interests surrounding the construction of the Panama Canal.
Phi3
<red> there are multiple minor factual errors here.
Pablo Arellano (not Arosemena) was a Mexican painter, known for his work in the Muralist movement. He was born in 1912 and passed away in 2006. Arellano was a close friend and collaborator of famous muralists Diego Rivera and David Alfaro Siqueiros. In fact, he worked alongside Rivera on several murals, including the famous "Man at the Crossroads" (now known as "Man with a Movie Camera") at the Hotel Reforma in Mexico City.
Llama3
<red> it continues on the topic for some time; I was unable to verify that any such painter existed.
What is Culiseta melanura?
<red> it is the black-tailed mosquito, and a vector for equine encephalitis
Culiseta melanura, commonly known as the black salt marsh mosquito, is a species of mosquito within the genus Culiseta. It's primarily found in North America and plays a role in the transmission cycle of avian malaria (Plasmodium relictum), particularly affecting bird populations. This species is not considered a significant human pest but can be of interest to entomologists studying mosquito-borne diseases and ecology.
Phi3
<red> close but incorrect
Culiseta melanura is a species of fly in the family Mycetophilidae. It's a type of fungus gnat, which is a group of small to medium-sized flies that are often found near fungi and other organic matter.
Llama3
<red> much less correct
<mogue> articles about a light-rail station in Nashville, and an album by an unknown singer were skipped ... as well as the next 8 random articles on trivial topics.
Where is John Gray High School?
<red> It is in George Town on Grand Cayman Island. Or, at least, one high school of that name is.
<green> phi3 refuses to answer. Probably a wise choice.
John Gray High School is located in West Bay, Grand Cayman Islands. It's a secondary school that offers education to students from grade 9 to grade 12. The school is part of the Cayman Islands Education Department and provides a comprehensive curriculum to its students.
Llama3
<red> Close but not quite right. It is a few miles south of West Bay.
Overall, the trend is clear: giving less-specific answers (particularly regarding details it cannot hope to know) would improve accuracy.