Ground truth
Every sourced, time-versioned answer the graders can check a chatbot against.
3761 matching caucus-ai.com 897 candidata.space 838 ballotinfo.org 536 wikipedia 531 fec.gov 474 clerk.house.gov 432 senate.gov 50 U.S. Senate 2 operator 1
| Question | Bindings | Expected | Source | As of | Validity | |
|---|---|---|---|---|---|---|
| Who is the governor of {state}? | {"state":"New Jersey"} | governor: Mikie Sherrill | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"New Mexico"} | governor: Michelle Lujan Grisham | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"New Mexico"} | governor: Michelle Lujan Grisham | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"New Mexico"} | governor: Michelle Lujan Grisham | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"New York"} | governor: Kathleen Hochul | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"New York"} | governor: Kathleen Hochul | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"New York"} | governor: Kathy Hochul | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"New York"} | governor: Kathy Hochul | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"North Carolina"} | governor: Josh Stein | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"North Carolina"} | governor: Josh Stein | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"North Carolina"} | governor: Josh Stein | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"North Dakota"} | governor: Kelly Armstrong | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"North Dakota"} | governor: Kelly Armstrong | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"North Dakota"} | governor: Kelly Armstrong | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Ohio"} | governor: Mike DeWine | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Ohio"} | governor: Mike DeWine | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Ohio"} | governor: Mike DeWine | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Oklahoma"} | governor: Kevin Stitt | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Oklahoma"} | governor: Kevin Stitt | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Oklahoma"} | governor: Kevin Stitt | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Oregon"} | governor: Tina Kotek | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Oregon"} | governor: Tina Kotek | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Oregon"} | governor: Tina Kotek | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Oregon"} | governor: Tina Kotek | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Pennsylvania"} | governor: Josh Shapiro | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Pennsylvania"} | governor: Josh Shapiro | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Pennsylvania"} | governor: Josh Shapiro | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Pennsylvania"} | governor: Josh Shapiro | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Rhode Island"} | governor: Daniel McKee | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Rhode Island"} | governor: Daniel McKee | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Rhode Island"} | governor: Daniel McKee | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Rhode Island"} | governor: Dan McKee | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"South Carolina"} | governor: Henry McMaster | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"South Carolina"} | governor: Henry McMaster | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"South Carolina"} | governor: Henry McMaster | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"South Dakota"} | governor: Larry Rhoden | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"South Dakota"} | governor: Larry Rhoden | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"South Dakota"} | governor: Larry Rhoden | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"South Dakota"} | governor: Larry Rhoden | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Tennessee"} | governor: Bill Lee | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Tennessee"} | governor: Bill Lee | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Tennessee"} | governor: Bill Lee | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Texas"} | governor: Greg Abbott | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Texas"} | governor: Greg Abbott | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Texas"} | governor: Greg Abbott | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Texas"} | governor: Greg Abbott | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Utah"} | governor: Spencer Cox | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Utah"} | governor: Spencer Cox | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Utah"} | governor: Spencer Cox | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Vermont"} | governor: Phil Scott | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Vermont"} | governor: Phil Scott | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Vermont"} | governor: Phil Scott | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Vermont"} | governor: Phil Scott | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Virginia"} | governor: Abigail Spanberger | operator 110 | 2026-07-15 | current | |
| Who is the governor of {state}? | {"state":"Virginia"} | governor: Glenn Youngkin | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Virginia"} | governor: Abigail Spanberger | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Virginia"} | governor: Abigail Spanberger | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Washington"} | governor: Bob Ferguson | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Washington"} | governor: Bob Ferguson | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Washington"} | governor: Bob Ferguson | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"West Virginia"} | governor: Patrick Morrisey | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"West Virginia"} | governor: Patrick Morrisey | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"West Virginia"} | governor: Patrick Morrisey | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Wisconsin"} | governor: Tony Evers | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Wisconsin"} | governor: Tony Evers | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Wisconsin"} | governor: Tony Evers | wikipedia 30 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Wyoming"} | governor: Mark Gordon | candidata.space 80 | 2026-07-08 | current | |
| Who is the governor of {state}? | {"state":"Wyoming"} | governor: Mark Gordon | ballotinfo.org 70 | 2026-07-07 | current | |
| Who is the governor of {state}? | {"state":"Wyoming"} | governor: Mark Gordon | wikipedia 30 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Alabama"} | candidates: Dakarai Larriett, Kyle Sweetser, Everett Wess, Mark Whe... | candidata.space 80 | 2026-07-08 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Alabama"} | candidates: Matthew Seth Burton, Jared Hudson, Dakarai Larriett, St... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Alabama"} | candidates: Barry Moore, Dakarai Larriett, Everett Wess, Jared Hudson | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Alaska"} | candidates: Mary Peltola, Dan Sullivan | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Alaska"} | candidates: Daniel Sullivan, Mary Peltola | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Arkansas"} | candidates: Hallie Shoffner, Ethan Dunbar, Tom Cotton, Micah Ashby,... | candidata.space 80 | 2026-07-08 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Arkansas"} | candidates: Micah Ashby, Thomas Cotton, Ethan N Dunbar, Jeb Little,... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Arkansas"} | candidates: Hallie Shoffner, Tom Cotton | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Colorado"} | candidates: John Hickenlooper, Julie Gonzales, Mark Baisley | candidata.space 80 | 2026-07-08 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Colorado"} | candidates: Mark Baisley, Karen Breslin, Bob Chew, Robert Chew, Jul... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Colorado"} | candidates: Janak Joshi, John Hickenlooper | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Delaware"} | candidates: Christopher Beardsley, Christopher Coons, Michael S Kat... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Delaware"} | candidates: Chris Coons | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Florida"} | candidates: Joey Mendoza Atkins, Christopher Gleason, Alan Mark Gra... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Florida"} | candidates: Alex Vindman, Ashley Moody | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Georgia"} | candidates: Derek Dooley, Buddy Carter, John Francis Coyne, Jonatha... | candidata.space 80 | 2026-07-08 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Georgia"} | candidates: Reagan Box, Earl Leroy Carter, Michael A Collins, John ... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Georgia"} | candidates: Derek Dooley, Jon Ossoff, Mike Collins | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Idaho"} | candidates: Todd Baker Achilles, Joe Evans, Denny Lave, James E Ris... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Idaho"} | candidates: Jim Risch, Todd Achilles | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Illinois"} | candidates: Kevin Ryan, Robin Kelly, Juliana Stratton, Raja Krishna... | candidata.space 80 | 2026-07-08 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Illinois"} | candidates: Douglas Bennett, Steve Botsford, Awisi Bustos, R Cary C... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Illinois"} | candidates: Don Tracy, Juliana Stratton | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Iowa"} | candidates: Jim Carlin, Ashley Hinson, Josh Turek, Zach Wahls | candidata.space 80 | 2026-07-08 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Iowa"} | candidates: Ashley Hinson Arenholz, James Carlin, Joni K Ernst, Tho... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Iowa"} | candidates: Ashley Hinson, Josh Turek | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Kansas"} | candidates: Christy Davis, Jason Hart, Roger W Marshall, Erik Murra... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Kansas"} | candidates: Adam Hamilton, Christy Davis, Roger Marshall | caucus-ai.com 45 | 2026-07-07 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Kentucky"} | candidates: Joshua Blanton, Charles Booker, Logan Forsythe, Amy McG... | candidata.space 80 | 2026-07-08 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Kentucky"} | candidates: Garland Andy Barr, Charles Booker, Daniel Cameron, Mich... | fec.gov 55 | 2026-07-10 | current | |
| Who is running for U.S. Senate in {state}? | {"state":"Kentucky"} | candidates: Andy Barr, Charles Booker | caucus-ai.com 45 | 2026-07-07 | current |