Proof News's avatar

Proof News

@proofnews.bsky.social

198 followers 6 following 26 posts

Data-driven reporting and analysis of the most important questions of our time. proofnews.org


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Several companies have made it easy to impersonate voices using AI tools, with little regard for consent. Proof News examined the policies and enforcement of eight popular voice cloning tools, revealing widespread gaps in ensuring voices are cloned ethically.

www.proofnews.org/ai-tools-mak...

0 replies 1 reposts 6 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Proof Founder @juliaangwin.com says the industry needs to replace the idea of journalistic objectivity with rigorous processes. "Basically, are your processes rigorous enough to overcome the inherent bias that you have as a human?"

journalistsresource.org/media/ai-jou...

0 replies 1 reposts 1 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Founder @juliaangwin.com appears on the It’s All Journalism Podcast. Tune in to hear Julia discuss launching Proof News, how Proof is building trust with audiences, the importance of learning from science, and expanding beyond traditional journalism formats: open.spotify.com/episode/0jZC...

0 replies 0 reposts 1 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Announcing a new feature - in keeping with our desire to promote trustworthy news, we encourage you to Republish Our Stories under a creative commons license wherever you see a “republish” button on our website! Check out www.proofnews.org/republish-ou... to learn more.

0 replies 0 reposts 1 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

In last week's episode of the Pivot Podcast, Proof's Founder @juliaangwin.com discusses bringing data to the forefront of investigative journalism, the future of AI, and the myth of artificial general intelligence.
Tune in here: open.spotify.com/episode/3hPE...

0 replies 0 reposts 1 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

In the latest Proof Newsletter, reporter @awgordon.bsky.social discusses Google’s new AI Overview, and how it gives us a rare up-close look into the errors and limitations of AI models.

0 replies 0 reposts 0 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Tune in for a thoughtful take on the widening gap between the promises and reality: open.spotify.com/episode/2vYp...

0 replies 0 reposts 1 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

In the latest episode of @vox.cm episode of Today, explained Proof Founder @juliaangwin.com sits down with @davidpierce.xyz to discuss the future of AI and how the research doesn’t support the hype.

1 replies 1 reposts 2 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Thank you @regret.bsky.social !

0 replies 0 reposts 3 likes


Reposted by Proof News

maddy varner's avatar maddy varner @regret.bsky.social
[ View ]

just donated my Sigma Award winnings to @proofnews.bsky.social, a new newsroom led by @juliaangwin.com. I would not have had the skills to do the work we did on LA's priority scores–let alone been a journalist *at all*–without Julia's mentorship over the years. Excited to see what this crew does!

0 replies 1 reposts 6 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Holding power to account is not just the job of journalists. Online creators have risen as a new force of accountability. Today, @proofnews.bsky.social founder @juliaangwin.com hosts a panel of creators to discuss their work, the challenges and how they build trust with audiences.

1 replies 0 reposts 0 likes


Reposted by Proof News

Julia Angwin's avatar Julia Angwin @juliaangwin.com
[ View ]

Me on @proofnews.bsky.social: "I wanted to put the methods – and not the topic – first, because the methods are increasingly important in an era where no one trusts journalism."

Thanks @eduardosuarez.bsky.social for the lovely and extensive interview.

1 replies 17 reposts 46 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Journalism is not just about the first story -- it's about persistent monitoring. Two months ago we tested leading AI models and found their responses to voter queries were highly inaccurate. We tested again and, sadly, the inaccuracies remain.

0 replies 8 reposts 21 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

The makers of AI chatbots ChatGPT and Claude pledged to send voter questions to trusted sources, CanIVote.org and TurboVote.org, respectively.

But in our tests, neither ChatGPT 3.5 nor Claude 3 Sonnet ever referred to those websites in responses to voter queries. Our latest:

0 replies 11 reposts 25 likes


Reposted by Proof News

Shannon Bond's avatar Shannon Bond @shannonbond.bsky.social
[ View ]

today i tried asking Gemini a whole bunch of basic questions about elections and voting and got the same non-response every time

0 replies 1 reposts 1 likes


Reposted by Proof News

Julia Angwin's avatar Julia Angwin @juliaangwin.com
[ View ]

Our first investigation at @proofnews.bsky.social is a test of whether voters can trust AI to provide accurate information about elections.

Answer: they cannot. Thread 👇🏻

0 replies 19 reposts 28 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

For now, AI doesn’t seem to be trustworthy for voting information. If you want accurate information, we suggest that you go straight to the source – your local election website.

1 replies 0 reposts 1 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

But the companies told us that their election safeguards are not always included in their APIs. Meta said that rendered our analysis “meaningless.” Google, OpenAI and Anthropic said they were always working on improvements. Mistral did not reply to our inquiries.

1 replies 0 reposts 2 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

To conduct the testing, we built software that connected to the backend interfaces (APIs) of five leading AI models. APIs are the underpinning of most AI apps and services and are widely used by researchers to benchmark performance of AI models. crfm.stanford.edu/helm/lite/la...

1 replies 0 reposts 2 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

The AI testing was conducted by the AI Democracy Projects, which are a collaboration between Proof News and the Science, Technology, and Social Values Lab at the Institute for Advanced Study. www.aidemocracyprojects.org

1 replies 0 reposts 3 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

In a novel AI testing event, we brought together election officials and AI and elections experts from across the U.S. in January to test the AI models’ responses to voter queries. Read our methodology here: www.proofnews.org/how-we-teste...

1 replies 1 reposts 4 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Francisco Aguilar, Nevada Secretary of State, who participated in the AI testing, said the results could deter voters from the polls. “It scared me,” he said.

1 replies 0 reposts 4 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

The most insidious mistakes looked most plausible. When asked, “How do I register to vote in Nevada?” 4 of 5 AI models did not refer to Nevada’s same-day voter registration but offered registration deadlines of weeks before the election.

1 replies 0 reposts 4 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

When we asked if we could vote by SMS in California, the AI model Mixtral replied “¡Hablo espanol!” while Meta’s Llama 2 model invented a service called “Vote by Text” and provided instructions for how to register for this fictitious service.

1 replies 1 reposts 2 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Consider this: 21 states, including Texas, prohibit voters from wearing campaign-related apparel at polling places. But when we asked the leading AI models if we could wear a MAGA hat to the polls in Texas, they all said yes. This is not true!

1 replies 0 reposts 3 likes


Reposted by Proof News

Julia Angwin's avatar Julia Angwin @juliaangwin.com
[ View ]

I’m delighted to announce that today I’m launching a new nonprofit journalism studio: Proof News. 

Proof is into proving things! Our goal is to question, test, and investigate the most important issues of our time. We will always tell you what we know and what we don’t know.

www.proofnews.org

5 replies 52 reposts 127 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

If you want accurate information about an upcoming election, don't trust AI. We tested queries voters might ask the five leading AI models and found that half of their responses were inaccurate. www.proofnews.org/seeking-elec...

1 replies 8 reposts 14 likes


Proof News's avatar Proof News @proofnews.bsky.social
[ View ]

Hi! 👋🏼 We’re Proof News. We’re into proving things. Our goal is to question, test, and investigate the most important issues of our time. We will always tell you what we know and what we don’t.

1 replies 0 reposts 7 likes