ProPublica

Journalism in the Public Interest

The ProPublica Nerd Blog

Timeline: How Obama Compares to Bush on Torture, Surveillance and Detention

As the terrain and debate around national security shifts, we took a look back at some of the most controversial elements of George W. Bush’s national security policy, to see how much has changed under Obama – and how much has stayed the same.

Latest News Corp. Investigation Emails

Report your findings in over 160 News Corp. internal emails released today

Updated: Dialysis Facility Tracker

ProPublica obtained data about the performance of more than 5,000 U.S. dialysis clinics. Our Dialysis Facility Tracker allows patients to compare clinics on such measures as patient survival, infection control, hospitalization rates and transplant rates.

Useful Code Snippets

Open Source code doesn’t always come in big complex packages. At ProPublica we sometimes share small, simple snippets of using GitHub “Gists.” These Gists rarely have documentation and don’t even always have names, but they can be super-useful. Here are some we’ve shared over the past few years.

A Tangled Web: Who’s Making Money From All This Campaign Spending?

Many have been detailing the vast sums being raised by the presidential candidates and the super PACs supporting them. But where are all those millions being spent?

Untangling a Web of FEC Data

Our Tangled Web graphic shows the 200 biggest recipients of expenditure money from the five major presidential campaigns (Gingrich, Obama, Paul, Romney and Santorum), as well as from major super PACs, from around the middle of 2011 through February, 2012.

Introducing StateFace

Today we released a font that you can use to include small state map shapes as a design element in a web application. It’s called StateFace.

Some Thoughts on Timelines

Over the past few weeks we've done a lot of thinking about timelines. We made one that recounted the history of FDA fines levied on the Red Cross, another one that traced the changing government approach to fracking, and finally one that described the day-by-day unfolding of the Komen/Planned Parenthood debacle. Each was pretty different and went through multiple iterations before arriving at its final form. Here's the story behind each one -- the thinking, planning, and building of each timeline, complete with some of the approaches we rejected along the way.

Sealing Loose Lips: Charting Obama’s Crackdown on National Security Leaks

A timeline of the Obama administration’s aggressive campaign against government leakers.

Announcing Simpler Tiles

When Are 190 Emails Like Six Emails?

On Tuesday we published a graphic that looks at six variations of a single email sent out by the Obama re-election campaign last Thursday night.

This all started when fellow news nerd Dan Sinker got an email from the campaign on the same night his wife did and noticed that although they were both apparently from the same person at the campaign — Julianna Smoot — the e-mails had subtle differences. So Dan set up a Google form and asked his Twitter followers to send in their own examples of the “Smoot Email.”

At ProPublica, we’d been wanting to dig more deeply into how “big campaign data” works so we struck a deal with Dan: He’d share his database with us and we’d help analyze and visualize it.

Of course, it was far from a valid sample, but we thought analyzing the data would yield interesting observations if not statistically significant conclusions.

What the Frack is in That Water?

Environmentalists have repeatedly pressed regulators to compel oil and gas companies to report what chemicals they use in the drilling and fracking process. No one knows the exact makeup of the frack mixture or drilling muds, but this list breaks down the main ingredients revealed so far.

Message Machine: Reverse Engineering an Obama Email Campaign

Campaigns are increasingly tailoring their messages—and their funding requests—using massive databases of personal information about potential voters. Here are six variations of a Thursday night message from the Obama campaign, based on emails submitted by 190 recipients across the country.

Ponying Up: How Much Have Big Banks Been Docked for the Financial Crisis?

Nearly four years after the financial crisis, settlements with the big players on Wall Street keep coming out, one after the other. It can be hard to keep track of it all. So who’s been hit, with what, and for how much in total?

Showing You the Money (Faster)

Over on The New York Times’ Open blog today is a post by Times Developer Derek Willis about the latest update to the Campaign Finance API, which we were excited to help out with.

When we started ramping up our investigation into money in politics late last year, super PACs had just started spending heavily in the early primary states. The Federal Election Commission required these committees to file reports within 24-48 hours of making expenditures, and we thought this data would be a good subject for a news application that would automatically keep up with the rapidly changing data.

Taking Stock of the Stock Act: A Side-by-Side Comparison

The Stop Trading on Congressional Knowledge Act, or Stock Act, recently passed in both chambers of Congress. We break down the main differences between the House and Senate versions, with a real-life scenarios that illustrate activities the bill targets.

Introducing Simple Tiles: Our New Mapping Library

Newsrooms have been publishing maps for a long time. However, mapping on the web is very difficult due to the sheer amount of data involved. Some of the largest datasets available to journalists are geospatial. The U.S. TIGER/Line roads database, for example, tips the scale at 9.2 gigabytes, and the USGS’s national hydrography data set is 17 gigabytes compressed.

The data needed to analyze legislative redistricting is similarly huge. In California alone there are 700,000 Census blocks. When we started covering redistricting last year, we knew we would need an easy way to present vast amounts data quickly. We took a serious look at both Mapnik and Mapserver — who are still leaders in the field — but the Ruby bindings support in both, at the time, weren’t as robust and stable as we needed them to be.

Updated Recovery Tracker

Once again, we’ve taken all the data used on the government’s stimulus Web site, Recovery.gov, spiffed it up and added thousands of other recovery spending records — the law doesn’t require all recipients to report to Recovery.gov.

Komen’s Contortions: a Timeline of the Charity’s Shifting Story on Planned Parenthood

The Komen foundation’s decision to cut funding to Planned Parenthood set off such an uproar that the charity quickly gave it back. We trace how their explanations changed along the way.

From Gung-Ho to Uh-Oh: Charting the Government’s Moves on Fracking

Fracking has only recently become a household word, but government involvement with the drilling technique goes back decades. We trace officials’ moves—and levels of caution—over time.

The News Apps Team

Download Our Data

Use ProPublica's data — cleaned, categorized and often created from multiple sources — in your reporting and research.

Use Our Code

Explore Our Work