ProPublica

Journalism in the Public Interest

Cancel

What We Learned from Free the Files—and How to Make It Better

After spending months digging through the tens of thousands of documents the country’s television stations uploaded as part of our Free the Files project, we look back on what we learned and how to make it better.

.

Back in August, the Federal Communications Commission forced the country's television stations to put their political advertising files — which reporters had been able to see only by visiting the stations — online.

With the help of more than 800 volunteers, we've spent months digging through the tens of thousands of documents the stations uploaded as part of our Free the Files project, and we've learned a great deal.

We uncovered a so-called dark money group, a "social-welfare nonprofit" not required to disclose its donors, that spent more than $1 million to air ads attacking Democratic Sen. Sherrod Brown in Ohio. The group was run by a lobbyist who employed a former aide to Brown's rival. We also found a self-described "grassroots" group in Florida that was actually funded by big electric companies. And we used the files to track the influence of dark money groups in tight races in New Mexico and Nevada.

But the data also has some limitations. It only includes files from ABC, CBS, NBC and FOX affiliates in the nation's top 50 markets. (All stations will have to participate by 2014.) Here are four ways to make it better:

  • Create a Common Format: The biggest problem with the files at the moment is that they're not searchable. Stations simply upload the advertising contracts in PDF format, which means that in order to find out how much President Obama's campaign spent in, say, Denver, you have to click on each ad contract and add up the numbers. The data would be much more useful if the FCC required the stations to list the buyer, the price and the contract number for each ad buy in a searchable format, in addition to uploading the contracts.
  • Solve the Revisions Problem: With the help of our volunteers, we've tallied $753 million in ad buys so far. But that number is almost certainly too high. A lot of contracts are revised multiple times, and each version of the contract is uploaded to the FCC. Duplicates are sometimes uploaded, too. (One contract showed up 19 times.) When we went through the files and eliminated the duplicates for the Las Vegas market, the total ad buys dropped from about $133 million to $47 million. The FCC could require stations to flag the most recent version of the contracts so people can ignore the rest.
  • One Contract, One File: Some files we reviewed included multiple ad contracts. Other times, one ad contract was split into two separate files. We recommend one contract per file.
  • Set Deadlines for the Stations: The FCC doesn't specify how long stations can take to upload ad contracts — it simply requires they do it "as soon as possible." Some were still uploading contracts a week after the election. The FCC should set a reasonable, but short deadline to get it done.

You’ve made a number of good suggestions but I think you should concentrate on developing (finding?) document readers that can understand what they’re reading and, in particular, recognize numerical data and its meaning.

As time goes by, you will, more and more, need to read electronic documents to get information about what you are investigating and reporting. A good reading program can help immensely.

Does that mean you don’t need to read yourself? Of course not. It does mean that when what you need to read amounts to hundreds of thousands of pages, you can’t do it in a reasonable amount of time by yourself. And, in particular, when what you need to do is analyze information scattered throughout those hundreds of thousands of pages, a program can do a better and quicker job.

It’s worth keeping in mind that these “limitations” were almost certainly intentional to minimize the people learning how much was spent to sway their choices.  If you ask me, Free the Files was far less important for uncovering specific information than it is for showing the FCC (and the candidates) that transparency is not going to be stopped by shell games.  Hiding information about how our country works is really no longer an option.

This article is part of an ongoing investigation:
Free the Files

Free the Files

Outside groups are spending hundreds of millions to influence the coming elections. Help unlock outside spending by "freeing" political ad buys from television stations in swing markets.

Get Updates

Stay on top of what we’re working on by subscribing to our email digest.

optional