The evolution of the National Security Agency’s dragnet under Presidents Bush and Obama.
The sixth ProPublica P5 Resident is Joanna Kao.
While the tools and techniques to present large datasets in graphics and news apps may differ from project to project, the basic design principles stay pretty much the same. Many might pretty familiar – even if you’ve never studied design formally, you probably know some of them instinctively. Let’s name them, explain why they work and see how other designers use them. Once you recognize the concepts, you’ll become more conscious of when and how to use them in your own projects.
We’re looking for the next great News Applications Fellow to work with ProPublica’s world-class news applications desk.
It's a great fellowship for, among others, a coder who's civic-minded and interested in working with journalistic problems and data sets, or a j-school grad who wants to tell stories with code, or a digital humanities student looking to try their skills in journalism. You’ll work side-by-side with the best newsroom developers on the planet, on some of the biggest and most innovative projects in investigative and data journalism. You will leave here a better journalist, a better designer and a better developer.
As part of our ongoing investigation into patient safety, ProPublica reporters Marshall Allen and Olga Pierce produced this interactive story in collaboration with PBS Frontline and Ocupop during a May 11-16 hackathon.
Medicare’s popular prescription-drug program now serves more than 35 million people, but the names of prescribers and the drugs they choose have never previously been public. Use this tool to find and compare doctors and other top prescribers in 2010.
Use our database to find almost 616,000 tax-exempt organizations and see details like their executive compensation, revenue and expenses, as well as download their tax filings going back as far as 2001.
In addition to our Nonprofit Explorer interactive database, here are some resources for researching charities and other tax-exempt organizations.
This week, Justin Elliott wrote about new House Financial Services Committee chairman Rep. Jeb Hensarling (R-Texas) attending a weekend getaway with banking industry officials.
One of the ways he found out who was at the getaway was by using the Instagram photo sharing service, which turned up a snowy snapshot taken by Len Wolfson, a lobbyist for the Mortgage Bankers Association (which had contributed to Hensarling's PAC). Wolfson has since set his account to private.
The Instagram site has no search function, so finding shots like this can take a lot of digging. However, Instagram has an API with a "Media Search" endpoint that returns data both by timeframe and distance from a certain latitude and longitude -- a perfect way to see who's at a certain place at a certain time.
Our P5 Resident this month is Alan Palazzolo from MinnPost. He’s the fifth P5 Resident.
The Global Editors Network announced finalists for its 2013 Data Journalism Awards.
On the shortlist are three projects, including maps that retell the "Great Migration," from ProPublica and two projects from former residents in our P5 Program.
This past weekend, a team from ProPublica competed in the GEN Editors’ Lab New York hack day, with the theme “Newsgaming.” We learned how to use game mechanics to create an interactive experience that went beyond badges and reputation systems to explore a complex accountability story in fun and engaging way. Seriously, our game is really fun.
Here’s what we learned (and produced!) in two days.
HeartSaver is an experiment in news game design, built in two days for the April 2013 GEN Editors’ Lab Hackathon. How many lives can you save?
The Senate defeated several amendments to the proposed gun control bill, with only two amendments reaching the 60 votes necessary to pass. We break down how senators voted.
Four months after the Newtown tragedy, the Senate resoundingly defeats gun control legislation. We break down how Senators voted on the bill.
Today we debut a ProPublica Nerd Blog redesign, which includes a new look for our main landing page as well as our article pages. We wanted to create both a better reading experience, as well as to help you find what you’re looking for more easily. Here are three new features we want to highlight:
First, we created a new sidebar to help you quickly locate our tools and guides, including ProPublica's latest News Apps and Data Guides. It’s powered by the Github API, so anything we open source will instantly be added there. We've also added a section called "Explore Our Work" that gives you another way to navigate through our stuff.
Second, we're cross-posting announcements all of our news apps and graphics here. This makes the Nerd Blog a one-stop shop for all of our projects and the technical posts we write about them. Look for the gold boxes for new apps.
Third, we added simple keyboard shortcuts to the landing page to help you navigate more quickly. You can press "j" to skip to the next blog post, and "k" to go back. Vim fans should be delighted.
We hope you like the new look, as well as our new "data bass" icon, drawn by Jason Das, and we welcome suggestions on how to make the nerd blog even better in the comment section -- now powered by Disqus -- below.
ProPublica was able to pinpoint five drugs whose approval rested, at least in part, upon data from a now defunct firm with “egregious” research violations
Last week we published a big update to Dollars for Docs, our interactive news application of payments made to U.S. healthcare providers by 15 pharmaceutical companies. Compared to when we launched the project in 2010, the amount of data we’re collecting has grown enormously: The list of payments increased from around 750,000 to almost 2 million, and the grand total of the payments grew from around $750,000 to just under $2 billion.
Compiling the data for it has been an enormous project right from the beginning. After we published the first version, the original developer on the project, Dan Nguyen, compiled all of the things he had to learn into a guide to scraping data. This year’s update took more than eight months of full-time work by me, working with other news-app developers, and at times with our CAR team, a researcher, two editors and two health care reporters. It was a massive effort and presented huge technical and journalistic challenges.
During the 2012 election, we created Free the Files, an interactive news application based on crowdsourced data, built in real time by thousands of volunteers. It was a collaborative effort to track TV ad spending by campaigns, super PACs and so-called “dark money” nonprofit groups in the country’s top swing markets.
Measured by participation rate, Free the Files was an astonishing success. More than 1,000 contributors submitted over 94,000 transcriptions to help turn messy invoices from local TV networks into clean data. One volunteer transcribed over 28,000 filings. Each transcription was “verified” after two or more users agreed on all of its data points. There are currently around 17,000 verified filings, and people are still working.
ProPublica hosts newsroom developers -- or developers who want to see what it's like to work in news -- for 3-5 day job shadowing residencies called the ProPublica Pair Programming Project, or P5.
Use ProPublica's data -- cleaned, categorized and often created from multiple sources -- in your reporting and research.