Main Page Content:
-

Computer programming as journalism

Posted by Martin Stabe on 18 October 2006 at 16:21
Tags: Journalism, Wired

A key point in Tim O’Reilly’s speech at the recent AOP conference was that the skills needed by journalists and computer programmers are moving together and that it is becoming possible to see computer programming as journalism.

On Monday, Wired News published a great example of how a journalist with programming skills can develop important investigative stories.

Kevin Poulsen wrote a script, consisting of more than 1,000 lines of Perl code, that allowed him to trawl more than 1 million MySpace profiles to compare them to details also occuring on a list of registered sex offenders.

Paulsen’s script confirmed 744 sex offenders with MySpace profiles and led to a police investigation of a man who appeared to be on the prowl for underage boys.

Wired News is now planning to publish the script under an open-source licence so that others can undertake similar projects.

(Hat Tip: Ethan Zuckerman)

Update: In an interview with the Columbia Journalism Review’s blog, CJR Daily, Paulsen said his research had been inspired by a previous Wired story. Freelance Jenn Shreve had found seven sex offenders active on MySpace simply by manually typed random names from  California’s sex offender registry into a search engine.

Wired has now published Paulsen’s script.

“We’re releasing it primarily as part of a transparency-in-reporting ethic,” Paulsen told CJR Daily.

But he is concerned about potential abuse of his software by vigilanties: “We’re going to put clear disclaimers in all caps saying first that the code itself won’t give you a list of sex offenders with MySpace profiles. It has a huge false positive rate. Anyone who tries to draw any conclusions just by running the code without doing the footwork is getting bad results. That’s the most important thing.”

Tags: Journalism, Wired

CommentsRSS feed for the comments on this post

Add your own comment

  1. neil baker |  19 October 2006 at 2:47pm

    Interesting example, but surely that’s a case of a journalist using a computer programme? Maybe it’s true to say that *some* types of journalism are getting a lot like computer programing, but only some.

  2. Martin Stabe |  19 October 2006 at 4:19pm

    Neil — yes, good point. Of course only some journalism will be done like this.

    In fact, I suspect that stories like this will always be exceptional, because they are expensive and time-consuming.

    I’m not suggesting that every story will be a database story, only that this is a new type of journalistic skill that will become increasingly prevalent.

  3. neil baker |  19 October 2006 at 8:02pm

    You’re welcome. I know you weren’t suggesting that every story would be a database story. The thing that annoys me about so much new media rhetoric from the likes of O’Reilly and Jeff Jarvis is that when they talk about “journalism” they only really mean one dimension of journalism – reporting of news. The kind of journalism I like to read – narrative and in-depth reportage – couldn’t be done by a computer, thank God! Interestingly, despite the potential for new media to offer richer story coverage, mixing video, audio and text, for example, not many people are doing it. Possibly because it requires money and skill.

  4. r-echos » Blog Arch&hellip |  13 March 2007 at 7:17pm

    [...] the Chicagocrime.org mashup, gives a great talk entitled Journalism Through Computer Programming. I refer to it often in my own talks on the future of [...]

Leave a Comment

required

required, but will not be published

-

Advertisement

E-mail Newsletter Signup

-

Advertisement

-

Advertisement