Simon Willison's Weblog: tom-watson

MoD sticks with insecure browser

2009-07-24T10:18:55+00:00

Tom Watson MP used parliamentary written answers to find out that the majority of government departments still require their staff to use IE6, and not all of them have upgrade plans to 7 or 8. Not a single department considered an alternative browser. “Many civil servants use web browsers as a tool of their trade. They’re as important as pens and paper. So to force them to use the most decrepit browser in the world is a rare form of workplace cruelty that should be stopped.”

Tags: browsers, civilservice, politics, tom-watson, ukgovernment

Quoting Tom Watson

2009-03-10T14:30:01+00:00

I’m not bowled over much these days. But Guardian Open Platform is a chasmic leap into the future. It is a work of simplistic beauty that I’m sure will have a dramatic impact in the news market. The Guardian is already a market leader in the online space but Open Platform is revolutionary. It makes all of their major competitors look timid.

— Tom Watson

Tags: guardian, openplatform, tom-watson

A few notes on the Guardian Open Platform

2009-03-10T14:28:39+00:00

This morning we launched the Guardian Open Platform at a well attended event in our new offices in Kings Place. This is one of the main projects I've been helping out with since joining the Guardian last year, and it's fantastic to finally have it out in the open.

There are two components to the launch today: the Content API and the Data Store. I'll describe the Data Store first as it deserves not to get buried in the discussion about its larger cousin.

The Data Store

Simon Rogers is the Guardian news editor who is principally responsible for gathering data about the world. If you ever see an infographic in the paper, the chances are Simon had a hand in researching the data for it. His delicious feed is a positive gold mine.

As of today, a sizeable portion the data he collects for the newspaper will also be published online. As a starting point, we're publishing over 80 data sets, all using Google Spreadsheets which means it's all accessible through the Spreadsheets Data API.

Here's Simon's take on it, from Welcome to the Datablog:

Everyday we work with datasets from around the world. We have had to check this data and make sure it's the best we can get, from the most credible sources. But then it lives for the moment of the paper's publication and afterward disappears into a hard drive, rarely to emerge again before updating a year later.

So, together with its companion site, the Data Store – a directory of all the stats we post – we are opening up that data for everyone. Whenever we come across something interesting or relevant or useful, we'll post it up here and let you know what we're planning to do with it.

It's worth spending quite a while digging around the data. Most sets come with a full description, including where the data was sourced from. New data sets will be announced on the Datablog, which is cleverly subtitled "Facts are sacred".

The Content API

The Content API provides REST-ish access to over a million items of content, mostly from the last decade but with a few gems that are a little bit older. Various types of content are available - article is the most common, but you can grab information (though not necessarily content) about audio, video, galleries and more. You can retrieve 50 items at a time, and pagination is unlimited (provided you stay below the API's rate limit).

Articles are provided with their full body content, though this does not currently include any HTML tags (a known issue). It's a good idea to review our terms and conditions, but you should know that if you opt to republish our article bodies on your site we may ask you to include our ads alongside our content in the future.

We serve 15 minute HTTP cache headers, but you are allowed to store our content for up to 24 hours. You really, really don't want to store content for longer than that, as in addition to violating our T&Cs you might find yourself inadvertently publishing an article that has been retracted for legal reasons. UK libel laws can be pretty scary.

In addition to regular search, you can also filter our content using tags. Tags are a core aspect of the Guardian's R2 platform, being used for keywords, contributors, "series" (used to implement blogs), content types and more. Every item returned by the API includes tags, and the tags can be used to further filter the results.

We also return a list of filters at the bottom of each page of search results showing the tags that could be used to filter that result set, ordered by the number of results (you may have seen this feature referred to as faceted search or guided navigation). Handy tip: you can use ?count=0 in your search API key to turn off results entirely and just get back the filters section. The race is on to be first to release a tag relationship browser based on this feature.

API responses can be had in custom XML, JSON or Atom. The Atom format is the least mature at the moment, and we'd welcome suggestions for improving it from the community.

I released a Python client library for the API this morning, and we also have libraries for Ruby, Java and PHP.

We also have an API Explorer (written in JavaScript and jQuery, hosted on the same domain as the API so that it can make Ajax requests) but you'll need an API key to try it out.

The bad news

The response to the API release has been terrific (check out what Tom Watson had to say), but as a result it's likely that API key provisions will be significantly lower than the overall demand for them. Please bear with us while we work towards a more widely accessible release.

Tags: apis, atom, contentapi, data, data-journalism, datastore, guardian, javascript, journalism, jquery, json, openplatform, python, simon-rogers, tom-watson, xml

Interview with the Blogging MP

2003-04-15T14:46:38+00:00

Via Tom Watson himself, a short interview with Tom, the UK's first blogging MP:

It is a huge political risk (Watson's spoof page for teenagers caught the eyes of the national newspapers last week) but Watson is determined to stick with it.

Watson admits: "I'll get some stick but I think eventually people will see that is fundamentally a more honest way of communicating with people who want to know what you think and do. Oh, and its also great fun and slightly addictive."

What's more, Watson is convinced that weblogging will catch on among his fellow MPs.

"If the software makes publishing your thoughts and ideas easier, it will certainly catch on. For me, there is the advantage of getting ideas and opinions in the public domain quickly, without the reliance on your good profession (journalists) to interpret/edit what I've said."

Not only is Tom's weblog a great precedent for a more open, accessible government, it is also a fascinating insight in to the day to day life of an elected representative in this country. It's a shame all the press coverage so far has been about the spoof teens page rather than the format of the site itself.

Tags: blogging, tom-watson

Blogging and journalism

2003-02-28T23:42:16+00:00

I've been pretty much ignoring the whole "Blogging vs Journalism" thing but recently I've begun to understand what the big fuss is about. One of the most popular arguments put forth by journalists concerned by competition from blogs is that the information contained therein isn't as reliable thanks to a lack of an editor to check facts. Rubbish. I can't remember the last time I read a technology article in the main stream press about something I have more than a passing interest in that didn't have at least a few errors. Some of the blogs I read on the other hand are written by subject matter experts - these people are not being paid to knock out 750 vaguely relevant words on a breaking story, they are voluntarily providing their insights because they are heavily involved with the topic at hand.

When Safari came out, who had the best coverage? Look no further than Mark Pilgrim. The Eldred case was graced with coverage by Lawrence Lessig, the man at the very centre of the story. I'm sure there are plenty of other examples.

So, for a lot of tech related news I find blogs a far more useful source of information than the mainstream press. The problem of course is one of reputation - before I can judge the value of a blog entry I need to know something about the blogger who wrote it. Part of this judgement is helped by links from bloggers who I already trust (the linking nature of the web at work). Unlike Tantek I still have a use for traditional media for my non-tech news, but as the blogosphere expands and new methods evolve for finding quality blogs on a variety of subject matter I can see my dependence on the media reducing even more.

Tags: blogging, journalism, tom-watson