Bringing the web and books closer together

As a kid I was fascinated by astronomy and cosmology -- a genuine geek. In the early sixties the discovery of quasi-stellar radio sources (precursors to black holes) created quite a buzz among professional astronomers and amateur geeks. I spent many a winter Saturday morning (summer Saturday's were reserved for baseball) going back and forth between Kay's Book Store and the Cleveland Public Library searching for any books that may have existed on the topic.

Well someday there may be a web page for every book that has ever been published. If that idea excites you, you're probably as big a geek as I am. (GW)

The library that never closes

By Bobbie Johnson
Guardian
July 1, 2009

The Open Library hopes to unite the net and the printed word by creating a web page for every book. Bobbie Johnson talks to the audacious project's leader.

Ambitious archiving projects by the Open Library and Google will provide easy access to millions of books online.

The internet's relationship with books, it is fair to say, has been a tumultuous one. Ever since the digital revolution started changing our relationship with information, the printed word – one of the most successful technologies in history – has been on the back foot.

Amazon has altered the face of the industry twice – first in the 1990s by changing the way books are sold and then, more recently, the way they are consumed, with its Kindle electronic book reader. Google has caused its own earthquake in the print world with its Book Search scheme – a plan to suck the text of millions of books into its search engine that has raised the hackles of publishers and authors alike.

Talk to workers at either of these technology companies and there is a feeling of technological inevitability: that the printed book is a stepping stone in the evolution of information, and now lies ready to be devoured by its hi-tech successors.

Not everybody thinks that way, however, including the Open Library – a project with an audacious goal that it hopes can bring the web and books closer together.

The scheme is to create a single page on the web for every book that has ever been published; an enormous, searchable catalogue of information about millions of books. It is still in beta, but already more than 23m books are in its system, drawing information from 19 major libraries and linking to the text of more than 1m out-of-copyright titles.

That is admirable work for just a handful of staff at the library, an arm of the non-profit Internet Archive (which itself has the vast objective of trying to keep a historical record of the web for future generations). But with information about books already being processed by hugely popular websites such as Google and Amazon, the question remains – why bother?

George Oates, the newly installed project leader, says it's a way to preserve book records for history and, crucially, make the information usable by anybody.

"It's remarkably difficult to unify this information," she says, when we meet at the Internet Archive building in San Francisco's leafy Presidio park, a former military outpost that is, rather aptly, historically preserved. "As much as the libraries attempt to have similar standards and orders, there are always gotchas and nooks and crannies that have to be worked out."

The locus position

More than simply bringing together cold lists of books from isolated libraries, however, she also believes OL can breathe life into books by grabbing information from around the internet.

"Imagine books more as a networked object, rather than a single entity," she suggests. "We start with this kernel and then we see what we can pile onto it … it's a locus for all the information about a book that's on the wider web."

In a way, it's like a Wikipedia for printed material (indeed, it runs on wiki software, allowing anyone to add their own notes on different books or editions). And Oates, who took over the project this year, is hoping to turn it from a skilful attempt to ingest vast amounts of data into something that is useful to ordinary people.

The site can potentially pull information from all over the web – retailers, reviews, book clubs, forums and enthusiast sites – as well as from social networks that already exist for bibliophiles, such as LibraryThing or GoodReads.

"It is about sharing as openly as possible – and that's really liberating … we're almost a non-threat to the rest of the web, because we're not keeping the property."

Oates knows a thing or two about sharing objects online. For the past few years, the Australian was one of the leading lights at the popular photo website Flickr – spending four years as lead designer, before moving to a role that included projects such as the Commons: a scheme to use Flickr as a window on publicly held photography collections.

Journey of discovery

The lessons from her previous work are carrying through to the project in obvious ways – a redesign is being mooted to make more palatable to those who don't have a degree in library science. But she is also hoping to introduce some of sense of serendipity or exploration to the records.

"Right now it's about search and retrieve, and there's no sense of browsing or skipping around," she says. "In the future we can start to do queries like 'show me all the popular subjects that were written about in 1934'. You can start to trend that over time, look at peaks and troughs in areas of interest. The data's all there, but it's about making connections that are inferred by the data itself – I'm really excited by that."

Propagating that idea could be made more difficult by Google, which last week revamped its book search to make it a more sleek and social experience. Oates says she doesn't see that in adversarial terms, however.

"The book search on Google is awesome – they've thrown a shitload of computing power at it, and you can see books that mention things, websites that mention those books and books on a map. It's useful, but it's really clinical." Oates won't say any more about Google, but her colleagues are less reticent. Peter Brantley, the archive's director of access, has been a vocal critic of the company's plans – even going as far as calling Google's attempt to gain exemption against future copyright claims as ­"disgusting".

There is certainly a tension between the two schemes, partially because their intentions are so similar while their approaches are so different. But, while Google has the backing of many publishers, who see the chance to make some extra cash in the deal, one crucial ally for Open Library may be the academic world.

If the scheme gives researchers and students the chance to use Open Library in their work – referring to an OL page as a citation source, or building a bibliography using its tools – they could get a core audience that spreads the concept. Plus, of course, the idea is that Open Library will remain just that – open – for ever. "The longevity of the work that we're doing is a bit of a culture shock, and a really curious solution to provide," she says. "How do we write stuff to disk that's going to be retrievable in 1,000 years? This is a very new problem for my brain – not that the systems I've worked on before would go up in smoke, but this is designed explicitly not to."

Neutral success?

Still, regardless of long-term vision, the scheme's success is not clear cut. Despite its meek appearance, the library world is big business – and it is not clear that big libraries are particularly keen on giving away the keys to anyone just yet. Organisations such as the British Library have their own projects to archive their vast collections for the web.

Still, Open Library is hoping that it can succeed by being a neutral space, without agendas or commercial imperatives.

"I want it to be a place where people can love books and contribute information about books," Oates says. Perhaps, in the face of the onslaught of digital ­information, the printed word has found a new way to evolve.