TicTocs: Give us a file! Pretty pretty pretty please!

For those who haven’t heard, ticTOCs is a service that provides web-based access to a database of Journal RSS/Atom Table of Contents feeds. Awesome.

In their blog at News from TicTocs, a post titled I want to be completely honest with you about ticTOCs notes that:

As for the API – yes, we’ve been asked this several times, and the answer is that it is currently being written and should be available very soon.

That’s great, but writing in a comment on that post (after logging in with a very, very old OpenID — I used to have a blog named Opachyderm, a name which I thought was insufferably clever), I noted that we don’t need an API right away.

What we need is a text file.

Simple. Tab-delimited. TicTocID,Title,URL,issn,eissn. Update it every night.

That’s all we need.

We can do the rest. Put it in the OPAC. Stick it on our SFX pages. Not screw around with Javascript/AJAX calls when the data we need are (relatively) static and (absolutely) simple.

Someone needed to put a web interface on those data, and the one provided at ticTocs is really nice. I’m glad it’s there.

And I can’t tell you how much I applaud the JISC for starting this project and getting vendors on board. That’s always the hard part — participation and standardization. They’re doing it, and I couldn’t be happier.

But these data are incredibly valuable,  and their value is currently limited because they’re boxed up.

Spreading these data far and wide is good for scholarship, and I can’t imagine the case that could be made showing it’s better for JISC to keep them at a single endpoint.

The knee-jerk reaction is always, I know, to keep things behind a wall, even if it’s a short wall. “Things will get out of sync if people have their own copies.” Or, “We’ll provide whatever access you need, as fast as you need it, honest.” Or, “We’re going to be providing value-added services on top of the data.”

It’s all true. Things will get out-of-sync — but that’s going to happen whether you encourage people to not cache results or not. And I don’t doubt for a moment that the API provided will be great. And of course you’ll be in a position where you can provide value-added services.

But so can the rest of us.

I’ve run into this myself. I fear…well, let’s be honest. I fear providing a service, having the data stripmined, and then having no one appreciate the front-end I put on it. I do this job for the fame, not the fortune. Obviously.

But I’ll never provide services as fast as me plus three hundred other geeks, all responding to different situations and servicing different patrons.

So…provide an API. Start simple: a single call named getCurrentTextFile. Or maybe add getCurrentTextFileGzipped. It’s only ten-thousand lines of text, probably less than 75k gzipped up. I promise to call it every night about 3am local time so I’m up-to-date.

So….pretty please? With sugar on top? My catalog is waiting. So is my SFX install. And our list of ejournals. And our subject guides. And lots of pages on our website. And our pre-packaged OPML files to offer students and professors. And a thousand yet-to-be-devised services as well.

Pretty pretty pretty please???

5 Comments

  1. Posted February 3, 2009 at 2:19 pm | Permalink

    Hi Bill,

    If you are going to insert links from, say, an A-Z list of your journal subscriptions, which would be better – a) link to the journal RSS feed b) link which would display the latest TOC for each journal in at the ticTOCs website?

  2. Bill
    Posted February 3, 2009 at 2:31 pm | Permalink

    Both, of course :-)

    In many cases, for many of our users, a link to the ticTOCs site is less useful than a link directly to the home page of the journal, esp. if the RSS provided by the publisher is rather sparse. But I’d also like to inline ToC content in some cases. Or ferret out whatever I can about the user and proxy links (or don’t) through an appropriate proxy server. Or mash up filtered “superfeeds” for specific audiences (perhaps even an audience of one).

    But frankly — and I mean no disrespect, I really don’t — I’m not sure why the onus should be on me (and others) to make the case for opening the data. Can you articulate the case for keeping it closed?

  3. Posted February 3, 2009 at 5:12 pm | Permalink

    We’re not keeping it closed. Our techie has been ill, but is now working on it.

    Filtered superfeeds is an interesting idea. As is something I’m currently considering – Personalised journal current awareness visualisation with animated timeline of emerging research interests.

  4. Posted February 10, 2009 at 12:42 pm | Permalink

    Take a look at http://www.tictocs.ac.uk/text.php . Does this give you what you are looking for, for now? (When I download its output into a text file from IE7 the fields are delimited by a space rather than a tab which is pretty useless, but I’m assured that it really is tab-delimited and that whetever you are using is likely to see the tabs – tell us if he’s wrong!)

  5. Posted February 12, 2009 at 4:08 am | Permalink

    The file certainly is tab-delimited, juct checked it via a command-line download.

    Great blog post, BTW. A very good reminder to get stuff out there with the lowest friction possible, and not to lie awake at night worrying about lost opportunities (or fame).

2 Trackbacks

  1. [...] by Terry Bucknell on February 11, 2009 We’ve answered the call of developers like the Robot Librarian by providing a simple tab-delimited text file that contains all of the titles, ISSNs and feed URIs. [...]

  2. By A-to-Z TOCs via RSS – not just alphabet soup! on February 9, 2010 at 9:38 am

    [...] useful directory of RSS-format journal TOCs, available at: http://www.tictocs.ac.uk) -  after they were asked, and agreed to ‘open the box‘ on their data – by making it available in a format [...]

Post a Comment

Your email is never published nor shared. Required fields are marked *

*
*