[mjcrossuk]

Yes please do keep the old TTD online, at least in a read-only mode. The historical value is immense. No where do I know of such a detailed archive of information on past gigs.

I would like to try to preserve the torrent details from TTD in a database, which would be put online.

I've been trying to scrape the pages in the Music Downloading section of http://www.thetradersden.org/forums/archive/, but I'm getting strange results, both when scraping (using the Python Requests package) but also when browsing the pages in Chrome & Firefox. Sometimes the torrent list contain links to the individual threads, other times there's just a list of torrents without links (which is no use for getting all the torrent details).

Is there a better way for me to get all the data? Could a database extract or dump be provided, in the event that TTD closes?

Why me? I'm a retired software developer with 45+ years of experience in mainframe, workstation, PC, client-server, database and web technologies. I'm also a music collector, & trader.

I created and maintain a database of the Bot List messages from DimeADozen. The database currently contains 1,552,963 messages, each message being a torrent, going back to May 2004 (when it was EZT). The database is online, and available for download by anyone, you don't have to be a Dime member. It uses SQLite so can be used by anyone on their own computer once they've downloaded the database and installed a SQLite browser app.