Glad to see you had no problems getting in, Signal. Welcome to the forums proper.
I suppose I should have told you this over email, but basically what Taparip gets is three tables holding a detailed set of threads, messages and users -- the tables had a lot more info than I realized could be scraped from the pages of the board -- but in an arbitrary format for compactness, stored in SQLite format. I ended up writing a Rube Goldberg machine of SQL queries and stored procs that moved the data out of SQLite into Microsoft T-SQL and from there into MySQL, using T-SQL procs to actually write new queries which put the board data into the MyBB tables. (Which I did because SQLite didn't support half the stuff I wanted/needed to use, like cursors.)
I had a few false starts and accidentally wiped the new board once in the process, but it eventually got done over the course of a couple-three weeks. If I were doing it all again from scratch I'd probably do a better job, as I left behind a lot of information (like "last edited" info on messages) that while not necessary would have been nice to preserve. (Theoretically I could still pull that info out of the SQLite DB and put it into the board DB, but it would be far more work than it's worth as I didn't save the correspondences between threads and messages from Crapatalk and the new threads and messages here.)
Anyway, you're welcome to my horrendously complicated and baroque scripts if you like; they might save you a little time in figuring out how to do things for yourself.
I suppose I should have told you this over email, but basically what Taparip gets is three tables holding a detailed set of threads, messages and users -- the tables had a lot more info than I realized could be scraped from the pages of the board -- but in an arbitrary format for compactness, stored in SQLite format. I ended up writing a Rube Goldberg machine of SQL queries and stored procs that moved the data out of SQLite into Microsoft T-SQL and from there into MySQL, using T-SQL procs to actually write new queries which put the board data into the MyBB tables. (Which I did because SQLite didn't support half the stuff I wanted/needed to use, like cursors.)
I had a few false starts and accidentally wiped the new board once in the process, but it eventually got done over the course of a couple-three weeks. If I were doing it all again from scratch I'd probably do a better job, as I left behind a lot of information (like "last edited" info on messages) that while not necessary would have been nice to preserve. (Theoretically I could still pull that info out of the SQLite DB and put it into the board DB, but it would be far more work than it's worth as I didn't save the correspondences between threads and messages from Crapatalk and the new threads and messages here.)
Anyway, you're welcome to my horrendously complicated and baroque scripts if you like; they might save you a little time in figuring out how to do things for yourself.
-- Bob
I have been Roland, Beowulf, Achilles, Gilgamesh, Clark Kent, Mary Sue, DJ Croft, Skysaber. I have been
called a hundred names and will be called a thousand more before the sun grows dim and cold....
I have been Roland, Beowulf, Achilles, Gilgamesh, Clark Kent, Mary Sue, DJ Croft, Skysaber. I have been
called a hundred names and will be called a thousand more before the sun grows dim and cold....