- \n
- Confluence has the Universal (Useless?) Wiki Converter.\u00a0 The UWC is a monolithic java program which requires Gnome and X-windows to run, at least in any sort of interactive mode.\u00a0 It never sucessfully converted a file in socialtext wiki format, and I never succeeded in getting it to upload an attachment.\u00a0 It was however, excellent at producing java stack traces and sitting and spinning forever.<\/li>\n<\/ul>\n
![\"Screen_shot_2012-11-12_at_4\"](\"http:\/\/blog.maclawran.ca\/wp-content\/uploads\/2013\/05\/c53b3-screen_shot_2012-11-12_at_4-21-40_am-scaled500.png\")
<\/div>\nSo here’s what to do:<\/p>\n
- \n
- For Socialtext, request your backups.\u00a0 They’re pretty useless except that they provide the attachments you’ll need, and grabbing them from the backups is generally easier than grabbing them manually out of Socialtext.<\/li>\n
- Next, accept that you’re going to have to do this stuff manually.\u00a0 I tried everything to avoid having to write code, but it just didn’t work out.\u00a0 Info on the REST api is here: https:\/\/www.socialtext.net\/st-rest-docs\/<\/a><\/li>\n
- Get a list of the workspaces you’re going to migrate, and I created them manually in Confluence.\u00a0 Then for each article in the space, you’re going to want to grab three things (which I put in 3 separate files):\n
- \n
- The article itself, in wiki format, i.e. workspace.downloadPage(space, page)<\/li>\n
- The Meta information for the file – this is where you’ll get the owner info from – something like: meta = workspace.getMetaData(page)<\/li>\n
- A list of the attachments associated with the article.<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n
![\"Screen_shot_2012-11-12_at_4\"](\"http:\/\/blog.maclawran.ca\/wp-content\/uploads\/2013\/05\/17a3f-screen_shot_2012-11-12_at_4-22-19_am-scaled500.png\")
<\/div>\nNow, for the Confluence imports:<\/p>\n
- \n
- Turn on XMLRPC from the admin menu.\u00a0 You will get to know it well.\u00a0 Here are the docs: https:\/\/developer.atlassian.com\/display\/CONFDEV\/Confluence+XML-RPC+and+SOAP+A…<\/a><\/li>\n
- I couldn’t find a decent converter from socialtext to TEXTILE (the flavor of markup used by Confluence).\u00a0 However the changes between the two formats aren’t terrible:\n
- \n
- ^, ^^, ^^^, ^^^^ get translated into h1., h2., h3., and h4.<\/li>\n
- {file: blah} gets translated into |blah|<\/li>\n
- {image: blah} gets translated into !blah!<\/li>\n
- {user: blah} becomes [mailto:blah]<\/li>\n
- .code becomes {code}<\/li>\n
- {link: blah} becomes [blah]<\/li>\n
- {section: blah} becomes {anchor: blah}<\/li>\n<\/ul>\n<\/li>\n
- Once you’ve got some wiki text converted, try to upload it to confluence using XMLRPC, it’s straightforward, i.e. newpage = confluence.storePage(token, newpagedata)<\/li>\n
- Next, the attachments – you should have all the info you need in the .meta file from socialtext, plus the attachments themselves from your socialtext backups – they’re straightforward except for having to convert the attachment data to base64: confluence.addAttachment(token, pageid, newattdata, XMLRPC::Base64.new(attdata))<\/li>\n<\/ol>\n
Gotcha’s:<\/p>\n
- \n
- Confluence thinks any open-squiggly bracket { is a macro and will barf accordingly.\u00a0 Either wrap the offending area inside of {code} bad-squigglies here {code}, or turn them into something else, like [<\/li>\n
- Obscure bug of the day – the ruby library for confluence barfs if the document being uploaded has any control characters in it, i.e. ^G’s etc.\u00a0 I don’t know how they got in there, either.<\/li>\n
- I’ve seen the upload of large attachments hang mysteriously.\u00a0 Beware.<\/li>\n
- I’ve run out of disk space – because of attachments.\u00a0 Keep an eye on the confluence_data directory – it gets big.\u00a0 Fast.<\/li>\n
- The whole thing is *really* CPU intensive.\u00a0 I’m using a decent Amazon server and have seen the load average over 10.\u00a0 I’ve also run out of memory and had the import crash.<\/li>\n
- The Socialtext REST interface may have issues.\u00a0 When I pulled a list of all the wiki pages out using the following command, iterated
\nhttps:\/\/www.socialtext.net\/data\/workspaces\/angel\/pages?filter=pagetype<\/a>:wiki;count=100 it didn’t return all pages.\u00a0 So I issued the same command without the filter – https:\/\/www.socialtext.net\/data\/workspaces\/angel\/pages?count=100<\/a> and some of the missing wiki files appeared.\u00a0 To make sure I compared the 2 lists (after sorting) using the UNIX comm command… and found to my dismay that the command to get “all files” managed to miss some of the wiki files returned by the first command.\u00a0 That sucks.\u00a0 So I’ll use a list of files from both these commands – which leaves me unsure of whether I’ve missed anything.\u00a0 Ugh.<\/li>\n<\/ul>\nNow think about moving your users.\u00a0 If there’s a one-to-one mapping, it’s straightforward, just create the new users in Confluence and make sure the articles are owned by the correct person.\u00a0 If however, you’re using something like Active Directory, then the mapping becomes a little more exciting.<\/p>\n
In this case, I suggest spinning up a test instance of Confluence and creating a pile of dummy users with the correct A\/D names and mappings.\u00a0 You can then export spaces from a test version of Confluence into a production version with live A\/D.\u00a0 The mappings will carry over, which is nice.<\/p>\n
If you’re running into issues, feel free to drop me a line, I’m happy to help.<\/p>\n
<\/p>\n
<\/p>\n","protected":false},"excerpt":{"rendered":"
Consulting tends to be interesting. Sometimes, you get interesting fun new things to do. Sometimes you get to do the stuff nobody else wants to do. Recently, I suspect it was the latter. One wouldn’t think converting a wiki would be that tough. Re…<\/p>\n
- I couldn’t find a decent converter from socialtext to TEXTILE (the flavor of markup used by Confluence).\u00a0 However the changes between the two formats aren’t terrible:\n
- Turn on XMLRPC from the admin menu.\u00a0 You will get to know it well.\u00a0 Here are the docs: https:\/\/developer.atlassian.com\/display\/CONFDEV\/Confluence+XML-RPC+and+SOAP+A…<\/a><\/li>\n
- Get a list of the workspaces you’re going to migrate, and I created them manually in Confluence.\u00a0 Then for each article in the space, you’re going to want to grab three things (which I put in 3 separate files):\n