Update the docs and readme with all the changes we've made
Make the worker thread api clearly seperated and ready for test harness