Nick, you are right that it is a fairly soft wooded tree. This is the same family that includes balsa wood (Ochroma pyramidale), and most of the trees in the family have fairly soft wood.
I've got a couple of baby baobabs that I grew from seed. They are are about 4 feet tall now, and should be ready to plant out fairly soon. Planting trees is awesome, especially special ones like these!
If you ever come out here Nick, it would be my pleasure to make sure that you get a chance to climb that tree.