More information on the track dolly project.
The answer to smoothing things up partly involves the shape of the base board. It must be square and not rectangular. I am also going to change the PVC track for aluminium and the castors for rubber wheels with flanges either side to keep the unit on the tracks.
Oh! Also make the base board a bit heavier. This adds enormously to the stability and makes it more smooth when in motion.