I had planned to remove all track pins after/during ballasting, but I believe that the track needs to be well secured to the baseboard for extensive soak testing (and playing!) before it is safe to ballast.
Thanks for everyone's interest, it is much appreciated.