Change Colony Upgrade

Is there any way to change the upgrade on a colony world?

Or is your first choice or the choice of the original owner if you capture it, what you are stuck with?