How to prevent other civs from taking planets in yours solars systems ?

So i colonize 9 and above worlds leaving rest uncolonized.

I have this one civilisation that colonize worlds from lvl 4 planet class.

Is there a way to stop it or do i have to start a full scale war with them ?

Thanks for the info,

Cheers,