Decommission Primary

I recently introduced two new primary servers and want to decommission two older ones. My environment will then have only two primary servers. Alot of my users do not contact the network often so would it be reasonable to unistall zenworks from the two primary servers that are being decommissioned and bind their ip addresses to the new servers? In the future when I am confident all agents now have the new closest server rule list I can unbind the old address.

Any issues with this or am I missing something?

WIndows 2008 R2 Zenworks 11.2.1