ZCM 11.2.3a Replace Primary

I'm having a problem with one of my 2 primary servers. When the Zen services are running users can not login (this was my original primary). If I kill all the services the logon hangs for a few seconds then authenticates with my second primary. I've set all the services to look to the second primary, but they still look to the original first.

Can I simply remove the original primary from the realm, create a new server (VM) with the original name and reinstall Zen then add it as a primary and be on my happy way? Would it be best to continue running them on 2008R2 or move them to linux (not a lot of in house linux experience)?

Thanks for any input here, good times :).

Dennis