From LedHed's Wiki
I recently upgraded my VM infrastructure to ESXi 5.5 and came across an interesting issue. The client installer refused to install on a Windows Domain Controller.
Turns out VMWare decided to enforce a common standard of not installing 3rd party software on a Domain Controller. While I agree with this, there is an exception to every rule.
In those cases you can force the install by passing the following command line switch:
/VSKIP_OS_CHECKS="1"