A client recently re-iped their servers and as a result of which their server names also changed. This is for the BizTalk and the SQL servers. So we use the Update Database and Update Registry vb scripts to tell BizTalk about its new database servers. Ent SSO was also working fine. But we were unable to start our host instances.
We tried everything from checking security configuration on all servers for DTC to using DTC Ping and DTC tester. All of them told there was a problem with DTC. It turns out that we had an issue with name resolution. Putting the IP addresses along with the servernames in the hosts file fixed this. But this was only for troubleshooting. As mentioned in this article we should make the entry in the DNS, the WINS server, or the LmHosts file.