Just setup a new VM and I was having problem starting User Profile Synchronization Service for the passed few days despite following all the steps outline in TechNet. Finally I figured out the only thing different on my new VM is that the Windows User Account Control feature is enabled.

Everything works flawlessly now after I disable UAC and restart the server!