Virtual Center. Physical or VM?

Make VC a VM in your VI Environment.

Doing this frees you from finding a physical host that has a P4 2.0Ghz or better proc, 2GB of RAM and more.

Worried what would happen if VC crashes while being virtual?

Don't be that's why you have HA!!

It'll be fine ...