Are scientific theories really better when they are simpler?

Ockham’s Razor says that simplicity is a scientific virtue, but justifying this philosophically is strangely elusive.