How did you select your infrastructure for your first launch?

Basically I am stuck between two choices, A quick and launch with a VPS with good storage running manual back ups (VPS provider is really reliable and has minimal down time). Upsides : cheaper and easy to launch, downsides: need to rework if solution grows. Or I go for a more expensive yet future proof set-up