You can do this by selecting a building in your city and then tapping the Upgrade icon. You can upgrade a building if you have reached the building's resource and next-level requirements.