We travel this route at least a half dozen times a year. Yeah, you lose 3% to 4% HP per 1000' in elevation, but not too worry, there's lots to see on your route. As noted, you turn off at Minturn before you even get to the beginning of Vail Pass. There are a few hairpin curves, but they've got the speed limit down through them so you won't be holding up much traffic. The steeper sections are interspersed with more gentle grades, unlike some passes that are nothing but UP.
Not far above Minturn you'll go by the ghost mining town of Gilman, perched on the side of a mountain. Not open to the public, but was obviously once a real company town.
Before you get to the pass, you'll go by Camp Hale where the 10th Mountain Division was trained in winter fighting techniques before deploying to Europe in WWII. Informative signs worth stopping and reading. Mostly what is left is foundations and the "streets". Many of Colorado's ski areas were founded and developed by veterans of that group of men.
Once you get over Tennessee Pass, it's not far to Leadville with only a 300' drop in 10 miles (the easy side of the pass).