If it were me, I would seriously consider running the utilities now, even if the water system consists of a single hose bib, the sewer of just a clean out (aka dump station) and the electric of just a 50A receptacle, rather than running some PVC pipe for later.
Water normally would not be in PVC, but in some other sort of tubing, and typically is just buried directly. If you have significant winter weather, heat tape may be needed (or the system drained for winter, which if designed with a proper slope may be a simple gravity drain).
Sewer would probably be PVC.
Electric is usually direct burial wire or wire in some sort of approved conduit, not normal PVC sewer pipe. If run in the PVC pipe, you probably would need to pull direct burial wire to comply with code, the pipe serving only for mechanical protection.
If you're planning on putting a panel in the building, I think code does require you to have a separate ground rod or other ground for the outbuilding...but check with someone who actually knows. (It's not required for a single circuit, possibly a 120/240V circuit, but required for a separate panel IIRC.) Sometimes that can be much more easily installed with initial construction.