1) Just to confirm, the building will have its own dedicated meter from the utility, correct?
2) In your application, you will be going from the utility 3-phase 480 VAC and will require a 480 VAC main disconnect which will feed into 480 VAC a step-down transformer, then out of the transformer this will feed into a 208 3-phase panel which will provide 208 3-phase as well as 120 single phase.
3) The main disconnect, the step-down transformer and the 208/120 panel will be located inside the building. It is recommended that the utility meter socket be located back-to-back from the 480 VAC Main Disconnect switch. If the 480 VAC Main Disconnect switch cannot be located back-to-back from the meter socket, your local inspector (Authority Having Jurisdiction) will need to approve for the distance from the meter socket out to the main disconnect. Reason being is the National Electrical Code is limited on the distance as to how far the main disconnect switch can be located from the meter socket.
The 480 VAC Main Disconnect, the step-down transformer and the 208/120 panel should all be co-located as close as possible to each other. Either way, voltage drop calculations will need to be performed based upon the type of feeder conductors (copper versus aluminum), the distance from the main disconnect out to the transformer and the distance from the transformer to the main 208/120 load-center as well as the amperage load in the panel.
4) You will also need approval from the AHJ as to how the system will be grounded. For example, if the building will have concrete footings, I recommend installing a "Ufer" Grounding Electrode Conductor directly to the concrete footings as the "Ufer" is the best ground available. If a "Ufer" cannot be deployed, and the building will have a city cold water metal supply piping, then the ground connects to that. If no city water supply but using a well, then the ground will connect to the well head. Either using a city or a well water supply grounding, a supplemental grounding such as a minimum of (1) one or more 8 foot copper ground rods will be required. Many AHJ's allow the use of a "Ufer" ground as the single ground and a supplemental ground such as ground rods, grounding plates, water supply ground, etc, may not be required. The AHJ would need to make this call and advise you to what they require.
5) Another area where you will need to engage the AHJ is the type of raceway they will require connecting from the exterior meter socket to the main disconnect. Most likely, they will require Rigid Metal Conduit. Here again, the raceway type is their call.
6) If the service drop will be over-head and not a service underground lateral, then there are more additional requirements. Underground is more cost effective and the preferred service routing method.