Wowzers! I agree with everything you've said!
Apple has been working with Stanford University's AR/VR Laboratory for seven years now. Stanford and another collaborator (Apple competitor I suspect) introduced a glasses-based display at last year's SIGGRAF convention.
I'm still hoping for Apple glasses - sooner rather than later. I'm further sticking my neck out believing it will be wirelessly connected to a user's iPhone, which will do the heavy-lift AR processing. An iPhone already has an A-series cpu/gpu, a good amount of RAM/SSD, decent battery capacity, communications to the internet, etc.
Why unnecessarily duplicate all that stuff in a set of lightweight glasses and make it heavier/bulkier?
Glasses could communicate with a user's iPhone via short-range UWB (which Apple developed and iPhone conveniently has, and is low power).
A small battery, custom ASIC, etc. in glasses could handle the multiple video streams to and from iPhone.
IMO, if Apple introduces a bulky goggles/headset, I'm guessing that will be tepidly received being below most people's expectations coming from Apple.
If there is indeed a delay (Gurman), I suspect it might be due to Apple going for the gusto right from the start, rather than iterating from a goggles/headset and being behind competitors.
I've stuck my neck out far enough. If Apple indeed introduces a set of goggles, I'm willing to endure the Nah-nah-ni-nah-nahs.
EDIT: Delays could also be due to getting enough decent apps together from developers and ready to go on launch date.