I think we are pretty much on the same page.
My main Python project is itself devoted to graphics:
Graphics are motivational and the feedback loop of code to graphics has been important for me.
An IDE has not been.
I also am in agreement as to the fact that it would be wonderful to have some high potency graphical capabilities within the Python standard distribution.
The most likely candidate might be VPython:
I think it is in the right spirit and has the kind of small footprint that would make it appropriate as a battery included. I think the main push back is crossplatform issues - it has some fairly exotic dependencies on Linux, does not run natively on Mac, and the more exotic OS's I would suspect might be even more problematic.
Though none of this sounds unsolveable with reasonable effort.