Well somehow it turns out that rendering hundreds of 26 vert "stars" is faster than using a high-res environment texture by about a second on average ¯\_(ツ)_/¯
(I'm dealing with <5s/frame times thanks to disabling most features of the rendering engine, so an extra second is a big deal!)
Art Progress Afficher plus
Either way this lets me start to try to eliminate the "distortion" caused by the equirectangular projection by, well, not using one >_>