So FFMPEG's nightmarish filter syntax got the best of me, so I scaled the two sets of frames with imagemagick first and then shoved them together with ffmpeg ¯\_(ツ)_/¯

I mean, hey, if it works >_>