Well frick, I've managed to lose the exact ffmpeg command that scaled things up just as I wanted (no interpolation whatsoever) and my bash history doesn't have it =V

(-sws_flags neighbor doesn't seem to work by itself, and I can't remember the other part of this command that made it all work as I expected =V )