When Flowey starts to feel things again cos of the souls he's captured, it HURTS him. Musically the relatively soothing white noise and drumming of the fight gives way to discordant blasts of melody. I feel llike access to any _happy_ memory of Asriel's past must have been like that for Flowey, getting only worse and worse with time. Any thoughts about his mother and father and how they said they loved him when they could feel nothing must have been thoughts to smother as loudly as possible in laughter and noise.
Memories of Chara, though, those were too bright to deny. Even Flowey couldn't forget them. #Undertale