Do I lose Kristoff’s memories permanently?

Yes, in the quest, Kristoff sacrifices his memories of Anna to fuel the spell – this is a narrative, not a lasting game effect outside the quest.