It's referred to "forgive AND forget" because you can forgive something, but you do not have to forget that something just because you forgive.

I am a VERY forgiving person, but I don't forget the things I forgave. I don't bring it up, ever, even in anger. My forgiveness has lead to being taken advantage of or for granted.