I really am sorry that you're missing him so much. It's never easy and it's going to hurt for a long time, but one day you'll be able to think about him without it feeling so bad.

I think you should keep your memories. They may hurt, but they're yours and they make you who you are.