Because it's a part of you. Running away or forgetting isn't going to change that fact.

[Then, more quietly:]

The only thing that will make them go away is to accept the memories. Accept them, and then you can move on.