You just have to let go.
What good does it do dwelling on something that has happened? It’s in the past. We all have one, regardless of whether it was being in prison, sleeping around, having a dirty job, being married – it does not matter! You just have to detach yourself from that, and begin a future that WILL make you happy, and knowing you don’t have to let go of a PAST that has GOOD memories!