This gives me some solace. I had read somewhere that it is just not important to forgive others, but also to forgive yourself at times.

Forgiving yourself does not mean to justify something wrong, but to accept that you have wronged.
And to let go. Just let go.