C'est mon passé et je m'y accroche.

English Translation

That’s my story and I’m sticking to it.

The translation is slightly off.
That’s my story and I am sticking to it sounds like a bad kid talking to a parent (or cop).
That’s my past and I cling to it sounds like Marcel Proust and his memories.