Extremely late here, but I argue that religion (in particular Christianity) is the solution. Ultimately we all have sinned, and the only way for us to be forgiven is by Jesus Christ. Even just reading the Bible is helpful! It's nice to know that the Creator loves you despite your sins, and will forgive you if you ask and believe that Jesus died to save you from your sin.
I think this guilt is your conscience speaking, and you have to listen to it, and strengthen it by praying, and reading the Bible. It's a very good sign that you are even thinking these things though! I'll keep you in my prayers, hopefully your situation improves!