"Speak now or forever hold your peace,
Do you want me out of this place?
Cuz you're throwing words back and forth,
Do I have you to look foreward to?"

Good opening, I like all your questions you ask, making the reader think.

"Cuz" should be "Because", just proper grammar.

"I'm built for sin,
But I'm so pure when you're near.
Nothing crosses my mind
But white doves, and holy words."

This was a little choppy to me, just the wording. The way you worded it was a little bit odd I'm sorry. We are all sinners, we all sin, I don't get why you are pure when you are near, maybe you could instead say you have a change of heart, or some other wording. I just think you could word it differently for better understanding.

"My soul, once shackled,
Gives in to your kind words and sweet phrases.
My body, so frail,
Is now awakened by your tenderness."

Great descriptions here of how you once were, the wording you chose was wonderful.

"Is this forever,
Or is it now and never?"

The "and" would sound/ read much better if changed to "or".

"Your eyes may catch me,
But your arms might turn away."

When read, it doesn't make sense with the "might", delete that if possible.

"Terrified of your redemption,
I want more.
You are my most deadly sin,
But my most alive happiness."

Excellent ending, satisfying the reader.
Well-expressed emotions of how your heart truly feels.

4/5 from me, take care and God Bless!

~MaryAnne

Love this piece, so much emotion. 5/5, Em