Very nice, very sweet, very rhyming-like. It was a lovely poem, one after my own heart.
However, two things:
1) Shall always will we have the other
To burden all of one another
The top line is a little confusing for me. "Shall always will?" Do you need a comma there? Or something sentence restructuring?
Secondly, less importantly, that I don't think it's even really worthy of mention:
And what is it that I ought to say?
When feeling just this way
And is there anything I ought to do?
For a sunset's meaningless without you
This stanza seems slightly at odds with the rest, especially the last line, which contains a syllable too many, thus stopping the flow of the poem.
But as I say, hardly worth mentioning, it works well with it there.