Hi there...
Don't worry, people will always talk...but as you get older, you won't mind as much. As long as you are comfortable with who you are, and you know you're a decent person, you have nothing to prove to anyone. Good luck!