i let myself down

He really has no reason to be mad at you. Somethings's obviously bugging him. What i think you should do is sit him down and ask him what has been bothering him. Tell him that things have been weird between you, and you don't know what to do. If things don't change, and you really don't think you can deal with your problems, it might be best to end it. Good luck.