I see where you are coming from....
and it sounds like at first you were flattered that this guy was so into you, and that you could have his friendship and also go and be with other guys, knowing this one would be in the background if you needed him. Than, once you started to notice he wasn't paying as much attention to you...you decided to say something to him that you knew would trigger what he really felt.
It sounds to me like you know that you don't want to be with him and you for some reason are fighting it. Are you afraid to be alone...?? If the case of not knowing what you want from day to day is really how you are, than you definately shouldn't be in any kind of boyfriend/girlfriend relationship with anyone at this point in your life. Sounds like you've got other issues going on in your life...maybe you need to take a deeper look inside yourself.