Your doctor may have passed it off if he believed that it was a mass of benign fatty tissue cells called a lipoma.
However, if you're this concerned, and instinctively believe that he may be wrong, consult with another physician. It never hurts to get a second (or third) opinion. Peace of mind is priceless. A dermatologist or an orthopedist might be good specialists to speak to about it.
Thanks for the inofrmation. I am not sure if its relevant but I am a 20 year old male and the only time its is visible if i look in the mirror and take in and hold a deep breath. I have a physcial later this month and I will ask about it again there too. You are right about peace of mind, who knows me just thinking about it and poking it may be the cause of why I feel it (hopefully)