You may have developed a traumatic cyst--a fluid-filled sac brought on by biting. This isn't serious, but won't go away on its own. A dermatologist can diagnose this for you and probably treat it very simply if necessary using electrocautery. (Of course, it may not be a cyst, in which case medical treatment with creams and such may do the trick.)
Best.
Dr. Rockoff