Your infection is genital. Herpes infects nerve groups, and genital herpes infects the sacral ganglia nerve. This means that any symptoms you have will be in the boxer shorts area. No other body systems will be affected. It doesn't spread through your body and affect anything else.
You are only contagious from your genitals, and your symptoms will only be in the genital area. No need to worry about anything else. :)