Baby oil will help, but next time you are shaving dont use a cheap razor or it sounds like it, also never shave against the grain always shave the way your hair grows, just give it a couple of days and it will go away, suggest you go commando for the next couple of days as that will help.
I've been shaving for over 30 years, once you get used to doing more often you should not get it again, by the way shaving with the it grows stops ingrowing hairs.
Good Luck
Hi there you could also try Sudocrem that will calm it down Take care ............Bob
Pantothenol creme is what we use on tattoo's