See your doc if this continues. And if you get a clean bill of health, it's OK to let it go.
Night terrors and sleep apnea go hand in hand. Have you considered a sleep study? If it was a one time deal, obviously not much of a concern. Also, if you have risk factors for sleep apnea, get an in lab eeg.