No, you don't need to say that. You don't know what you had, if anything, and HPV clears from the body within 2 years for 90% of those that have it.
You might have had hemorrhoids or anal fissures or something, and there's no way of knowing now what you had. There's no test for men and HPV, but I wouldn't spend any more time worrying about it.