You would know if you had a toothbrush left in your anus. Not easy to miss. You don't, I'd not worry about that. Be careful what you are inserting into your anus though. You don't want anything to break off and get stuck or to harm yourself if it is too rigid and rough. A penis, even when erect, is still covered in soft skin and malleable to some extent.