Well, the size of a flaccid penis shouldn't matter. That I'd not worry about although if the appearance of your penis is changing and you are retracting or shrinking and it isn't related to cold or something like that, you should talk to a doctor. You need to talk to a doctor about what is going on and they may order a testosterone test to know if your level is low. Did you start any new medications? Peyronies Disease (scar tissue builds up and causes a bend in the penis) is another reason that causes shrinking. https://www.medicalnewstoday.com/articles/320883#what-are-the-treatment-options If you were just small, that's life. But if this is a changing situation, talk to your doctor to understand why.