What do you currently take for meds?
Taking into account information on your other threads, I guess I don't understand, either, why it matters whether you have a goiter or not.
You've tested positive to antibodies, so we know you have Hashi's. Goiters come in all sizes. Since your U/S report found "mild inflammation", I'm sure we can assume that your thyroid is somewhat swollen. That's very typical of Hashi's.
The initial dose we're put on is seldom where we end up. If you're not feeling better on your current dose, then meds need to be adjusted.
What are you basing your decision to d/c meds on?
I commented on your "goiter" thread, so won't need to repeat myself here.
I can't imagine any reason, whatsoever, to stop taking thyroid replacement medication, simply because you may or may not have a goiter.
Per your other thread, you have Hashimoto's. Since you've been diagnosed with Hashimoto's, your hypothyroidism will continue to get worse, as the antibodies continue to destroy healthy thyroid tissue. Stopping medication will only make things worse.
If you don't feel well on your current dosage, it's probable that you simply need an adjustment in your med. If you'll post your current thyroid hormone levels (FT3, FT4), we might be able to give you some guidance. Be sure to include reference ranges with any labs, as ranges vary lab to lab and have to come from your own report.