Thanks for the valuable suggestions.
You should not play around with your medications yourself. I do not know of any pill that combines both of those drugs in one tablet. You can ask your doctor, but I really doubt it exists.
If you're better now on the pills, it means they're working. It's a trap many people fall into--"I'm feeling better, so I don't need the meds anymore". It ***** to have to take multiple pills a day, but if that's what keeps you healthy, that's what you need to do. You could talk to whoever prescribed the meds about the possibility to transitioning to a monotherapy, but if the only problem you have is taking a bunch of pills (i.e. you aren't having unpleasant side effects/they're only mild), then it's probably best to keep with what you have, because the new thing might be a lot worse.