"...so I am assuming that is good. "
Yes, it is.
What about a new medication then; or some chemical accidentally breathed, or swallowed in food or water? Any of that could relate to damage to the bone marrow, which is where blood cells are manufactured.
No, there's no need to panic at all. You haven't mentioned that you get frequent infections, so that's very good. Your neutrophils are not technically low enough to be officially regarded as neutropenia anyway. If you have no symptoms, then there is not much to worry about for now. That's why I'd said it in a casual tone, "I'd want to eventually find out why the neutrophils are down-ish."
Also, I don't see it as a steadily downward trend. I instead see it more as an initial sharp drop, then holding more or less steady since then. Was there some event like an illness or accident that happened between when you were at 6.8 then dropped to 2.87?
Hi, you want to look at the absolute numbers, not the relative. Your relative lymphocyte percent is up only because your neutrophils are down. It's mathematical.
Your Lymphocytes Absolute are actually less than the halfway point, and so is your overall WBC. A doc won't be worried because they are not really low, but if you have several past CBCs and you see a definite downward trend, I'd bring that up to any doc you see for sure. But randomly going up and down over months is not really a worry.
"Should I be worried with these numbers?"
I'd want to eventually find out why the neutrophils are down-ish. They are normally the most numerous white blood cell.
There are many causes of "neutropenia" and a blood cancer is NOT at the top of the list of likely causes. I'd first think of some infection, but not if they have been steadily low for years. It's even possible that's normal for you as an individual. More clues are needed.