Thanks for using the forum. I am happy to address your questions, and my answer will be based on the information you provided here. Please make sure you recognize that this forum is for educational purposes only, and it does not substitute for a formal office visit with a doctor.
Without the ability to examine and obtain a history, I can not tell you what the exact cause of the symptoms is. However I will try to provide you with some useful information.
Trouble with memory and attention in younger people such as yourself are uncommon, but there are causes (other than epilepsy). One that comes to mind is low thyroid function, what is called hypothyroidism. Low thyroid function causes fatigue, weight gain, cold intolerance, constipation, and memory/concentration problems in addition to several other symptoms. Another possibility is anemia, which can cause severe fatigue and thinking trouble. In addition, other causes include certain vitamin deficiencies. These can all be diagnosed with simple blood tests. Another group of problems that can cause thinking problems and fatigue are psychiatric. This is not at all to say you are crazy or making anything up. Clinical (medical) depression and anxiety can sometimes be expressed not in sad or depressed feelings but rather in thinking troubles and fatigue. Treatment improves this. Finally, certain people with attention/memory troubles can have learning disabilities or attention deficit disorder (ADD). Many people think of this as a childhood disorder but it can start in childhood and not be diagnosed into later in life.
However, since you have a history of epilepsy. This should be evaluated. I would suggest that you be evaluated by your neurologist and have an EEG performed.
Thank you for this opportunity to answer your questions, I hope you find the information I have provided useful, good luck.