So would it be safe for me to keep eating it
This is a sign of a deficiency. I used to eat paper when I was a kid. I have Celiac disease, so I wasn't getting adequate nutrition absorption. Maybe you have something like that.
Yes, paper has acids and chemicals we are not supposed to eat, so you need to find out what you are deficient in so you won't have this urge. See a doctor for testing. It is called pica when you eat non-food items.