Didnt think of that good call, check this first.
Do not change both, change the front one and see if there is any change, if not consider checking the rear one, but I would def check the air filter first…the rear o2 can affect the AFR but its mainly for the catalytic converters performance.