Logically those levels are fine, it's CANH-CANL that matters, not the absolute voltage of each wire individually. I've seen this behaviour before, where CANH-CANL = 0 during recessive periods but the absolute levels drift as per your scope trace; it's not a problem.
What's connected to Rs? Is it connected to GND, or pulled to GND with a well defined and valid resistance?