Yes, it is almost certainly a multi-layer dielectric coating. It might be possible to remove it chemically but the first problem is that you don't even know the materials (SiO2, TiO2, Al2O3, MgF2, ...?). And some of the stuff that could work is pretty nasty and will attack the glass substrate as well. If you really have to, polishing it off should work, it won't be more than a couple of microns.
Most optics/glass suppliers will do custom sized windows (with a suitable AR coating). If you can't afford that, you could try buying a larger sheet in a standard size and cut that yourself.
You will probably get more helpful replies if you ask on a photo/astronomy forum, like Cloudy Nights.