I wouldn't do that if I were you. The charger's 3.65V output suggests it's designed to work with a different type of Lithium cell. Most Lithium cells have a nominal voltage of 3.7V, but LiFeMnPO4 cells, like the one you are using, have a lower voltage of 3.2V.
With Lithium cells, it is EXTREMELY important that the charger explicitly supports and is configured for the exact chemistry, voltage and structure (number of cells in series/parallel) of the battery attached. Mismatches will, at best, trip the charger/battery's protection circuitry (if they have any). At worst, they may cause the battery to be damaged, catch fire, even explode.