Thetford Toilet sprays water over the front edge

I believe you have the answer to you own question since you say "Don't have the problem when using the water pump because the pressure/volume of water is not as high."

You need a reliable water pressure regulator on the city water inlet line. What brand you tried does not reduce the pressure low enough. Like was already suggested, you may want to try an adjustable water pressure regulator.