shower taps leaking

Is water supposed to run out of the tap assembly where the shower hose goes on when you turn the taps off, old one did it & so does the replacement