For a single hose heat pump,
As long as the temperature of the discharge air is colder than the temperature of the replacement air leaking in (outside air temperature), there will be some heat gain from the air.
When the temperature of the discharge air is equal to the temperature of the air leaking in, there is no heat gain from the air. The only heat gain will be from the watt hours being consumed by the motors in the heat pump. This is he essentially the same efficiency as a resistance heating unit.
If the temperature of the discharge air is warmer than the outside air temperature, the net heat added will be less than the watt hours consumed, and might even be negative.
With a two hose heat pump, discharge air temperature will almost always be colder than the inlet air temperature, however at very cold temperatures the gain is modest and may not justify the wear and tear on the heat pump.
Some heat pumps include resistance heaters to provide added heat in very cold weather.