Since a diesel has higher compression, it must also have a longer strike to make that happen. Longer stroke engines make higher revs hard on the moving parts, specifically the crank shaft. The physics of all this is pretty straight forward. HP is a time rate measure, torque is a force. Torque is a force. Force over distance is work. Work over time is Power, as in Horse power.
The essence of the difference between Gas and Diesel experience is this. The HP and torque curves of the gas engine are shaped the same, they just peak at different RPM's. The diesel has a torque peak early then falls off slowly with rpm, while the HP curve is more peaked at the upper limit of rpm. Since HP is a RPM based measure, as rpm drops HP falls. In a gas engine it may have to fall 1500 rpm to see the torque rise. In a diesel the torque rise is immediate. So, measured HP falls at slower rate in the diesel vs gas.
YMMV