2006 Fleetwood Pace Arrow Entry Lockset Issue

We started having issues with the entry lockset where when we try to enter and we pull on the handle, it pulls but does not open the door. When that happens, we can open it from the inside with no problems. I took the lockset apart and looked at the mechanics on how that works and what I found was the interior door 'knob' which when pulled up is what does all the mechanics of opening the door (latch). The outside pull handle simply has a piece that pulls the interior door handle up and thus opens the latch. I think, possibly, what is happening is there is some slop in the mecahincals in the door which allows the exterior handle component to pull too far and actually on top of the piece that it is supposed to pull thus NOT opening the door.

I know this is a lot of rambling but if anyone has any thoughts on my issue, please advise. I am at the point where I believe I need a replacement lockset.

This is the style I have: