Finding a low mileage one might be difficult. I think you will find a number of folks who have logged 250 plus on those model years. A friend of mine did 250 on his 06, but he replaced the transmission twice. He did buy a new Ram at that point.
My personal experience with a 05 3500 was all positive, with only a couple of sensors failing. I traded it at 100K, and it still drove as new. There were some major improvements from 04 to 05 -- not the least of which was putting the fuel pump in the fuel tank. And then with the 06, the exhaust brake was a new feature. I would look for a 06 or newer, mainly due to the exhaust brake.