To the OP only you can decide if the trip is a bucket list adventure that must be done while your kids are young. If you take that approach no rational debate or drive time constraint will deter you.
If you feel you must do it to say it was done, than you will defy any other logic.
Nevertheless the drive time vs. quality time ratio is way too far out of whack for me to consider such a journey without more time.
I see the trip as being hurried and tiring without enough time to relax and truly enjoy the area. If this is the bucket list trip you have in mind there is no stopping you.
