Columbia ice fields

We are travelling this summer to Banff 5days then to Jasper 3days,should we camp@ the ice fields 1nite on the way to Jasper or come back from Jasper to visit. What would experience say? John R.