I'm way in favor of towing with full sized vans so take this with a grain of salt.
I've been towing with full sized vans since 1974. I love them for towing and comfort when on the road. I feel that many people just haven't towed with them to figure out how well they work.
Longer wheel base, wider track, short distance from rear axle to tow ball, straight rear axle (not independent suspension), decent vehicle weight, a real frame, stiffer suspension and some other things I'm likely forgetting all work to make towing better. A full sized van has those.
Another thing that full sized vans have is a better transition from vehicle box to trailer to help with air flow. I've noticed that I get much more air wash bumping my trailer around from big rigs that are tankers or vehicle haulers than I do from 40 and 53 ft box trailers. I feel that the box shape helps tractor trailers and vans with air movement while towing.
For towing I would go for the 3/4 ton van and V8 over a 1/2 ton with V6. You pay a bit in fuel economy but the extra capacity is worth it. My personal opinion is that with diesel fuel prices and diesel engines being more expensive than gassers a gas engine makes the most sense for casual use towing with a van.
Vans allow easy storage for stuff while traveling. Everything stays dry and is fairly readily available. We had two young children traveling with us. Being able to have each one in their own rear seat was a godsend. That remained true into their teen years. Don't underestimate that if you have kids.
In most vehicles you sit partially reclined. In a full sized van you sit more upright with your feet flat on the floor. That makes it easier to change positions while driving long distances. That is another plus that I wouldn't underestimate.
Some of the worst towing experiences I have had have been when helping others tow using their SUV. I hate towing with SUV's. That includes my friend's Escalade.