I dont think it would be unreasonable for the direct to consumer clothing folks to at a minimum split the cost of return shipping for a size replacement. Kinda difficult for the consumer to always get that right when you cant try it on first.
Split is probably reasonable. I see what you're saying, but some folks absolutely abuse it to the detriment of others.