I wear my saddle. I only carry my tether and Linesmans belt on it full time.
I have an empty pouch on the back for my strap platform, saw, pruners while climbing. Pouch on my right always has my linesman's belt. Pouch on left always has tether. I always have something to stand on (stirrups, Sling or platform) I always have something to attach to the tree (PAS, Sling, Tether, LB). Putting that stuff in your pack can you leave you stranded.
My haul line is attached to my pack and I hook my bow to it at the same time. Coming down with a long rope, the top of the haul line is my rope retrieval too.
In the tree I use my empty pouches for my phone, glasses, gloves, layers...whatever. I don't find them to be bulky or distracting. I like being able to get to my main items with minimal movement and noise. While climbing, I like to be able to get to climbing items IMMEDIATELY.