I'm in the search too. I normally don't give a crap about babying my stuff and rock the Rick Young harness with no protection, unless it has 1 of 3 names on it. So I've tried the FHF and hated that thing. Like you say, pretty much a pack on your chest. Way too big. The last couple nights I have been playing with a harness from Oregon Packworks called the BinoBro. I don't think i like it. It is definitely compact, and quiet, but getting the binos back in 1 handed is very difficult. Not 2 hours ago I ordered the harness from Kuiu to try out. My brother has the FHF and Kuiu and much prefers the Kuiu.
I would say once I get over the initial babying period a person does with something new I'll go back to previous method of not giving a shit, or do what SDMF suggests.