Rather than saying the older brother pimps his two younger ones out--which he doesn't even come close to doing...that's a gross over exaggeration--I'd say that he's getting them wrapped up into some rather over-the-top stuff.
Yes, the one guy was a pedo, but that was to accentuate what a scumbag he actually was. That was the whole point, you know? To make you hate him as a pedo and a blackmailer.
The attempted molestation with Souta was repulsive, but again, this same man told a struggling young woman who aspired to be a teacher that he'd help her out if she slept with him--knowing she was struggling hard enough to actually go through with it (though she could have simply said "no"...). He was MEANT to come across as a sleaze bag. After that incident, Naoya never asks the younger brother for his help again--up to this point, at least. So apparently, he cares about his brother's well-being and is not the pimp he's accused of being. He did ask them, btw, not force them. They could have said no, and I'm sure he would have conceded--especially given how the youngest brother has no problem telling him to f*ck off under every other circumstance... He could have said no if he really wanted to. He's not as helpless as you'd assume. And as far as the older brother goes, the dude gave up going to a prestigious college because the middle brother, Yuuto, cried about being separated from everyone. Do you really think a cold-hearted pimp would give up on the prospect of going to a school that's on par with Harvard, Stanford or Oxford and eventually becoming a big shot lawyer...just because he didn't want to upset his brothers? Most likely not. The guy is not a perfect guardian, but it seems as though he's doing things to the best of his knowledge. It's really not that bad.
This series is nothing spectacular or unique, but it TOOOOOOOONS better than most of the silly, shallow shoujo out there. You know, the ones where the guy is f*ucking jumping through hoops for a girl who acts like she literally doesn't even know how to cross the street at a crosswalk (with flashing signs) on a road that is completely vacant of cars without needing some kind of assistance? The kind where the chick can't even button her coat without the help of the ever gallant "Hot-kun" or something equally as eye roll inducing? I'll take this over 95% of all shoujo in existence, actually. I recommend giving this a try if you have nothing else to read and don't mind a few shounen ai overtones. Again, it's nothing spectacular but pretty good for passing the time.
I've honestly read worse. cough Renai Shijou Shugi cough