I remember reading it about 2 years ago...but I don't remember the title OR the author's name.

Basically, it's about 2 boys (maybe living in a high-school dorm together?), I remember one of them was a LOT taller than the other, and one of them had a lot of brothers who all had side-stories throughout the manga. Also, at least one of the boys was blond, and I remember at least one scene with the bigger boy picking up the smaller one and carrying him over his shoulder.
It wasn't short, it had a few books (and maybe a spin-off book with the brothers?).
I know this isn't a lot to go off of, but can anyone help me?

Warui Koto Shitai ?

idk about the shoulder thing though LOL

Ah, it's not that one...but now I want to go read it lol
I think the height difference was bigger?

was it Saa Koi ni Ochitamae?

No...I remember the seme had yellow hair...but now I'm going to read that one too

Family Border?
In a scene, the blonde seme does carry a smaller boy.

Could it be Kimi ni Sachi Are! by Kusaka Takaaki?

There are 2 sequels each focusing on one of the seme's brothers but the characters from the first story pop up in both: Naturalist no Kare and Orangenia na Hibi.

It was Kimi ni Sachi Are! Thanks maladymaven for finding it and everyone else for helping me!!!