What I remember about this manga is that the uke had moved in with a lot of young men and there was this seme that always sneaked into his room and the uke always got embarrassed by the Semes actions and hated that the seme always went into his room without permission and one day they fell in love and the Ukes brother found out and threatened the seme not to get close to his little brother but one day they ended up having sex. Oh and also the uke and seme met each other when the uke was going to sleep and the seme went into the the Ukes room to sleep and that's how it was every night

is it Chara Cafe Relish Ni Oide ?

No but it's somehow related to it