Finding a yaoi manga that goes like this. In high school, the tall uke likes the short seme secretly. They were both in the basketball club. Then in college they met again. This time the seme was 1cm shorter than him. He starts falling in love with him again. He had sex with the seme while he was drunk. The seme seems to forgot it but feels something when he touched the uke the day after while thanking him. Then the uke has a seme younger brother who is close with him. He lets his brother borrow the car with his lover. They went to uni to return it. Then the lover said that the seme is now taller than him.

Owaranai Fukou ni Tsuite no Hanashi

Yay! Thanks!