It has at least two volumes, the main character's father owns a metal sheet manufacturing business. The MC takes over for his dad when he falls sick and at first has trouble adjusting. He was an office worker in a different city before. His love interest has a goatee/stubble.

I first read this a few years ago and I can't find it again! If anyone knows the name, it would be much appreciated.

Wow nevermind, I just managed to find it. It's Konomi ja Naka to by Mita Homuro