All I remember is theres woman with long black hair think maybe she wears a glasses also pretty sure she either works in a bookstore or library.

One day a handsome man walks in think hes either an author or doctor.

The Male lead is married but his wife is cheating on him.

might be Ane no Kekkon

Thanks so much this is it