"... Harry has frontal lobe damage in his brain. It might lessen, it might not, but his impulse control is limited right now. He thinks, he wants, he does. He also doesn't have the inhibitions that might stop him, like shame of embarrassment."

It wasn't affecting what he felt. Simply how he acted on those feelings.