It really depends on the individual. Some prioritize physicality above all else, but I'd wager that those are not in the majority.

I don't believe I have ever taken a lover I did not like as a person first and foremost.