A question regarding a mans height and dating.?

I'm 5'4 and I wouldn't mind a guy being 5'6. If I get along with him and see a good relationship ahead, I'm not going to throw it away on a guy being slightly below average height. For some women, it does matter though. Just as I know some girls who are 5'10+ and have been turned down based on their height.