Does height really matter in determining the size of your penis? Not really. A friend of mine told me that he had sex with a basketball player and his penis was disappointingly short. While on the other hand, some short guys do have a well endowed penis. So whether you are short or tall, what matters is how you use your tool.