Genetics and environmental conditions. If the fish has the genetic background for large wen, and u keep the fish in a fish bowl with no filtration and cheap food, then the wen never going to develop.

However, if you get a cheapy goldfish with poor genetic background, and u give it a large pond and the best food and care, it will still not grow a huge wen.