Providing you get enougth zinc it's not gona make enougth of a difference for you to notice. It may make a difference for an omlympic sprinter between gold and silver but there dealing with fractions of a second.
Having said that the average diet doesn't have enougth sinc. An average ejactulation contains 3mg of zinc. The average diet somewhere about 7-8mg. So that's over a third of your zinc gone. If you get the optimum of 15mg then it won't be a problem..
I'll shut up now, i don't half gone on sometimes.