Is It Advisable To Refrain From Sexual Intercourse Until The Fertile Days?

Hi, Myself an my wife are trying for a baby and I have just started taking supplements to increase sperm motility and sperm count (both are quite low, but not drastically so). During my wife s ovulation days (or the two days beforehand, which we were advised are the best times to try), should I have orgasms in the days leading up to this or should I refrain from orgasms leading up to this? Many thanks.