After diet, rest could be the next biggest element that affects your body’s testosterone manufacturing