Cortisol can also "compete" with testosterone, attaching to the same cellular receptors that testosterone usually binds to, making testosterone less effective. On the other hand, you should limit your intake of red meat, refined sugar, processed foods, and excessive dairy, which can increase adiposity and the production of aromatase. Even