If your sex drive isn’t what it used to be, you’re not alone. Millions of men struggle with low libido, but instead of addressing the root cause, most are told to “just deal with it” or take a pill. Here’s the truth: Your hormones control your sex drive. If your testosterone, cortisol, or other key hormones are out of balance, your libido is going to take a hit.