Yes, that's correct.
The issue that I "seem to imply" is men staring at women's bodies, specifically in various states of physical exertion. You know men that do not look at the body of the opponent they are playing an athletic sport against? A sport that requires observation of the opponents movements? How exactly do you know this?
Unfortunately people tell me lots of things male and female. I have a warm non judgmental presence in most cases (I know people don't think that here) I went to college I was the girl that guys talked to but didn't do try anything else with because I was probably the marrying type not the other type of girl and this was way before I became a traditional Catholic so yes I know a lot. Yes some men can play sports for fun without lusting after a girl.
I think the real question may be is there really a difference between admiring something beautiful like a painting and perverting it into something impure?
A person can look at a painting of a flower and say that is beautiful, but someone can also imagine that flower into something perverse. Which is correct? Is it just a flower or is it perverse?