But do I have to rebuke the sexual thoughts that arouse me?
Depends who you ask really.
I say that you shouldn't and accept it as part of your natural life. Thinking of it as sin is not a healthy state of mind in my opinion.
Others may well say otherwise of course.