The false religious aspect or persuasive experience aspect is always dangerous but that problem can even exist in modern psychology. But hatha yoga as purely a system of physical exercise is fine, so are Tai Chi, Aikido, etc.
Actually, every intention of Yoga is to glorify idols.. I would prefer to stay away from it completely.. there are other exercises.. I can live without yoga..