I don't think there's anything inherently wrong with switching Rites or deciding to go to Eastern Rite masses when you convert, but I'd heed what Matthew and Ladislaus said and be sure to not just pick it for the sake of it being exotic or having more interesting "smells and bells". If you feel like the Eastern Rite is preferable for you, then go ahead. But don't pick it because you think it looks prettier.
My friend Carlos went to a terrible seminary in Washington D.C. and the professors spewing heresy caused him to lose his Faith. He later switched to the Byzantine Rite. At the time, he had no idea that he couldn't just switch back to the Roman Rite. Although, depending where you are, the Byzantine priests are most likely fully Conciliarized. Like Matthew said, this crisis is much more than a fight for the Mass.