What about the authority of the Pope bothers you so much as to make you want to leave?
I don’t think anyone was meant to be infallible. Rather, I think that, since the power comes from the Holy Spirit, all real authority for doctrine and dogma should be placed with Him. Resultantly, I think that the Holy Spirit has given authoritative teaching (as it must) for the first seven ecumenical councils, and I have complete faith in these.
I don’t think any of the patriarchs was supposed to have authority over any other, as that would be a misunderstanding of where authority comes from, and in whom it is vested.
Magisterial teachings I disagree with are the immaculate conception. I believe in the Theotokos, Mary being more honorable than the cherubim, and more glorious beyond compare than the seraphim, and would not sit well with a Church that does not honor the mother of Her Lord. But I do not believe she had the guilt of sin, but neither do I believe any of us do, and since she did grow old and die, she was as much affected by the consequences of original sin as much as any of us.
I do not like dogmatically defining every little thing (when exactly the miracle of Eucharist occurs, transubstantiation, that there is a “real and not just spiritual” change), and trying to control all ceremony (redefining calendars, changing words in the Creed, declaring new holidays without consent from the other Church Patriarchs).
Because I believe in Catholicity (I believe in the importance of unity), I stayed with the Catholic Church. But when I found out that Vatican II (among other places that I should believe infallible teaching) teaches that even the ordinary magisterium should be held to such authority and honor as to be almost effectively infallible itself, I could no longer stomach it.
We had an issue also with Artificial Contraception, and the Catholic opinion that it is always wrong. To make sure that this issue is not the major deciding factor in my conversion (and hopefully my wife’s conversion, as she has more fondness for the Eastern faith), we have stopped practicing contraception. But I still believe it is a mistake to declare it as part of the deposit of faith and morals that contraception be intrinsically sinful (even if this is true).
I hope this gives insight into some of my issues with the Roman Catholic Church.
But this discussion would probably be best made in an Eastern Orthodox Forum.