Im a protestant my only concern is you keep Christ central in your life if you stay or go. And just so you know if you do find a protestant church if they are correct in their teachings they should encourage you to reconcile to your old church before becoming a member of theirs. ( a member not just attending to be clear)
Keeping in mind something else if you leave because you dont like the saint statues, you will probably find something you dont like at say a baptist church, (possibly a band playing modern praise songs) then you could leave the baptists. I fear for you to potentially get into a pattern.
You mention protestants follow the bible then Id suggest to dig into it and seek what bothers you. There is probably a book in a christian store written by someone about most topics, read that. Discuss what you find with your family and friends and those at your church and here if you want.
What you are really after in my opinion is to grow closer to God. You can do that and should do that before you make any decisions on what church to attend. (catholics listening here?)
We all want and long for the Masters touch, He has promised to those who seek His face, and ask the door will be opened. Try reading the book of John and going over again the life of Jesus, focusing on Him.
Decide to dedicate some time each week to sit away from others and simply pray to Christ, just tell Him your frusterations and worries about the statues and other things. Keep doing all these things for awhile then you will slowly find yourself getting closer to God, When you finally move near Him things will be clearer what to do, where to go because you will be secure with Christ.
Hope that makes sense,
