Hey fence sitter,
I, too, entered RCIA as an agnostic ex-Mormon. I was really apprehensive about doing so as I was expecting the process to be similar to LDS conversion. On the first night, when we were given a calendar of topics, I was surprised to see that the course was going to last a year given that as an LDS missionary I would ask potential converts to be baptized after the second visit. It took me a good four months to even go to Mass with the other inquirers; in the mean time I would go to Mass at a different parish and sit toward the back by myself. The last thing I wanted was to start being “love bombed” by the Catholics.
Once I started to let my guard down and really get to know the other participants, I was shocked to learn that there were some who were on their second or third round of RCIA, still having not made the leap of faith. Heck, we even had two explicit atheists who were there for no other reason than to learn more about Catholicism.
I don’t know where you live, but you may very well be the only ex-LDS in RCIA, in which case you may be treated as a sort of exotic species

My RCIA director was very accommodating, and even set up private meetings with the Parish Priest so that I could ask him some of the more theologically deep questions which didn’t really fit in well with any of the organized weekly topics.
If I were you, I’d go at least the first night, and say pretty much exactly what you said to us to the director. Good luck!