Free will incorporates freedom to act out our desires as well. They might not be successful, but God isn’t stopping us from doing them…except in the case of the pope trying to teach something fallible and saying it is infallible.
The freedom you describe is undoubtedly part of free will.
I don’t understand how you can argue this really. If the pope has free will to do whatever he wants, and God has no control over his actions at all, no matter what, then he cannot be infallible because he is a human and can make mistakes (intentional or not). Right? IF God doesn’t interfere with his actions, then how can there not be a chance that he makes mistakes? That is impossible. The pope is a human, humans by definition make mistakes, so at the very least there is a possibility that he could declare something infallible when it is not true.
But, if God interferes with the pope’s decisions so that he cannot make mistakes, then his free will is impeded on. You haven’t really challenged this argument at all. You have just made the pointless “distinction” between freedom and free will to try to support your point, but it actually is meaningless.