First, your use of the qualifier “wholly” is a strawman. Nobody here has said “wholly” or anything similar. It isn’t that simple.
But further, it is impossible to say that sexual orientation has no impact on identification as gay. The very term gay is synonymous with sexual orientation. They cannot be separated.
I only know one gay person who is a staunch, Orthodox Catholic, and remains chaste. He recognizes his SSA, and he disagrees with you. Reflecting on the time before his re-conversion, he recognized that he very much identified himself with his sexual orientation. he says that even to this day he struggles to remind himself that his innate desires do not define him, but that his actions and his conscience do.
And for the other gay people I know, they very much identify with their sexuality. Indeed, it was central to who they were. I have never had any in-depth discussions as I did with the former individual I discussed, but these folk made it very clear that “who they loved, and how they loved them” was important. Separating being “gay” from “sexual orientation” is impossible.