If you are planning on becoming a Catholic, the classes normally start in the fall, so you might have time to make some arrangements for child care during the class. There may be people in the parish who could assist you in that.
And if you were taking a class from my parish and could not work out baby sitting, you would be welcome to bring the child.