You should visit your parents regularly in any event, to the extent you can do so. Obviously if you are in some circumstance like deployed overseas, in prison, a long distance away, living in a cloister, etc. visiting time is going to be limited, and you may have to rely on Skype or phone calls if permitted.
If your parent has a big expectation of you being there for Father’s Day or Mother’s Day, and you reasonably can do so, then you should be there because it would make them happy.
If your parent doesn’t have a big expectation of you being there for a specific event or day, then you should just plan a visit when you can.
My parents expected me to visit from time to time and especially around major holidays like Christmas, but they did not expect me to visit them every Mother’s Day or Father’s Day, and there were many years when it would have been difficult for me to do that because I lacked travel money or vacation time or had some other pressing commitment like exams. Both of them had spent a lot of years in situations where they were distant from home and couldn’t just go home any old time because they didn’t have the money or in my dad’s case because he was deployed fighting wars. So they were very understanding. I know to some parents it’s a much bigger deal when the kid doesn’t come home and in those situations you either have to go home or try to discuss it with them.