I think the whole point of that commandment is that we should be taking a day to focus on God. Heavy, tedious labor in farms, factories, offices, etc. defeats that purpose. I, for one, consider my gardening a hobby, not a sin.
DISCLAIMER: Catholic Answers has turned over the archive to Catholic-Questions.org and no longer owns, manages, or moderates the forums. For additional apologetics resources please visit www.catholic.com.