Is it bad that I don't think I need to walk my dog ?

No I don't think it is bad because it sounds like you play with him. However, when my two Min. Schnauzers were still with me I would walk them just so they could get out of yard. Also helps to keep them used to people and other dogs. You are really the only one who can judge how much exercise your dog is getting.