I agree it could be quite a trek, especially with little ones. But, if you want to do it, you might consider the back way. Walk through DTD, exit the resort through the shuttle and bus area on the east to Harbor. Go south on Harbor to Disney Way. Cross the street, on the south side, and walk down Disney Way to the back entrance of GardenWalk. Stroll through GardenWalk to the restaurant.