Sidewalk Chalk. We keep ours in a bucket in the garage so we can just carry it out to the driveway or sidewalk.
"Paint" with water. All you need is a container of water, a paintbrush and a dry sidewalk or fence. Not only does S love to do this, but I love that it's relatively mess free.