You could narrow your aperture, although that will mean a broader depth of focus. You could lower the ISO, which will make the receptor respond slower to light, and that will also reduce grain or 'noise'. Action and reaction! It depends a lot on how manual your camera is :)
http://365project.org/discuss/tips-n-tricks/63/slow-shutter-panning