The Moon is very big, and any small object hitting it would have very little effect on its motion around the Earth, because the Moon's own momentum would overwhelm that of the impact. Most asteroid collisions would result in large craters and little else; even the largest asteroid known, Ceres, wouldn't budge the Moon.
