Given the risks, I think caution should be taken. That said, altering even a smaller asteroid’s orbit is a long and slow task. If done at all properly there will be plenty of time to adjust its orbit to make it safe.