perturb

To bother or unsettle someone so they feel worried.