rankle

To keep bothering or upsetting someone for a long time.