After failing to spy on someone the house npc goes gray and I can't control him anymore. I've noticed this happen multiple times and I doubt it is because of relations because it happens the same day Ihire them.