Just destroy the totem.. then those monsters don't respawn.

And learn the tactic of kiting.
There is a mechanic where you can attack and dash and block, that will keep you in a perpetual fast moving state, and those npc monsters wont even touch you.

The player NPC on the other hand has spells.. so he will definitely touch you..