Once you attack a combat dummy the dummy tries to attack you back. So, even if you attacked the dummy a long time ago and you left the area and came back as soon as you stand near enough to the dummy it will take a swing at you (and you will automatically enter combat and counter attack).
Small bug, but having actions in objects' action queques that can not completed seems like a bad idea.
(tested with a dummy in the Tigereye fortress)