I use it against goblins, kobolds, halflings, rats, anything, and it's always -4 still. What up?

Size affect discipline check, not AB.