I think it doesn't work. I walk / run at the same speed, whether I wear heavy armor or don't.
Barbarian speed
Probably just on your end and it might be due to wearing the heavy armor and then when you take it off the system does not recognize it right away so the speed doesn't come back on demand. But I have never had a problem with barbarian speed.