I have experienced this with smallmouth in particular. There have been many occasions where I had to burn my swimbait to trigger strikes. A slower retrieve would get follows or completely ignored, while reeling as fast as I could reel would get my arm broken.

I haven't tried this much for largemouth but it sounds like I need to experiment with this more often.