If line shyness is a concern, then line visibility and diameter should be more important than pound test. If you do not pay attention to diameter you might end up replacing one brand's 6# with another brand's 4# of about the same diameter. A compromise would be to use 4 or 6# 100% fluorocarbon leader instead of respooling.

Report what you decided to do and if it seemed to make any difference.

Good luck.