Doubt your rod and reel are the issue. I fish them with 14lb and an MH rod.
My advice is to slow down on your hookset. They don't immediately reject swimjigs, so I suggest waiting til the fish turns before setting the hook. Let them load up on it. Seems to me if you set the hook when they're still facing you, you have a better chance at pulling it out of their mouth.