I was also blessed with love handles (worse than yours) no matter how skinny or in shape I have been, I have always had large love handles.
If I was ever going to get anything done, that would proably be the one thing I "corrected"