I agree if you're going to stop, you should do it cold turkeynow. That'll make them see the ratings drop. Me, I'm going to continue, because I'm invested in the story and characters, but if you're going to drop, do it soon, not next season.
If you're unsatisfied even slightly with the direction which the show has taken, and find it less fun compared to previous seasons, best to watch it illegally. The ratings have to hurt bad, if there any is one percent change of the show improving, and getting on Season 2 level.