Keep going. It get's much much better. Each season is better than the last, but Season 2 is where the feel of the show stablises and softens; it'll always be jarring when you go back to season 1 after you pass it. Season 3 is definitely where it starts to hit it's stride.
It's largely an episodic show; you could skip to season 3 and go back to the season 1 & 2 later without missing much. A few recurring characters and themese like do Q make more sense if you watch from the start though.
If you're really wavering definitely skip to season 3.