I enjoy establishing backgrounds, but I think it's important too to know when a panel is going to benefit from a robust background, or when a simpler one -- or none at all -- is more useful. Dialogue is also a consideration; if there's a dialogue-heavy panel with prominent figures in it, I don't tend to draw too much of a background in most of those. It's just wasted time and effort, since it won't be seen or won't be the focus of the panel.
It's also important to consider a balance for the eye in a panel. An extremely detailed, busy background and prominent figures in the foreground can cause confusion and clutter the visuals. It's wonderful to try and draw the eye along one's work, to amuse and stimulate from it, but it's also important to know when to let the reader advance to the next.
I'll usually draw a more intricate background upon the change or establishment of a scene, but after that it's typically more minimal, or omitted, since it's usually not directly relevant. If you love to draw backgrounds, though, draw them! Do what you enjoy. I hope my advice will be useful.