Downwind with a jib up?

I have noted locally that no one drops their jib while sailing downwind under spinnaker. Why is this? Is it just the trouble of dealing with it? When the jib is up it just seems to block the wind of the chute. Looking for some discussion...