Coming to the nuisance is no defence
The principle, established in Sturges v Bridgman that if something is a nuisance, the fact that it has been a nuisance for a long time without anyone complaining about it doesn't stop it being a nuisance.
So if someone moves into the neighborhood and decides this thing everyone else doesn't consider a nuisance is a nuisance, then saying "the nuisance was here first" is no defence.
There is a suggestion that either (a) this general principle doesn't apply to cricket or (b) cricket is, at law, not a nuisance (per Lord Denning MR's dissenting juidgment in Miller v Jackson. Sadly Lord Denning’s very famous view was articulated in the course of a dissenting judgment, so sadly cricket is not immune from nuisance actions.