There is no specific law against it, but the cops can give you dangerous driving and/or trespass by night (if its private property) which are both criminal charges. They could also give you a noise violation or all sorts of other little things they pull out their ass.
You could probably get off the dangerous charge because your weren’t endangering anyones else’s life directly but the trespassing charge would be up to the owner of the property.