Ahh ok, You’re going to need to contact the town to see what regulations and build permits you may need if you want to do it legally.
If you think your neighbors wont give a shit, go ahead and build it, if you have a whiney DB neighbor follow procedure.