The next-door neighbor of a Southampton town justice can continue with his defamation suit against the judge he claims suggested he was a pedophile during a municipal hearing.