Measuring the vector boson scattering (VBS) precisely is an important step towards understanding the electroweak symmetry breaking of the standard model (SM) and detecting new physics beyond the SM. We propose a neural network which compress the features of the VBS into three dimensional latent space. The consistency of the SM prediction and the experimental data is tested by the binned log-likelihood analysis in the latent space. We will show that the network is capable of distinguish different polarization modes of $WWjj$ production in both dileptonic channel and semi-leptonic channel. The method is also applied to constrain the effective field theory and two Higgs Doublet Model. The results demonstrate that the method is sensitive to generic new physics contributing to the VBS.