To regain immediate access, just walk up to the console of the ESXi host (if accessible) or take an ILO/DRAC/KVM and on the console hit F2
That should enable you to log in and change the network settings.
And I agree with@nielse - sounds like a switch issue where it is set to trunk mode instead of access