The magnitude of the charge stored on one plate of the capacitor is constant but the capacitance decreases. Hence E must increase. There is an attractive force between the opposite charges separated. Work is done in overcoming that force to remove the dielectric.
Capacitance decreases the electric field increases without the polarized dielectric to cancel some of it out