A floating gate is a isolated gate from the circuit (hence floating). It, however, doesn't float.