Unlike in the desktop Firefox, there's no setting in Firefox for Android options to disable saving browsing history.
Go to about:config. Create a new boolean value (+ icon) called places.history.enabled and set to false. source note: the answer only applies to the eventually deprecated Firefox Fennec, not Fenix which is currently in the beta phase.