Phenomena in gauge theory are often described in the physics literature via a specific choice of gauge. In foundational and philosophical discussions this is often criticized as introducing gauge dependence, and contrasted against (often aspirational) "gauge-invariant" descriptions of the physics. I argue, largely in the context of scalar electrodynamics, that this is misguided, and that descriptions of a physical process within a specific gauge are in fact gauge-invariant descriptions. However, most of them are non-local descriptions of that physics, and I suggest that this ought to be the real objection to such descriptions. I explore the unitary gauge as the exception to this nonlocality and consider its strengths and limitations, as well as (more briefly) its extension beyond scalar electrodynamics.

19 pages. Minor revisions only. Forthcoming in Stud.Hist.Phil.Sci