We present sub-millimeter statistical detections of galaxies discovered in the 5'x5' Spitzer Early Release Observations (to 4-15 microJy 5 sigma at 3.6-8 microns, 170 microJy at 24 microns) through a stacking analysis of our reanalysed SCUBA 8mJy survey maps, and a Spitzer identification of a new sub-millimeter point source in the 8mJy survey region. For sources detected at 5.8 or 8 microns (154 and 111 sources respectively), we detect positive skews in the sub-millimeter flux distributions at 99.2-99.8% confidence using Kolmogorov-Smirnov tests, at both 850 microns and 450 microns. We also marginally detect the Spitzer 24 micron galaxies at 850 microns at 97% confidence, and place limits on the mean sub-millimeter fluxes of the 3.6 and 4.5 micron sources. Integrating the sub-millimeter fluxes of the Spitzer populations, we find the 5.8 micron galaxies contribute 0.12 +/- 0.05 nW/m^2/sr to the 850 micron background, and 2.4 +/- 0.7 nW/m^2/sr to the 450 micron background; similar contributions are made by the 8 micron-selected sample. We infer that the populations dominating the 5.8 and 8 micron extragalactic background light also contribute around a quarter of the 850 micron background and the majority of the 450 micron background.

Accepted for ApJS Spitzer Special Issue. 11 pages, 2 figures