Optical Fiber Infrasound Sensors (OFIS) are long compliant tubes wrapped with two optical fibers that interferometrically measure the differential pressure variation along the length of the tube. Because each sensor averages spatially along the length of the tube, the frequency response of the recorded pressure variation is a function of the orientation of the OFIS sensor relative to the back azimuth and incidence angle of the incoming wave. We have exploited this property to investigate the ability of various OFIS geometries to determine the back azimuth of infrasound signals. We have found that an OFIS comprised of two orthogonal 89-m-long arms having their centers separated by 63 m can resolve the back azimuth of most infrasound signals with a good signal-to-noise ratio. We find a good match between the back azimuths determined with our technique and those determined for the same signals recorded on the co-located pipe array I57US with the Progressive Multichannel Cross-Correlation technique. Based on these results and additional synthetic tests, we have built and are testing a larger OFIS with several arms that will be able to resolve signals from all directions and with small signal-to-noise ratios.