Caffeine is the most widely used stimulant in the world. The stimulant effects of caffeine are mediated through its antagonistic properties on neuronal adenosine receptors. In addition, caffeine blocks neurovascular adenosine receptors and decreases cerebral perfusion. Although the effects of caffeine on blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging measures are extremely important, there are few studies addressing this issue in the literature. Because chronic caffeine use causes an upregulation of adenosine receptors, the differential effects of caffeine in low and high users is of particular interest. The present study was designed to test the hypothesis that caffeine has differential effects on the BOLD signal in high and low caffeine users. We demonstrated that the BOLD signal change in visual cortex was significantly greater in high users than in low users in the presence of caffeine. In addition, the magnitude of the BOLD signal was significantly correlated with caffeine consumption. We propose that the outcome observed here was due to an upregulation of adenosine receptors in high users, resulting in differential contributions of the neural and vascular effects of adenosine in the two study populations.