Rivaroxaban is a direct oral anticoagulant that works by inhibiting factor Xa. Direct anticoagulants have largely replaced direct vitamin K inhibitors (VKAs) due to the decreased risk of major hemorrhages and the lack of need for regular monitoring and dose adjustments. However, there have been multiple reports of elevated international normalized ratio (INR) and bleeding incidents in patients on rivaroxaban, which brings into question the potential need for monitoring. We report a case of an INR of 4.8 in a rivaroxaban-naïve patient who presented with gastrointestinal bleeding and a significant drop in hemoglobin four days after starting rivaroxaban. We present possible pharmacologic explanations. We propose the idea that specific subgroups of patients may be at risk for true INR elevations and may benefit from routine monitoring of their INR while on rivaroxaban.