In 2006, the National Marine Fisheries Service, NOAA, initiated development of a national bycatch report that would provide bycatch estimates for U.S. commercial fisheries at the fishery and species levels for fishes, marine mammals, sea turtles, and seabirds. As part of this project, the need to quantify the relative quality of available bycatch data and estimation methods was identified. Working collaboratively with fisheries managers and scientists across the nation, a system of evaluation was developed. Herein we describe the development of this system (the “tier system”), its components, and its application. We also discuss the value of the tier system in allowing fisheries managers to identify research needs and efficiently allocate limited resources toward those areas that will result in the greatest improvement to bycatch data and estimation quality.