UAVDB is a high-resolution RGB video dataset meticulously designed for UAV detection tasks across diverse scales and complex backgrounds. Comprising 10,763 training, 2,720 validation, and 4,578 test images (18,061 total) across datasets and camera configurations, it addresses key limitations of existing datasets, such as inaccurate bounding box annotations and limited diversity in environmental contexts, thereby enhancing the reliability and applicability of detection algorithms in real-world scenarios.