Local ancestry inference is crucial for unraveling demographic histories, discovering selection signals, and including admixed individuals in genomic studies for improved equity and portability. To date, the precision and resolution of local ancestry inference were limited by technical and dataset issues. To address them, we present Orchestra, a model we train on over 10,000 single-origin individuals from 35 worldwide populations that demonstrates superior accuracy in benchmarking analyzes. We employ Orchestra to shed light on the demographic history of Latin Americans, finding trace ancestries supported by historical records. We then deploy it to offer insight on the debated Ashkenazi Jewish origins, highlighting their South European heritage. Finally, Orchestra enables us to map selection signatures, identifying trace Scandinavian ancestry in British samples and unveiling an immune-rich region linked to respiratory infections passed down from the Viking conquests. Our work significantly advances the field of local ancestry inference, highlighting its use in admixed populations.