What's Changed [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/catalyst-cooperative/pudl/pull/2097 Dbf xbrl mapping by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2088 eia860m september update by @cmgosnell in https://github.com/catalyst-cooperative/pudl/pull/2079 integrate the elecrtric energy source dbf & xbrl tbl by @cmgosnell in https://github.com/catalyst-cooperative/pudl/pull/2094 fix ferc1 record_id validation errors by @cmgosnell in https://github.com/catalyst-cooperative/pudl/pull/2102 Electric Dispositions Table by @cmgosnell in https://github.com/catalyst-cooperative/pudl/pull/2100 Use app token for auto-merging bot PRs when CI passes. by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2106 Update dask requirement from =2021.8 to >=2021.8,=3.20 to >=3.20,=1.0 to >=1.0,=1.4 to >=1.4,=22.0 to >=22.0,=0.10 to >=0.10,=5.0 to >=5.0,=5.3 to >=5.3,=2021.8 to >=2021.8,=1.18.5 to >=1.18.5,!=1.23.0,=1.5 to >=1.5,=0.9 to >=0.9,=2.9 to >=2.9,=4 to >=4,!=5.1.0,=3.20 to >=3.20,=5.1 to >=5.1,=3.20 to >=3.20,=1.6 to >=1.6,=1.4 to >=1.4,=4 to >=4,!=5.1.0,=4 to >=4,!=5.1.0,=2.2 to >=2.2,=0.60 to >=0.60,=4 to >=4,!=5.1.0,=0.9 to >=0.9,=3.20 to >=3.20,=2021.8 to >=2021.8,=5.1 to >=5.1,=2021.7 to >=2021.7,=1.4 to >=1.4,=2.9 to >=2.9,=2021.7 to >=2021.7,=5.3 to >=5.3,=3.20 to >=3.20,=1.5 to >=1.5,=1.4 to >=1.4,=5.0 to >=5.0,=2021.8 to >=2021.8,=5 to >=5,=22.0 to >=22.0,=1.4 to >=1.4,=2021.8 to >=2021.8,=3.3 to >=3.3, EIA missing ID validation ET[L] to Dagster by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2309 Update integration tests to work with Dagster ETL by @zschira in https://github.com/catalyst-cooperative/pudl/pull/2299 Convert epacems_to_parquet command to run dagster asset by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/2300 Add spot fix function/class by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/2254 [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/catalyst-cooperative/pudl/pull/2283 Update previous balancing_authority_code_eia fixes for plants_eia860 by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/2312 Breakpoints in Dagster by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2322 Fix balancing_authority_name update in cases where no ba_name_to_code_map() by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/2323 Update doi to point to new epacamd_eia archive by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/2316 Update local cache when using --gcs-cache-path by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2326 Update pre-commit requirement from =2.9 to >=2.9,=5.3 to >=5.3, dagster merge fixes by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/2318 Update dask requirement from =2021.8 to >=2021.8,=2021.7 to >=2021.7,=2021.8 to >=2021.8,=2021.7 to >=2021.7, Main merge by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2380 Bump docker/setup-buildx-action from 2.4.1 to 2.5.0 by @dependabot in https://github.com/catalyst-cooperative/pudl/pull/2389 Update dask requirement from =2021.8 to >=2021.8,=0.14 to >=0.14,=1.1, main by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2399 Dagster ETL documentation by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/2306 Move prime_mover_code back into boiler_fuel_eia923 by @cmgosnell in https://github.com/catalyst-cooperative/pudl/pull/2362 dev -> dagster-asset-etl merge by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2398 Rename PUDL_CACHE to PUDL_INPUT by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2401 Throw error when db is missing table schema by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/2410 Standardize asset group and asset module names by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2411 Merge dev into main by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2423 Update pre-commit requirement from =2.9 to >=2.9, main 2023-03-27 by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2457 Convert EIA-861 ETL to use Dagster by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2403 Update python-dotenv requirement from ~=0.21.0 to >=0.21,=2021.8 to >=2021.8, main 2023-03-28 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2463 Throw error if database metadata has changed by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/2331 Untangle eia_transform / harvesting / bga multi-asset by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2450 Solve 2023-03-29 nightly build failure issues by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/2469 Create PudlSQLiteIOManager to accept a Package object by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/2466 Nightly build 2023-03-30 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2473 Update PUDL from Python 3.10 to 3.11 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2408 Use enforce_schema() and read-chunking in PudlSQLiteIOManager. by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2459 dev -> main 2023-03-31 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2474 Add PUDL_INPUT and PUDL_OUTPUT vars to zenodo-cache-sync action by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/2476 Update timezonefinder requirement from =5 to >=5,=1.8 to >=1.8,=22.0 to >=22.0, main for 2023-04-03 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2484 [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/catalyst-cooperative/pudl/pull/2487 Move project metadata & build specs from setup.py to pyproject.toml by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2479 Parallelize Dagster processing of EPA CEMS by @zschira in https://github.com/catalyst-cooperative/pudl/pull/2472 Retry on md5 mismatch in GCS by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2488 Parallelize tests by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/2432 Use FERC XBRL Extractor 0.8.2 to allow pandas 2.0 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2492 Merge dev into main after nightly build 2023-04-05 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2495 Dagsterize eia tables by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/2496 Create simple SQL view assets by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/2445 Create Dynamic PudlTabl methods by @zschira in https://github.com/catalyst-cooperative/pudl/pull/2498 Update sphinx-autoapi requirement from =1.8 to >=1.8,=22.0 to >=22.0,=6.2 to >=6.2,=2021.7 to >=2021.7, main for 2023-04-11 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2520 Add 1:m matches into plant_parts_eia by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/2429 Move ferc eia manual mapping notebook 2 by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/2502 Dagsterize EIA output tables by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2519 Validate and save csv of all 1:m FERC-EIA matches by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/2516 Update networkx requirement from =2.2 to >=2.2,=2021.7 to >=2021.7,=5 to >=5,=1.2.2 to >=1.2.2,=1.2.2 to >=1.2.2,=3 to >=3,=2021.8 to >=2021.8,=4 to >=4,!=5.1.0, main 2023-04-26 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2549 Initial refactoring of dbf extraction process by @rousik in https://github.com/catalyst-cooperative/pudl/pull/2536 dev -> main for 2023-04-28 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2551 Bump JamesSingleton/is-organization-member from 1.0.0 to 1.0.1 by @dependabot in https://github.com/catalyst-cooperative/pudl/pull/2554 Update dask requirement from =2021.8 to >=2021.8,=4 to >=4,!=5.1.0,=4 to >=4,=4 to >=4,=5 to >=5,=2021.7 to >=2021.7,=2021.7 to >=2021.7,=0.9 to >=0.9,=2021.8 to >=2021.8,=1.5 to >=1.5,=2.9 to >=2.9,=1.10.3 to >=1.10.3,=2.10 to >=2.10,=1.1 to >=1.1,=2021.8 to >=2021.8,=4 to >=4,=2021.8 to >=2021.8,=2021.7 to >=2021.7,=3.0 to >=3.0,=2021.7 to >=2021.7,=4 to >=4,=1.18.5 to >=1.18.5,!=1.23.0,=6.2 to >=6.2,=1.6 to >=1.6,=2021.8 to >=2021.8,=1.0 to >=1.0,=2021.8 to >=2021.8,=22.0 to >=22.0,=2021.8 to >=2021.8,=0.14 to >=0.14,=1.2.2 to >=1.4,=0.18 to >=0.18,=4 to >=4,!=5.1.0,=4.0 to >=4.0,=2021.8 to >=2021.8,=5.3 to >=5.3,=4 to >=4,=4 to >=4,!=5.1.0,=2021.8 to >=2021.8,=4 to >=4,=5 to >=5,=2.4 to >=2.4,=2.9 to >=2.9,=2021.7 to >=2021.7,=2021.8 to >=2021.8,=0.10 to >=0.10,=4 to >=4,=4 to >=4,=22.0 to >=22.0,=1.10.3 to >=1.10.3,=2021.8 to >=2021.8,=2021.7 to >=2021.7,=1.18.5 to >=1.18.5,!=1.23.0,=0.13 to >=0.13,=2021.7 to >=2021.7,=2021.8 to >=2021.8,=1.2 to >=1.2,=2022.5 to >=2022.5,=2022.5 to >=2022.5,=1.4 to >=1.4,=1.4 to >=1.4,=3 to >=3,=2022.5 to >=2022.5,=2022.5 to >=2022.5,=3 to >=3,=3 to >=3,=2022.5 to >=2022.5,=2022.5 to >=2022.5,=0.14 to >=0.14,=13 to >=13,=0.21.5 to >=0.21.5, Main sync by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3032 Merge dev into main for 2023-11-09 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3031 Test that DB schema matches the Alembic migrations by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3027 Fix XBRL extraction clobber by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3026 Update dask requirement from =2022.5 to >=2022.5,=0.21.5 to >=0.21.5,=23 to >=23,<23.12 by @dependabot in https://github.com/catalyst-cooperative/pudl/pull/3038 [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/catalyst-cooperative/pudl/pull/3042 Always use tmp path for clobber tests. by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3043 Set up reproducible Python environments with conda-lock by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2968 Add EIA860 2022 final release data by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/3040 Eia861 2022 final release by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/3048 Bring conda-lock workflows into main by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3049 Merge dev into main for 2023-11-16 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3054 Spot fix cliffside capacity by @cmgosnell in https://github.com/catalyst-cooperative/pudl/pull/3046 Always take lockfile version from current branch when merging by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3056 Update Lockfile by @github-actions in https://github.com/catalyst-cooperative/pudl/pull/3057 Update PUDL to SQLAlchemy 2.0 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/2267 Update Lockfile by @pudlbot in https://github.com/catalyst-cooperative/pudl/pull/3059 Pin conda-lock<2.5.0 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3063 Change lock file merge strategy to look for .yml instead of .yaml files by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/3065 [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/catalyst-cooperative/pudl/pull/3062 Fix full build notification logic by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/3058 Unpin conda lock by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3069 Use ruff instead of black for autoformatting by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3060 Merge dev into main for 2023-11-21 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3070 Update development setup documentation by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3074 Update Lockfile by @pudlbot in https://github.com/catalyst-cooperative/pudl/pull/3076 Merge dev into main for 2023-11-22 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3077 Simplify process of bootstrapping pudl-dev conda env. by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3080 Update Lockfile by @pudlbot in https://github.com/catalyst-cooperative/pudl/pull/3081 Merge dev into main for 2023-11-23 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3082 Update Lockfile by @pudlbot in https://github.com/catalyst-cooperative/pudl/pull/3083 Make nightly build outputs smaller by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3084 Update Lockfile by @pudlbot in https://github.com/catalyst-cooperative/pudl/pull/3087 Fix the override paths when running in github actions by @rousik in https://github.com/catalyst-cooperative/pudl/pull/3045 Clean up explosion by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/2894 Add DBF metadata to electric_plant_depreciation_functional_ferc1 by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/2918 Update EIA 860M and EIA 861 DOIs by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3085 Refactor PUDL to use Pydantic v2 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3051 Resolve core dump failure by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/3090 dotenv compatibility by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3092 Eia923 2022 final release q4 update Nov 21 by @robertozanchi in https://github.com/catalyst-cooperative/pudl/pull/3073 Dev environment cleanup and documentation tweaks by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3093 Rename dbf-derived FERC SQLite DBs by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3094 Merge dev into main for 2023-12-01 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3104 Merge dev into main for 2023-11-29 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3095 Add GHA workflow for release-on-tag by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3124 New Contributors @knordback made their first contribution in https://github.com/catalyst-cooperative/pudl/pull/2200 @AppTrain made their first contribution in https://github.com/catalyst-cooperative/pudl/pull/2592 @dstansby made their first contribution in https://github.com/catalyst-cooperative/pudl/pull/2641 @robertozanchi made their first contribution in https://github.com/catalyst-cooperative/pudl/pull/3073 Full Changelog: https://github.com/catalyst-cooperative/pudl/compare/v2022.11.30...v2023.12.01

If you use PUDL, please cite it as indicated below.