Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v2.0.4 release #438

Merged
merged 56 commits into from
Dec 20, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
3e17b28
drop CT from SIT data, minor cleanup of SIT functions
bl-young May 31, 2024
ba82b5f
update overlapping SIT activities for VT
bl-young Jun 1, 2024
b5e67c6
update for 2021 vintage SIT
bl-young Jun 10, 2024
3e1422a
point NY GHGI data to url; drop AR5 and HFC adjustment
bl-young Jun 12, 2024
ebdd1e4
Merge branch 'develop' into cbei_data
bl-young Jun 17, 2024
33351ef
incorporate `call_all_years` for SIT and allow different SIT schemas
bl-young Jun 19, 2024
7155b13
update VT custom inventory data
bl-young Jun 19, 2024
b7c6dd6
account for changes in GWP values in SIT versions
bl-young Jun 21, 2024
18eb316
enable updates to the default GWP values for select states
bl-young Jun 21, 2024
32c23ef
update ME supplemental file through 2021
bl-young Jun 21, 2024
9810b57
add BEA Personal Consumption Expenditures by state datasets
bl-young Jun 27, 2024
8066b21
add Census_SAS Table 3 fba
bl-young Jun 27, 2024
5c3de4a
fix file name typo
bl-young Jun 28, 2024
58f1579
Addition of American Community Survey Data
elanphearerg Jun 28, 2024
c8c5d94
add economic census data for 2017
bl-young Jun 29, 2024
7918ff2
add note to add distribution data
bl-young Jun 29, 2024
0df0a24
update parsing of BEA_PCE
bl-young Jun 29, 2024
a3c3ed6
initial consolidation of ACS scripts
bl-young Jun 29, 2024
b084b80
initial parsing of BLS consumer expenditures
bl-young Jun 30, 2024
d867d6f
make `url` not required for fba
bl-young Jun 30, 2024
df7e73b
add ces item codes
bl-young Jun 30, 2024
a966b36
file cleanup
bl-young Jul 1, 2024
5be65a2
update notes for older data
bl-young Jul 1, 2024
acc4317
drop `source_catalog` updates
bl-young Jul 1, 2024
b8f19cd
add distribution of sales; update to work with 2012
bl-young Jul 1, 2024
893b68e
consolidate parsing functions by specifying variable names in config
bl-young Jul 2, 2024
0332240
consolidate method yaml files
bl-young Jul 2, 2024
0032a70
add note
bl-young Jul 2, 2024
ef5be1c
add back develop tags
bl-young Jul 4, 2024
04d212b
add suppressed data field
bl-young Jul 10, 2024
be1297d
update MeasureofSpread and fix worksheet name
bl-young Oct 22, 2024
f18e7d8
Merge pull request #421 from USEPA/sas
bl-young Oct 22, 2024
76f5f96
add `time_delay` parameter (in seconds) to avoid 429 too many request…
bl-young Oct 22, 2024
7aad90b
Merge pull request #420 from USEPA/bea_pce
bl-young Oct 22, 2024
4d33fdd
finish parsing BLS CES data
bl-young Oct 23, 2024
1af49e1
include flags for census CBP flows, when available, add as Suppressed…
bl-young Oct 25, 2024
42e31d3
fix error in adjusting payroll when not a float
bl-young Oct 25, 2024
9de92d0
cleanup and refactor
bl-young Oct 25, 2024
7c7eeff
fix extra spaces resolves #426
bl-young Oct 29, 2024
9def1f3
move CBEI files to flowsa see https://github.com/USEPA/GHGbyindustryd…
bl-young Nov 1, 2024
1396a85
simplify urls before 2012 by joining 10 counties at a time, extend ba…
bl-young Nov 7, 2024
bcbdd7d
fix path issue for files pulled from other repo
bl-young Nov 7, 2024
dfa7dd0
don't test cbei FBS models in actions
bl-young Nov 7, 2024
690f6a5
update BLS_CES units to include Thousand USD, Thousand p, Percent, an…
catherinebirney Nov 26, 2024
a319f3b
update CenSus_ACS units to USD, p, and Percent, and add additional cl…
catherinebirney Nov 26, 2024
212337f
update Census_EC units to USD, p, and Percent
catherinebirney Nov 26, 2024
51a610c
add 2023 BLS_QCEW; add State Employment FBS for 2021-2023, update NAI…
bl-young Dec 16, 2024
3fdca0d
Merge pull request #427 from USEPA/census
bl-young Dec 16, 2024
3dbb4be
Merge pull request #428 from USEPA/cbei_data
bl-young Dec 16, 2024
f44757e
Merge pull request #437 from USEPA/employ_2023
bl-young Dec 16, 2024
7455372
bump upload-artifact
bl-young Dec 16, 2024
8638dbd
update flowsa package version to 2.0.4
catherinebirney Dec 16, 2024
1bc9c63
drop development from package requirements
catherinebirney Dec 16, 2024
4123641
add activity_schema for bls qcew 2023 and generate error message if a…
catherinebirney Dec 17, 2024
aec1e5f
add 2021-2023 data for USDA_ERS_FIWS
bl-young Dec 18, 2024
9a9b687
update NOAA_FisheriesLandings through 2023
bl-young Dec 18, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/compare_single_FBA.yml
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ jobs:

- name: Upload files
if: always()
uses: actions/upload-artifact@v3.1.1
uses: actions/upload-artifact@v4
with:
# Artifact name
name: "${{ github.event.inputs.source }} ${{ github.event.inputs.year }}"
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/compare_single_FBS.yml
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ jobs:

- name: Upload files
if: always()
uses: actions/upload-artifact@v3.1.1
uses: actions/upload-artifact@v4
with:
# Artifact name
name: "${{ github.event.inputs.method }}"
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/generate_FBA.yml
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ jobs:

- name: Upload files
if: always()
uses: actions/upload-artifact@v3.1.1
uses: actions/upload-artifact@v4
with:
# Artifact name
name: "${{ github.event.inputs.source }} ${{ github.event.inputs.year }}"
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test_methods.yml
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ jobs:
- name: Upload csv files
# if: steps.FBS.outcome == 'success' # Upload csv only if step succeeds
if: always()
uses: actions/upload-artifact@v3.1.1
uses: actions/upload-artifact@v4
with:
# Artifact name
name: FBS diff files
Expand Down
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -9,4 +9,7 @@ external_data.yaml
*.cache
**/data/fbs_diff/*
flowby-old.py
flowsa/methods/flowbysectormethods/archive*
flowsa/data/external_data/SIT_data/*
flowsa/data/external_data/StateGHGI_data/*
.spyproject*
560 changes: 560 additions & 0 deletions flowsa/data/activitytosectormapping/NAICS_Crosswalk_EPA_SIT.csv

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
ActivitySourceName,Activity,SectorSourceName,Sector,SectorType,activity_set,Notes
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,2213,,commercial_ethanol,"water, sewage and other systems"
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,42,,commercial_ethanol,wholesale trade
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,44,,commercial_ethanol,retail trade
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,45,,commercial_ethanol,retail trade
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,493,,commercial_ethanol,warehousing and storage
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,51,,commercial_ethanol,information
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,52,,commercial_ethanol,finance and insurance
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,53,,commercial_ethanol,real estate and rential and leasing
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,54,,commercial_ethanol,"professional, scientific, and technical services"
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,55,,commercial_ethanol,management of companies and enterprises
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,56,,commercial_ethanol,administrative support and waste management and remediation services
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,61,,commercial_ethanol,educational services
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,62,,commercial_ethanol,health care and social assistance
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,71,,commercial_ethanol,"arts, entertainment, and recreation"
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,72,,commercial_ethanol,accommodation and food services
StateGHGI_ME,"Commercial, Ethanol Combustion",NAICS_2012_Code,81,,commercial_ethanol,other services (except public administration)
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,2213,,commercial_wood,"water, sewage and other systems"
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,42,,commercial_wood,wholesale trade
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,44,,commercial_wood,retail trade
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,45,,commercial_wood,retail trade
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,493,,commercial_wood,warehousing and storage
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,51,,commercial_wood,information
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,52,,commercial_wood,finance and insurance
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,53,,commercial_wood,real estate and rential and leasing
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,54,,commercial_wood,"professional, scientific, and technical services"
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,55,,commercial_wood,management of companies and enterprises
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,56,,commercial_wood,administrative support and waste management and remediation services
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,61,,commercial_wood,educational services
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,62,,commercial_wood,health care and social assistance
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,71,,commercial_wood,"arts, entertainment, and recreation"
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,72,,commercial_wood,accommodation and food services
StateGHGI_ME,"Commercial, Wood and Wood Residuals",NAICS_2012_Code,81,,commercial_wood,other services (except public administration)
StateGHGI_ME,"Electric power, Wood and Wood Residuals",NAICS_2012_Code,2211,,direct,"electric power generation, transmission, and distribution"
StateGHGI_ME,"Industrial, Ethanol Combustion",NAICS_2012_Code,11,,industrial_ethanol,"agriculture, forestry, fishing and hunting"
StateGHGI_ME,"Industrial, Ethanol Combustion",NAICS_2012_Code,21,,industrial_ethanol,"mining, quarrying, and oil and gas extraction"
StateGHGI_ME,"Industrial, Ethanol Combustion",NAICS_2012_Code,23,,industrial_ethanol,construction
StateGHGI_ME,"Industrial, Ethanol Combustion",NAICS_2012_Code,31,,industrial_ethanol,manufacturing
StateGHGI_ME,"Industrial, Ethanol Combustion",NAICS_2012_Code,32,,industrial_ethanol,manufacturing
StateGHGI_ME,"Industrial, Ethanol Combustion",NAICS_2012_Code,33,,industrial_ethanol,manufacturing
StateGHGI_ME,"Industrial, Wood and Wood Residuals",NAICS_2012_Code,11,,industrial_wood,"agriculture, forestry, fishing and hunting"
StateGHGI_ME,"Industrial, Wood and Wood Residuals",NAICS_2012_Code,21,,industrial_wood,"mining, quarrying, and oil and gas extraction"
StateGHGI_ME,"Industrial, Wood and Wood Residuals",NAICS_2012_Code,23,,industrial_wood,construction
StateGHGI_ME,"Industrial, Wood and Wood Residuals",NAICS_2012_Code,31,,industrial_wood,manufacturing
StateGHGI_ME,"Industrial, Wood and Wood Residuals",NAICS_2012_Code,32,,industrial_wood,manufacturing
StateGHGI_ME,"Industrial, Wood and Wood Residuals",NAICS_2012_Code,33,,industrial_wood,manufacturing
StateGHGI_ME,"LFGTE projects, Solid Waste Management",NAICS_2012_Code,562213,,direct,solid waste combustors and incinerators
StateGHGI_ME,"Landfill off-gassing, Solid Waste Management",NAICS_2012_Code,562212,,direct,solid waste landfill
StateGHGI_ME,"MSW combusted, Solid Waste Management",NAICS_2012_Code,562213,,direct,solid waste combustors and incinerators
StateGHGI_ME,"Methane flared, Solid Waste Management",NAICS_2012_Code,562212,,direct,solid waste landfill
StateGHGI_ME,"Residential, Wood and Wood Residuals",NAICS_2012_Code,F010,,direct,personal consumption
StateGHGI_ME,"Transportation, Biodiesel Combustion",NAICS_2012_Code,48,,transportation_biodiesel,transportation and warehousing
StateGHGI_ME,"Transportation, Biodiesel Combustion",NAICS_2012_Code,491,,transportation_biodiesel,postal service
StateGHGI_ME,"Transportation, Biodiesel Combustion",NAICS_2012_Code,492,,transportation_biodiesel,couriers and messengers
StateGHGI_ME,"Transportation, Biodiesel Combustion",NAICS_2012_Code,F010,,transportation_biodiesel,personal consumption
StateGHGI_ME,"Transportation, Ethanol Combustion",NAICS_2012_Code,48,,transportation_ethanol,transportation and warehousing
StateGHGI_ME,"Transportation, Ethanol Combustion",NAICS_2012_Code,491,,transportation_ethanol,postal service
StateGHGI_ME,"Transportation, Ethanol Combustion",NAICS_2012_Code,492,,transportation_ethanol,couriers and messengers
StateGHGI_ME,"Transportation, Ethanol Combustion",NAICS_2012_Code,F010,,transportation_ethanol,personal consumption
Loading
Loading