Data Sources and Methodology

Overview

This vignette provides detailed information about the data sources and processing methods used to prepare the data used by the edfinr package. Understanding these details will help you interpret the data appropriately and inform analytical decisions.

Full data processing methods and scripts are available on GitHub via bellwetherorg/edfinr_data_cleaning.

Data Sources

This package provides access to education finance data from:

Data Processing Methods

Data Processing Detail

NCES F-33 Survey Data

Data source: NCES Common Core of Data text files of F-33 data from 2011-12 through 2022-23.

A note on year conventions used throughout the package: year is the fiscal year in which the school year ends, so year == 2023 is FY2023, covering SY2022-23. F-33 reports on state-defined fiscal years, which in most states run July through June. The enrollment denominator for all per-pupil measures is F-33 item V33, the district’s fall membership count (enroll).

The crosswalk below maps every F-33-derived column in the full dataset to the F-33 survey item(s) it is drawn from. It is generated from the package’s data dictionary, so it cannot drift from what list_variables() reports; single codes are 1:1 mappings and formula strings describe simple combinations.

list_variables("full") |>
  filter(source == "NCES F-33 Survey", !is.na(f33_item)) |>
  select(name, f33_item, description) |>
  knitr::kable()
name f33_item description
ncesid LEAID NCES district ID
year YRDATA School year (end year, e.g., 2023 = 2022-2023)
state STATE State abbreviation
dist_name NAME District name
enroll V33 Total district enrollment (V33)
rev_total_unadj TOTALREV Total raw revenue (TOTALREV)
rev_local_unadj TLOCREV Local raw revenue (TLOCREV)
rev_state_unadj TSTREV State raw revenue (TSTREV)
rev_fed_unadj TFEDREV Federal raw revenue (TFEDREV)
rev_state_unadj_pp TSTREV / V33 State raw (unadjusted) revenue per-pupil
rev_local_unadj_pp TLOCREV / V33 Local raw (unadjusted) revenue per-pupil
rev_state_cap_debt C11 State revenue for capital outlay and debt service (C11); the amount netted out of rev_state, zero-filled (not NA) for non-reporting districts
exp_cur_pp TCURELSC / V33 Current expenditure per-pupil (TCURELSC divided by V33)
exp_cap_total_pp TCAPOUT / V33 Total capital outlay per-pupil (TCAPOUT / enroll)
exp_cur_st_loc CE1 Current expenditure from state/local sources (ESSA item CE1; NA where the state did not report the fund-type split)
exp_cur_fed CE2 Current expenditure from federal sources (ESSA item CE2; NA where the state did not report the fund-type split)
exp_cur_resa CE3 Current expenditure by RESA on behalf of LEAs (ESSA item CE3; NA where the state did not report the fund-type split)
exp_cur_total TCURELSC Total current expenditure for elementary/secondary education (TCURELSC); the CE1/CE2/CE3 fund-type split does not sum exactly to this total
exp_cap_total TCAPOUT Total capital outlay (TCAPOUT)
exp_emp_salary Z32 Total employee salaries (Z32)
exp_emp_bene Z34 Total employee benefits (Z34)
exp_textbooks V93 Textbooks (V93)
exp_utilities V95 Utilities and energy services (V95)
exp_tech_supp V02 Technology-related supplies and purchased services (V02)
exp_tech_equip K14 Technology-related equipment (K14)
exp_pay_private_sch V91 Payments to private schools (V91)
exp_pay_charter_sch V92 Payments to charter schools (V92)
exp_pay_other_lea Q11 Payments to other LEAs (Q11)
exp_other_sys_pay V91 + V92 + Q11 Payments to other systems (V91 + V92 + Q11)
osp_pct (V91 + V92 + Q11) / TOTALREV Share of unadjusted total revenue paid to other systems (see data-quality notes)
exp_instr_total E13 Instruction - Total (E13)
exp_instr_sal Z33 Instruction - Salaries (Z33)
exp_instr_bene V10 Instruction - Benefits (V10)
exp_supp_stu_total E17 Support services, students - Total (E17)
exp_supp_stu_sal V11 Support services, students - Salaries (V11)
exp_supp_stu_bene V12 Support services, students - Benefits (V12)
exp_supp_instr_total E07 Support services, instructional staff - Total (E07)
exp_supp_instr_sal V13 Support services, instructional staff - Salaries (V13)
exp_supp_instr_bene V14 Support services, instructional staff - Benefits (V14)
exp_supp_gen_admin_total E08 Support services, general administration - Total (E08)
exp_supp_gen_admin_sal V15 Support services, general administration - Salaries (V15)
exp_supp_gen_admin_bene V16 Support services, general administration - Benefits (V16)
exp_supp_sch_admin_total E09 Support services, school administration - Total (E09)
exp_supp_sch_admin_sal V17 Support services, school administration - Salaries (V17)
exp_supp_sch_admin_bene V18 Support services, school administration - Benefits (V18)
exp_supp_ops_total V40 Support services, operation and maintenance of plant - Total (V40)
exp_supp_ops_sal V21 Support services, operation and maintenance of plant - Salaries (V21)
exp_supp_ops_bene V22 Support services, operation and maintenance of plant - Benefits (V22)
exp_supp_trans_total V45 Support services, student transportation - Total (V45)
exp_supp_trans_sal V23 Support services, student transportation - Salaries (V23)
exp_supp_trans_bene V24 Support services, student transportation - Benefits (V24)
exp_central_serv_total V90 Business/central/other support services - Total (V90)
exp_central_serv_sal V37 Business/central/other support services - Salaries (V37)
exp_central_serv_bene V38 Business/central/other support services - Benefits (V38)
exp_noninstr_food_total E11 Food services - Total (E11)
exp_noninstr_food_sal V29 Food services - Salaries (V29)
exp_noninstr_food_bene V30 Food services - Benefits (V30)
exp_noninstr_ent_ops_total V60 Enterprise operations - Total (V60)
exp_noninstr_ent_ops_bene V32 Enterprise operations - Benefits (V32)
exp_noninstr_other V65 Other non-instructional services (V65)
exp_covid_total AE1 COVID-19 Federal Assistance Funds - Total expenditures (AE1); NA where districts did not report the COVID items (all of NY in every year; roughly a third to half of CA districts from FY21)
exp_covid_instr AE2 COVID-19 Federal Assistance Funds - Instructional expenditures (AE2)
exp_covid_supp AE3 COVID-19 Federal Assistance Funds - Support services expenditures (AE3)
exp_covid_cap_out AE4 COVID-19 Federal Assistance Funds - Capital outlay expenditures (AE4)
exp_covid_tech_supp AE5 COVID-19 Federal Assistance Funds - Technology-related supplies and purchased services expenditures (AE5)
exp_covid_tech_equip AE6 COVID-19 Federal Assistance Funds - Technology-related equipment expenditures (AE6)
exp_covid_supp_plant AE7 COVID-19 Federal Assistance Funds - Support services operation and maintenance of plant expenditures (AE7)
exp_covid_food AE8 COVID-19 Federal Assistance Funds - Food services operations (AE8)
exp_cap_construction F12 Construction (F12)
exp_cap_land G15 Land and existing structures (G15)
exp_cap_equip_instr K09 Instructional equipment (K09)
exp_cap_equip_other K10 Other equipment (K10)
exp_cap_equip_nonspec K11 Nonspecified equipment (K11)
exp_debt_interest I86 Interest on school-system debt (I86)
debt_lt_begin _19H Long-term debt outstanding, start of FY (_19H)
debt_lt_issued _21F Long-term debt issued during FY (_21F)
debt_lt_retired _31F Long-term debt retired during FY (_31F)
debt_lt_end _41F Long-term debt outstanding, end of FY (_41F)
debt_st_begin _61V Short-term debt outstanding, start of FY (_61V)
debt_st_end _66V Short-term debt outstanding, end of FY (_66V)
fund_bal_debt_svc W01 Debt service fund cash and investments, FYE (W01); NA where flagged unreported
fund_bal_bond W31 Bond fund cash and investments, FYE (W31); NA where flagged unreported
fund_bal_other W61 Other funds cash and investments, FYE (W61); NA where flagged unreported

In addition to the items above, the cleaning scripts read F-33 variables U11, C24, L12, M12, and D11 to construct the revenue adjustments described under “Revenue Adjustments” below. C11 (state revenue for capital outlay anddebt service) both feeds those adjustments and ships directly asrev_state_cap_debt, so it appears in the crosswalk. Variables with an NA f33_item in list_variables() are either drawn from non-F-33 sources or are edfinr-adjusted measures.

Adjustments applied during cleaning:

CCD Directory Data

Data source: NCES CCD Directory data obtained via the educationdata package.

Raw variables selected:

Adjustments:

SAIPE Poverty Estimates

Data source: Census Bureau SAIPE Estimates.

Raw variables selected:

Adjustments:

ACS 5-Year Estimates

Data source: American Community Survey 5-Year Estimates accessed via the tidycensus package.

Raw variables selected:

Each fiscal year is joined to the ACS 5-year release ending in the same calendar year: FY2023 carries the 2019-2023 5-year estimates, FY2012 the 2008-2012 estimates. The 5-year window smooths across years, and its endpoint (December) extends a few months past the June close of the fiscal year.

Adjustments:

CPI

Data source: U.S. Bureau of Labor Statistics, specifically the Consumer Price Index for All Urban Consumers (CPI-U).

Raw variables selected:

Adjustments:

CWIFT (Comparable Wage Index for Teachers)

Data source: NCES EDGE Comparable Wage Index for Teachers (CWIFT), LEA-level releases.

Raw variables selected:

Adjustments and coverage:

Census Gazetteer Files (District Land Area)

Data source: U.S. Census Bureau Gazetteer Files, school district vintages.

Raw variables selected:

Adjustments and coverage:

Joining Data

Revenue Adjustments

Additional transformations are applied after the join:

Exclusions

Data Notes and Cautions

Users should note the following when working with the edfinr datasets. For examples of the diagnostic flags and comparability issues summarized here, see the “Data Quality and Comparability” article on the package website.