Comparison of Long-Term Air Pollution Exposure from Mobile and Routine Monitoring, Low-Cost Sensors, and Dispersion Models.
May 23, 2025Research report (Health Effects Institute)
Comparing Long-Term Air Pollution Estimates from Mobile and Fixed Monitors, Low-Cost Sensors, and Computer Models
AI simplified
Abstract
Exposure predictions of black carbon (BC), nitrogen dioxide (NO), and particulate matter (PM) for different years between 2010-2019 were highly correlated (R > 0.9).
- The year of the exposure model did not affect the presence of associations with mortality and morbidity outcomes.
- Different exposure models resulted in highly to moderately correlated predictions, with significant differences in predicted exposure levels and contrasts.
- Models explained historical exposure patterns at external sites over more than 10 years moderately well, particularly for BC and NO.
- Application of different exposure models led to similar conclusions regarding health associations, but the magnitude of effect estimates varied significantly.
- Differences in exposure assessment methods may contribute to the observed heterogeneity in effect estimates reported in systematic reviews of epidemiological studies.
- Exposure predictions from three modeling algorithms were generally highly correlated, showing similar associations with health outcomes.
AI simplified
INTRODUCTION: Assessment of long-term exposure to outdoor air pollution remains a major challenge for epidemiological studies. One of these challenges is characterizing fine-scale spatial variation of the ambient concentrations of key traffic-related air pollutants - including ultrafine particles (UFPs), black carbon (BC), and nitrogen dioxide (NO). Epidemiological studies have used widely different approaches to address these challenges, including empirical land use regression (LUR) models based on fixed-site routine or targeted monitoring, low-cost sensor networks, mobile monitoring, and deterministic dispersion models. Little information is available about the relative performance of these different approaches for assessing long-term exposure to traffic-related air pollution. Different methods may result in heterogeneity in health effect estimates from epidemiological studies applying different exposure-assessment approaches. 2
UNLABELLED: The Specific Aims of the study.
UNLABELLED: 1. Develop long-term ambient air pollution exposure estimates for selected epidemiological studies based on low-cost sensors, mobile and fixed-site monitoring, and deterministic dispersion modeling.
UNLABELLED: 2. Compare different exposure assessment methods in terms of their ability to predict spatial variation of long-term average concentrations using external validation data.
UNLABELLED: 3. Compare different exposure assessment methods in terms of air pollution effect estimates in selected epidemiological studies.
UNLABELLED: We assessed UFPs, NO, BC, and particulate matter ≤2.5 μm in aerodynamic diameter (PM). 2 2.5
METHODS: We evaluated annual average air pollution concentrations across the Netherlands using a suite of different exposure models, which differed in modeling approach (empirical LUR, deterministic dispersion models) and monitoring data used (low-cost sensors, mobile monitoring, nationwide and Europewide routine monitoring, and study-specific targeted monitoring). For empirical models, we tested three model development algorithms: supervised linear regression (SLR), Random Forest, and least absolute shrinkage and selection operator (LASSO). The predictions of the models were compared at 20,000 addresses across the Netherlands. The performance was also tested on external validation data, which were obtained from a new campaign (2021-2023) and existing data from different years, allowing assessment of how well recent models predict past air pollution exposure. Epidemiological analyses in three cohort studies were conducted to compare health effect estimates of the different exposure models. We assessed associations of air pollution in a national administrative cohort with natural-cause and cause-specific mortality, in a cohort study that had detailed lifestyle data with natural-cause mortality and incidence of stroke and coronary events, and in a mature birth cohort with lung function and asthma incidence.
RESULTS: Exposure predictions at residential sites from the dispersion model and the Europewide hybrid LUR models were available for multiple years in the period 2010-2019. For these models, exposure predictions of different years in the period 2010-2019 were highly correlated for BC, NO, and PM(Correlation coefficient R > 0.9). Consistently, the year of the exposure model did not affect the presence of an association with mortality and morbidity. Small differences in hazard ratios (HR) were related to exposure contrast for different years. The HR for the association of NOwith natural-cause mortality was 1.026 (95% confidence interval [CI]: 1.022-1.031) for the 2010 exposure estimate and 1.030 (1.024-1.035) for the 2019 exposure estimate of the Europewide LUR model, expressed per 10 µg/m. 2 2.5 2 3
UNLABELLED: The exposure models generally resulted in highly to moderately correlated exposure predictions at residential sites across the Netherlands (R > 0.7 for BC, NO, and UFPs; R > 0.5 for PM). The predicted level of exposure and exposure contrast could differ substantially between models and algorithms within models; for example, the interquartile range (IQR) for BC for each of the various models at the 20,000 residential locations ranged between 0.1 and 2.2 µg/m. Mobile monitoring studies generally resulted in modestly higher BC concentrations and exposure contrasts compared to other exposure models. Small differences were found between the different models in explaining the spatial variation of air pollution concentrations at the new and existing validation sites. Models explained historical exposure patterns at external sites covering more than 10 years moderately well, especially for BC (R > 0.7) and NO(R > 0.7), and moderately so for UFPs (R > 0.5). Most models predicted the small concentration contrasts of PMrelatively poorly. 2 2.5 2 2.5 3
UNLABELLED: Consistent with the high correlation of the different exposure models, the application of these models generally resulted in similar conclusions on the presence of associations with natural-cause, respiratory, and lung cancer mortality in the large nationwide cohort, and with asthma incidence and lung function in the birth cohort. However, the effect estimates differed substantially; for example, the HR for natural-cause mortality in the nationwide administrative cohort for a 1 µg/mincrease in BC ranged from 1.01 (95% CI: 0.99-1.02) to 1.09 (1.07-1.10). For the outcomes with small effect estimates and the smaller cohort studies, differences in conclusions related to the exposure assessment method were more distinct. 3
UNLABELLED: Differences in exposure assessment may contribute substantially to the observed heterogeneity of effect estimates in systematic reviews of epidemiological studies. High heterogeneity was indicated by the commonly used heterogeneity measure I, where the value was above 80% for a meta-analysis of the different effect estimates for natural-cause mortality in the nationwide cohort. 2
UNLABELLED: Validation of long-term exposure models for the nonroutinely monitored pollutants BC and especially UFPs was challenging, despite generally successful monitoring. The new external validation monitoring campaign resulted in rather unstable estimates of the long-term average spatial contrast, both across sites and where affected by temporal variation, especially for BC and PM. 2.5
UNLABELLED: No consistent differences were found in the model performance of SLR, Random Forest, and LASSO, both in internal cross-validation of model building and on external validation sites not used in model building. Exposure predictions from the three algorithms were generally highly correlated and resulted in similar associations with health. However, for individual models, occasionally large differences were found in exposure contrast, validation statistics, and associations with mortality and morbidity outcomes.
UNLABELLED: There was little benefit in using low-cost sensors for NOand PM. The addition of low-cost sensor data did not improve NOestimates in models that combined dispersion model estimates and data from the national monitoring network data. 2 2.5 2
CONCLUSIONS: The main conclusions of the project.
UNLABELLED: • Exposure predictions of BC, NO, and PMfor different years between 2010-2019 were highly correlated, documenting stable spatial contrast patterns. Consistently, the year of the exposure model did not affect the presence of an association with mortality and morbidity outcomes. 2 2.5
UNLABELLED: • Models explained historical exposure patterns at external sites covering more than 10 years moderately well, especially for BC.
UNLABELLED: • Different exposure models generally resulted in highly to moderately correlated exposure predictions. The predicted level of exposure and exposure contrast could differ substantially between models. Small differences were found between the different models in explaining spatial variation at validation sites.
UNLABELLED: • Application of different exposure models resulted in similar conclusions about the presence of associations with health outcomes, but effect estimates differed substantially in magnitude between individual exposure models. No consistent differences in effect estimates were found between groups of mobile, dispersion, and fixed-site LUR models.
UNLABELLED: • Differences in exposure models may therefore contribute substantially to the observed heterogeneity of effect estimates in systematic reviews of epidemiological studies. Factors that explained some of the heterogeneity of effect estimates included the performance of the model at external validation sites and the predicted exposure contrast.
UNLABELLED: • Exposure predictions from the three algorithms were generally highly correlated and resulted in similar associations with health. No consistent differences were found in their model performances.
Related papers
Sep '22
Long-Term Exposure to Low Levels of Air Pollutants and Its Links to Death and Illness in European Groups
cited by 90 papers
meta-analysis
Nov '25
Improving Air Pollution Measurement to Study Its Link with Thinking Skills
cited by 1,215 papers
journal article
Oct '24
Long-term exposure to tiny outdoor particles and black carbon linked to mortality in Montreal and Toronto, Canada
cited by 4 papers
journal article
Oct '22
Factors Influencing Air Pollution Near an Urban Intersection and a Freeway
cited by 26 papers
research support, u.s. gov't, non-p.h.s.
Mar '11
Measuring differences in indoor and outdoor air pollution using location-based models and statistical analysis
cited by 12 papers
research support, n.i.h., extramural
Oct '22
Links Between Air Pollution and Death Rates in Areas with Low Pollution: Phase 2
cited by 35 papers
research support, u.s. gov't, non-p.h.s.
Jun '09
Long-term traffic air pollution linked to lung and heart death rates in the Netherlands
cited by 125 papers
research support, u.s. gov't, non-p.h.s.
Dec '19
A 3D Model Tracking Changing Air Pollution Exposure in Hong Kong
cited by 8 papers
technical report