Comparison of imputation methods for missing values in air pollution data : case study on Sydney air quality index

W. M. L. K. N. Wijesekara, Liwan Liyanage

Research output: Chapter in Book / Conference PaperConference Paperpeer-review

34 Citations (Scopus)

Abstract

![CDATA[Missing values in air quality data may lead to a substantial amount of bias and inefficiency in modeling. In this paper, we discuss six methods for dealing with missing values in univariate time series and compare their performances. The methods we discuss here are Mean Imputation, Spline Interpolation, Simple Moving Average, Exponentially Weighted Moving Average, Kalman Smoothing on Structural Time Series Models and Kalman Smoothing on Autoregressive Integrated Moving Average (ARIMA) models. The performances of these methods were compared using three different performance measures; Mean Squared Error, Coefficient of Determination and the Index of Agreement. Kalman Smoothing on Structural Time Series method is the best method among the methods considered, for imputing missing values in the context of air quality data under Missing Completely at Random (MCAR) mechanism. Kalman Smoothing on ARIMA, and Exponentially Weighted Moving Average methods also perform considerably well. Performance of Spline Interpolation decreases drastically with increased percentage of missing values. Mean Imputation performs reasonably well for smaller percentage of missing values; however, all the other methods outperform Mean Imputation regardless the number of missing values.]]
Original languageEnglish
Title of host publicationAdvances in Information and Communication: Proceedings of the 2020 Future of Information and Communication Conference (FICC), Volume 2, March 5-6, 2020, San Francisco
PublisherSpringer
Pages257-269
Number of pages13
ISBN (Print)9783030394417
DOIs
Publication statusPublished - 2020
EventFuture of Information and Communication Conference -
Duration: 5 Mar 2020 → …

Publication series

Name
ISSN (Print)2194-5357

Conference

ConferenceFuture of Information and Communication Conference
Period5/03/20 → …

Keywords

  • air
  • data processing
  • pollution

Fingerprint

Dive into the research topics of 'Comparison of imputation methods for missing values in air pollution data : case study on Sydney air quality index'. Together they form a unique fingerprint.

Cite this