Missing Data Imputation Using Data Generated by GAN

Hanan Hammad Alharbi; Masaomi Kimura

doi:10.1145/3418688.3418701

Missing Data Imputation Using Data Generated by GAN

Hanan Hammad Alharbi, Masaomi Kimura

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Missing data is a common and challenging problem that arises in many research domains and led to the complication of data analysis. Therefore, handling missing data is a necessity as proposed in many previous studies. In this paper, we proposed two methods to impute missing numerical datasets based on generated data by GAN and determine the imputed values using Euclidian distance. In various missing percentages, we evaluated the imputation accuracy of all methods using MAE and RMSE tests. The proposed methods randomGAN and meshGAN produce the best imputation accuracy in 2 out of 4 datasets against three compared methods: SimpleImputer, IterativeImputer, and KNNimputer.

Original language	English
Title of host publication	ICCBD 2020 - 2020 3rd International Conference on Computing and Big Data
Subtitle of host publication	Workshop 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020
Publisher	Association for Computing Machinery
Pages	73-77
Number of pages	5
ISBN (Electronic)	9781450387866
DOIs	https://doi.org/10.1145/3418688.3418701
Publication status	Published - 2020 Aug 5
Event	3rd International Conference on Computing and Big Data, ICCBD 2020 and its Workshop the 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020 - Virtual, Online, Taiwan, Province of China Duration: 2020 Aug 5 → 2020 Aug 7

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	3rd International Conference on Computing and Big Data, ICCBD 2020 and its Workshop the 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020
Country/Territory	Taiwan, Province of China
City	Virtual, Online
Period	20/8/5 → 20/8/7

Keywords

GAN
KNNimputer
Machine learning
Missing data imputation

ASJC Scopus subject areas

Software
Human-Computer Interaction
Computer Vision and Pattern Recognition
Computer Networks and Communications

Access to Document

10.1145/3418688.3418701

Cite this

Hammad Alharbi, H., & Kimura, M. (2020). Missing Data Imputation Using Data Generated by GAN. In ICCBD 2020 - 2020 3rd International Conference on Computing and Big Data: Workshop 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020 (pp. 73-77). (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3418688.3418701

Missing Data Imputation Using Data Generated by GAN. / Hammad Alharbi, Hanan; Kimura, Masaomi.

ICCBD 2020 - 2020 3rd International Conference on Computing and Big Data: Workshop 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020. Association for Computing Machinery, 2020. p. 73-77 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Hammad Alharbi, H & Kimura, M 2020, Missing Data Imputation Using Data Generated by GAN. in ICCBD 2020 - 2020 3rd International Conference on Computing and Big Data: Workshop 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020. ACM International Conference Proceeding Series, Association for Computing Machinery, pp. 73-77, 3rd International Conference on Computing and Big Data, ICCBD 2020 and its Workshop the 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020, Virtual, Online, Taiwan, Province of China, 20/8/5. https://doi.org/10.1145/3418688.3418701

Hammad Alharbi H, Kimura M. Missing Data Imputation Using Data Generated by GAN. In ICCBD 2020 - 2020 3rd International Conference on Computing and Big Data: Workshop 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020. Association for Computing Machinery. 2020. p. 73-77. (ACM International Conference Proceeding Series). doi: 10.1145/3418688.3418701

Hammad Alharbi, Hanan ; Kimura, Masaomi. / Missing Data Imputation Using Data Generated by GAN. ICCBD 2020 - 2020 3rd International Conference on Computing and Big Data: Workshop 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020. Association for Computing Machinery, 2020. pp. 73-77 (ACM International Conference Proceeding Series).

@inproceedings{432d18ee1bd640f0a40c282c0f9fa584,

title = "Missing Data Imputation Using Data Generated by GAN",

abstract = "Missing data is a common and challenging problem that arises in many research domains and led to the complication of data analysis. Therefore, handling missing data is a necessity as proposed in many previous studies. In this paper, we proposed two methods to impute missing numerical datasets based on generated data by GAN and determine the imputed values using Euclidian distance. In various missing percentages, we evaluated the imputation accuracy of all methods using MAE and RMSE tests. The proposed methods randomGAN and meshGAN produce the best imputation accuracy in 2 out of 4 datasets against three compared methods: SimpleImputer, IterativeImputer, and KNNimputer. ",

keywords = "GAN, KNNimputer, Machine learning, Missing data imputation",

author = "{Hammad Alharbi}, Hanan and Masaomi Kimura",

note = "Publisher Copyright: {\textcopyright} 2020 ACM.; 3rd International Conference on Computing and Big Data, ICCBD 2020 and its Workshop the 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020 ; Conference date: 05-08-2020 Through 07-08-2020",

year = "2020",

month = aug,

day = "5",

doi = "10.1145/3418688.3418701",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

pages = "73--77",

booktitle = "ICCBD 2020 - 2020 3rd International Conference on Computing and Big Data",

}

TY - GEN

T1 - Missing Data Imputation Using Data Generated by GAN

AU - Hammad Alharbi, Hanan

AU - Kimura, Masaomi

PY - 2020/8/5

Y1 - 2020/8/5

N2 - Missing data is a common and challenging problem that arises in many research domains and led to the complication of data analysis. Therefore, handling missing data is a necessity as proposed in many previous studies. In this paper, we proposed two methods to impute missing numerical datasets based on generated data by GAN and determine the imputed values using Euclidian distance. In various missing percentages, we evaluated the imputation accuracy of all methods using MAE and RMSE tests. The proposed methods randomGAN and meshGAN produce the best imputation accuracy in 2 out of 4 datasets against three compared methods: SimpleImputer, IterativeImputer, and KNNimputer.

AB - Missing data is a common and challenging problem that arises in many research domains and led to the complication of data analysis. Therefore, handling missing data is a necessity as proposed in many previous studies. In this paper, we proposed two methods to impute missing numerical datasets based on generated data by GAN and determine the imputed values using Euclidian distance. In various missing percentages, we evaluated the imputation accuracy of all methods using MAE and RMSE tests. The proposed methods randomGAN and meshGAN produce the best imputation accuracy in 2 out of 4 datasets against three compared methods: SimpleImputer, IterativeImputer, and KNNimputer.

KW - GAN

KW - KNNimputer

KW - Machine learning

KW - Missing data imputation

UR - http://www.scopus.com/inward/record.url?scp=85096339994&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85096339994&partnerID=8YFLogxK

U2 - 10.1145/3418688.3418701

DO - 10.1145/3418688.3418701

M3 - Conference contribution

AN - SCOPUS:85096339994

T3 - ACM International Conference Proceeding Series

SP - 73

EP - 77

BT - ICCBD 2020 - 2020 3rd International Conference on Computing and Big Data

PB - Association for Computing Machinery

T2 - 3rd International Conference on Computing and Big Data, ICCBD 2020 and its Workshop the 2020 2nd International Conference on Computer, Software Engineering and Applications, CSEA 2020

Y2 - 5 August 2020 through 7 August 2020

ER -

Missing Data Imputation Using Data Generated by GAN

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this