Failure-atomic synchronization of memory mapped data in non-volatile memory based system

Koki Haga, Kenichi Yamazaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Thanks to the advancements in the research and development of high-speed nonvolatile memory (NVM) in recent years, the possibility has emerged that all hard disks and DRAM could be replaced by NVM. In this paper, we consider a computer with an architecture in which hard disks and DRAM are all replaced by NVM. In a conventional architecture, to perform a write operation to a file on an HDD data is copied to memory, modified, and written back to the storage. If the same process is followed in the NVM architecture, the high speed of NVM cannot be fully utilized. For this reason, in the NVM architecture files are mapped by mmap to virtual memory, and written directly as data on the NVM. On the NVM architecture, because writing to the mmaped area immediately takes effect on the file, there is no need to use msync. However, in such a case the consistency of the data cannot be guaranteed at a time of failure. In order to guarantee the consistency, we implemented a mechanism to create a copy of the file to be written. Writing is performed on the copy, and the copy becomes the original through a proposed atomic synchronization operation. In order to perform atomic synchronization, we implemented a mechanism to record journals. This paper describes the design and implementation in detail, and finally provides a performance evaluation.

Original languageEnglish
Title of host publicationProceedings - 12th SEATUC Symposium, SEATUC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538650943
DOIs
Publication statusPublished - 2018 Mar 1
Event12th South East Asian Technical University Consortium Sysmposium, SEATUC 2018 - Yogyakarta, Indonesia
Duration: 2018 Mar 122018 Mar 13

Publication series

NameProceedings - 12th SEATUC Symposium, SEATUC 2018

Conference

Conference12th South East Asian Technical University Consortium Sysmposium, SEATUC 2018
CountryIndonesia
CityYogyakarta
Period18/3/1218/3/13

Fingerprint

Synchronization
Computer systems
Data storage equipment
Memory architecture
Dynamic random access storage
Hard disk storage

Keywords

  • Fault tolerance
  • File system
  • High-speed nonvolatile memory
  • Operating system

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Energy Engineering and Power Technology
  • Industrial and Manufacturing Engineering
  • Control and Optimization

Cite this

Haga, K., & Yamazaki, K. (2018). Failure-atomic synchronization of memory mapped data in non-volatile memory based system. In Proceedings - 12th SEATUC Symposium, SEATUC 2018 [8788878] (Proceedings - 12th SEATUC Symposium, SEATUC 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SEATUC.2018.8788878

Failure-atomic synchronization of memory mapped data in non-volatile memory based system. / Haga, Koki; Yamazaki, Kenichi.

Proceedings - 12th SEATUC Symposium, SEATUC 2018. Institute of Electrical and Electronics Engineers Inc., 2018. 8788878 (Proceedings - 12th SEATUC Symposium, SEATUC 2018).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Haga, K & Yamazaki, K 2018, Failure-atomic synchronization of memory mapped data in non-volatile memory based system. in Proceedings - 12th SEATUC Symposium, SEATUC 2018., 8788878, Proceedings - 12th SEATUC Symposium, SEATUC 2018, Institute of Electrical and Electronics Engineers Inc., 12th South East Asian Technical University Consortium Sysmposium, SEATUC 2018, Yogyakarta, Indonesia, 18/3/12. https://doi.org/10.1109/SEATUC.2018.8788878
Haga K, Yamazaki K. Failure-atomic synchronization of memory mapped data in non-volatile memory based system. In Proceedings - 12th SEATUC Symposium, SEATUC 2018. Institute of Electrical and Electronics Engineers Inc. 2018. 8788878. (Proceedings - 12th SEATUC Symposium, SEATUC 2018). https://doi.org/10.1109/SEATUC.2018.8788878
Haga, Koki ; Yamazaki, Kenichi. / Failure-atomic synchronization of memory mapped data in non-volatile memory based system. Proceedings - 12th SEATUC Symposium, SEATUC 2018. Institute of Electrical and Electronics Engineers Inc., 2018. (Proceedings - 12th SEATUC Symposium, SEATUC 2018).
@inproceedings{98d6ce691a6849659606b7e82a6b96ad,
title = "Failure-atomic synchronization of memory mapped data in non-volatile memory based system",
abstract = "Thanks to the advancements in the research and development of high-speed nonvolatile memory (NVM) in recent years, the possibility has emerged that all hard disks and DRAM could be replaced by NVM. In this paper, we consider a computer with an architecture in which hard disks and DRAM are all replaced by NVM. In a conventional architecture, to perform a write operation to a file on an HDD data is copied to memory, modified, and written back to the storage. If the same process is followed in the NVM architecture, the high speed of NVM cannot be fully utilized. For this reason, in the NVM architecture files are mapped by mmap to virtual memory, and written directly as data on the NVM. On the NVM architecture, because writing to the mmaped area immediately takes effect on the file, there is no need to use msync. However, in such a case the consistency of the data cannot be guaranteed at a time of failure. In order to guarantee the consistency, we implemented a mechanism to create a copy of the file to be written. Writing is performed on the copy, and the copy becomes the original through a proposed atomic synchronization operation. In order to perform atomic synchronization, we implemented a mechanism to record journals. This paper describes the design and implementation in detail, and finally provides a performance evaluation.",
keywords = "Fault tolerance, File system, High-speed nonvolatile memory, Operating system",
author = "Koki Haga and Kenichi Yamazaki",
year = "2018",
month = "3",
day = "1",
doi = "10.1109/SEATUC.2018.8788878",
language = "English",
series = "Proceedings - 12th SEATUC Symposium, SEATUC 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "Proceedings - 12th SEATUC Symposium, SEATUC 2018",

}

TY - GEN

T1 - Failure-atomic synchronization of memory mapped data in non-volatile memory based system

AU - Haga, Koki

AU - Yamazaki, Kenichi

PY - 2018/3/1

Y1 - 2018/3/1

N2 - Thanks to the advancements in the research and development of high-speed nonvolatile memory (NVM) in recent years, the possibility has emerged that all hard disks and DRAM could be replaced by NVM. In this paper, we consider a computer with an architecture in which hard disks and DRAM are all replaced by NVM. In a conventional architecture, to perform a write operation to a file on an HDD data is copied to memory, modified, and written back to the storage. If the same process is followed in the NVM architecture, the high speed of NVM cannot be fully utilized. For this reason, in the NVM architecture files are mapped by mmap to virtual memory, and written directly as data on the NVM. On the NVM architecture, because writing to the mmaped area immediately takes effect on the file, there is no need to use msync. However, in such a case the consistency of the data cannot be guaranteed at a time of failure. In order to guarantee the consistency, we implemented a mechanism to create a copy of the file to be written. Writing is performed on the copy, and the copy becomes the original through a proposed atomic synchronization operation. In order to perform atomic synchronization, we implemented a mechanism to record journals. This paper describes the design and implementation in detail, and finally provides a performance evaluation.

AB - Thanks to the advancements in the research and development of high-speed nonvolatile memory (NVM) in recent years, the possibility has emerged that all hard disks and DRAM could be replaced by NVM. In this paper, we consider a computer with an architecture in which hard disks and DRAM are all replaced by NVM. In a conventional architecture, to perform a write operation to a file on an HDD data is copied to memory, modified, and written back to the storage. If the same process is followed in the NVM architecture, the high speed of NVM cannot be fully utilized. For this reason, in the NVM architecture files are mapped by mmap to virtual memory, and written directly as data on the NVM. On the NVM architecture, because writing to the mmaped area immediately takes effect on the file, there is no need to use msync. However, in such a case the consistency of the data cannot be guaranteed at a time of failure. In order to guarantee the consistency, we implemented a mechanism to create a copy of the file to be written. Writing is performed on the copy, and the copy becomes the original through a proposed atomic synchronization operation. In order to perform atomic synchronization, we implemented a mechanism to record journals. This paper describes the design and implementation in detail, and finally provides a performance evaluation.

KW - Fault tolerance

KW - File system

KW - High-speed nonvolatile memory

KW - Operating system

UR - http://www.scopus.com/inward/record.url?scp=85071596481&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85071596481&partnerID=8YFLogxK

U2 - 10.1109/SEATUC.2018.8788878

DO - 10.1109/SEATUC.2018.8788878

M3 - Conference contribution

AN - SCOPUS:85071596481

T3 - Proceedings - 12th SEATUC Symposium, SEATUC 2018

BT - Proceedings - 12th SEATUC Symposium, SEATUC 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -