Pengolahan Big Data Dengan Sharding Database Dan Kappa Architecture Untuk Data Time-Series

  • Kompiang Gede Sukadharma Universitas Udayana
  • I Putu Gede Hendra Suputra
  • Ida Ayu Gde Suwiprabayanti Putra
  • Luh Arida Ayu Rahning Putri

Abstract

In the digital era, managing and processing Big Data presents challenges. Historical or time-series data is crucial for decision-making. Distributed database systems, specifically database sharding, efficiently distribute CPU load and memory usage. Kappa Architecture outperforms Lambda Architecture by 220% in terms of speed, though Lambda has slightly higher reliability. This research integrates database sharding with Kappa Architecture using Kaggle’s time-series data. Load testing showed 60.46% performance for data retrieval across distributed databases. Remarkably, the system’s reliability reached 100%, even when one of the services failed, handling 10000 new data entries. Furthermore, with the same configuration, it was found that the utilization of Kappa Architecture and sharding database resulted in a 70.26% better performance compared to the system solely implementing sharding database.

Downloads

Download data is not yet available.
Published
2024-05-07
How to Cite
SUKADHARMA, Kompiang Gede et al. Pengolahan Big Data Dengan Sharding Database Dan Kappa Architecture Untuk Data Time-Series. JELIKU (Jurnal Elektronik Ilmu Komputer Udayana), [S.l.], v. 13, n. 1, p. 1023-1034, may 2024. ISSN 2654-5101. Available at: <https://ojs.unud.ac.id/index.php/jlk/article/view/114888>. Date accessed: 10 oct. 2024.

Most read articles by the same author(s)

1 2 3 > >>