Big data processing technology in a distributed information system

Authors

  • S. K. Serikbayeva L.N. Gumilyov Eurasian National University
  • J. A. Tussupov L.N. Gumilyov Eurasian National University
  • M. A. Sambetbayeva Institute of Information and Computational Technologies

DOI:

https://doi.org/10.51301/vest.su.2021.i2.35

Keywords:

Big data Technology, Information Technology, distributed information system, Hadoop, PostgreSQL, MapReduce.

Abstract

Digital technologies exist in almost all areas of human life. The volume of data recorded in global warehouses increases every second, which means that the conditions for storing information change at the same rate, and new opportunities must appear to increase its volume. The introduction of big data technology is a new step in scientific and technical development in various sectors of society. Despite the fact that big data technology is at the initial stage of development, it has achieved high results in the field of Information Technology. There are no universal methods for processing big data, but they allow you to use different methods to partially solve the problem. Successful use of Big Data Increases work efficiency several times. Currently, Big Data Processing is focused on the effectiveness of using new technologies. The article discusses methods and approaches to working with big data, emerging complex problems and the importance of using big data in a distributed Information System, Functional Requirements for a distributed information system that supports scientific and educational activities, and the big data architecture that supports scientific and educational activities of a distributed information system.

Published

2021-04-30

How to Cite

Серикбаева, С. ., Тусупов, Д. ., & Самбетбаева , М. . (2021). Big data processing technology in a distributed information system. Engineering Journal of Satbayev University, 143(2), 272–278. https://doi.org/10.51301/vest.su.2021.i2.35

Issue

Section

Technics and techology