Real-Time Data Streaming with Kafka: Revolutionizing Supply Chain and Operational Analytics
Keywords:
real-time data streaming, Apache Kafka, event-driven architectureAbstract
Real-time data streaming has evolved as a transformative model in modern analytics particularly in supply chain management and operational intelligence. Apache Kafka Is a distributed event streaming platform which has become a crucial technology in enabling real time data ingestion, processing, and analytics at scale. This paper explores the architectural principle of Kafka which highlights its role in facilitating event-driven data pipelines that enhance decision-making in supply chain analytics and inventory optimization.
Downloads
References
J. Kreps, N. Narkhede, and J. Rao, “Kafka: A distributed messaging system for log
processing,” in Proceedings of the 6th ACM SIGMOD Workshop on Networking
Meets Databases (NetDB), Athens, Greece, 2011, pp. 1-7.
George, Jabin Geevarghese. "Advancing Enterprise Architecture for Post-Merger
Financial Systems Integration in Capital Markets laying the Foundation for Machine
Learning Application." Aus. J. ML Res. & App 3.2 (2023): 429.
Dash, S. "Architecting Intelligent Sales and Marketing Platforms: The Role of
Enterprise Data Integration and AI for Enhanced Customer Insights." Journal of
Artificial Intelligence Research 3.2 (2023): 253-291.
Singu, Santosh Kumar. "Migration strategies for legacy data warehousing systems to
cloud platforms." Internafional Journal of Science and Research (IJSR) 12, no. 12
(2023): 2164-2167.
George, Jabin Geevarghese. "HARNESSING GENERATIVE AI FOR ENTERPRISE
APPLICATION MODERNIZATION: ENHANCING CYBERSECURITY AND DRIVING
INNOVATION." INTERNATIONAL JOURNAL OF ADVANCED RESEARCH IN
ENGINEERING AND TECHNOLOGY (IJARET) 15.3 (2024): 377-392.
Dash, S. "Designing Modular Enterprise Software Architectures for AI-Driven Sales
Pipeline Optimization." Journal of Artificial Intelligence Research 3.2 (2023): 292-334.
Godbole, Aditi, Jabin Geevarghese George, and Smita Shandilya. "Leveraging Long-
Context Large Language Models for Multi-Document Understanding and
Summarization in Enterprise Applications." arXiv preprint arXiv:2409.18454 (2024).
Akhilandeswari, P., and Jabin G. George. "Secure Text Steganography." Proceedings
of International Conference on Internet Computing and Information Communications:
ICICIC Global 2012. Springer India, 2014.
Singu, Santosh Kumar. "Impact of Data Warehousing on Business Intelligence and
Analytics." ESP Journal of Engineering & Technology Advancements 2.2 (2022):
-113.
Santosh Kumar, Singu. "Maximizing financial intelligence-the role of optimized etl in
fintech data warehousing." INTERNATIONAL JOURNAL OF COMPUTER
ENGINEERING AND TECHNOLOGY (IJCET) 15, no. 4 (2024): 464-471.
H. Karau, R. Warren, and M. Zaharia, High Performance Spark: Best Practices for
Scaling and Optimizing Apache Spark. Sebastopol, CA, USA: O’Reilly Media, 2017.
T. White, Hadoop: The Definitive Guide: Storage and Analysis at Internet Scale.
Sebastopol, CA, USA: O’Reilly Media, 2015.
A. K. Pathak, A. Jain, and S. Agrawal, “Real-time predictive analytics for supply chain
management using Apache Kafka and Spark Streaming,” in Proceedings of the 2020
IEEE International Conference on Machine Learning and Data Science (ICMLDS),
Noida, India, 2020, pp. 1-6.
P. Mell and T. Grance, “The NIST definition of cloud computing,” National Institute of
Standards and Technology (NIST) Special Publication 800-145, 2011.
D. Loshin, Enterprise Knowledge Management: The Data Management Paradigm.
San Francisco, CA, USA: Morgan Kaufmann, 2001.
J. Lin and D. Ryaboy, “Scaling Big Data Mining Infrastructure: The Twitter
Experience,” ACM SIGKDD Explorations Newsletter, vol. 14, no. 2, pp. 6-19, 20
Y. Cao, X. Liu, and L. Fan, “Supply chain optimization with real-time event processing
using Kafka Streams,” in Proceedings of the 2021 IEEE International Conference on
Big Data (BigData), Orlando, FL, USA, 2021, pp. 1-8.
