Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Article . 2021
License: CC BY
Data sources: ZENODO
ZENODO
Article . 2021
License: CC BY
Data sources: Datacite
ZENODO
Article . 2021
License: CC BY
Data sources: Datacite
versions View all 2 versions
addClaim

Knowledge Graph-Driven Real-Time Data Engineering for Context-Aware Machine Learning Pipelines

Authors: Sai Kiran Reddy Malikireddy; Bipinkumarreddy Algubelli; Snigdha Tadanki;

Knowledge Graph-Driven Real-Time Data Engineering for Context-Aware Machine Learning Pipelines

Abstract

The novel context-aware machine learning is based on state-of-the-art real-time data engineering processes that operate in shifting entity correlations. To this end, this paper presents a new architecture that combines knowledge graph construction with real-time stream processing to underpin the machine learning flow in a context-aware manner. The proposed system uses graph neural networks (GNNs) for updates and embeddings in real-time for dynamic integration of contextual information into the other machine learning models. This makes the approach ideal as changes in the relations of entities can be captured almost in real time, and models remain valid. The effectiveness of the architecture can be illustrated by use cases related to customer profiling and equipment failure prognosis. In a consumer classification, one has to continually modify customer profiles as others come across the new interaction to work on effective targeting and the subsequent personalization improvement. Predictive maintenance stores changing information on equipment to predict future failure. These applications show a 40% improvement in model accuracy and take 50% less time than normal methods for feature engineering. This research bridges computer science, particularly graph theory, and real-world data engineering by demonstrating the value of knowledge graphs and GNNs within machine learning pipelines. By incorporating contextual features, the system provides a feasible and flexible solution for current data trends, allowing for further development of smarter and more sensitive ML systems. The study points out real-time context sensitiveness as central to the advancement of machine learning, a landmark discovery.

Keywords

Real-Time Data Engineering, Knowledge Graph, Context-Aware, Machine Learning Pipelines, Knowledge Representation

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Green