Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Preprint
Data sources: ZENODO
addClaim

SemaGC: Semantic Garbage Collection for Efficient Context Management in Multi-Agent LLM Pipelines

Authors: Nadipalli, Jaya Sandeep Narasimha Chowdhary;

SemaGC: Semantic Garbage Collection for Efficient Context Management in Multi-Agent LLM Pipelines

Abstract

Multi-agent large language model (LLM) pipelines accumulate intermediate messages in a shared context window, leading to state bloat, increased inference costs, and degraded task fidelity due to the Lost-in-the-Middle effect. We present SemaGC (Semantic Garbage Collector), a runtime context management system for multi-agent LLM orchestration frameworks. SemaGC operates as a custom state reducer within LangGraph pipelines, transparently intercepting context updates to prune semantically drifted messages and compress relevant intermediate outputs into dense Micro-Rationales. Evaluated across five complex software engineering tasks on a 6-node pipeline, SemaGC achieves a consistent 42.9% reduction in context state size with an average GC overhead of only 1.91 seconds per pipeline execution. Our results demonstrate that cosine similarity between intermediate agent messages and the original task goal is an effective and lightweight signal for context garbage collection in multi-agent LLM systems.

Powered by OpenAIRE graph
Found an issue? Give us feedback