the first release of the whisper-llm-eval framework accompanying the paper on embedding-based evaluation of LLM post-processing for medical transcription. This version provides the full evaluation pipeline, including semantic similarity analysis using multiple embedding models, robustness assessment across repeated generations, and visualization tools for benchmarking LLM performance.