The rapid evolution of wireless communication has necessitated advanced waveform analysis for beyond-fifth-generation (B5G) and sixth-generation (6G) radio networks, focusing on efficient spectrum utilization. There is a need for greater spectrum allotment in data-intensive applications, and new technologies require faster data rates and reduced latency. This study explores hybrid spectrum sensing techniques, combining matched filter (MF) energy detection (ED) and an equal-gain combining-based energy detection Neyman-Pearson threshold estimation technique (EGC-ED-PTh) to enhance waveform detection accuracy in complex environments. The proposed method offers an enhanced signal-to-noise ratio (SNR) by optimizing the detection performance, particularly in low-SNR environments, thereby improving the signal reliability. The proposed algorithms are evaluated in comparison with traditional SS methods, including ED, MF, and cyclostationary feature detection (CFD). Additionally, characteristics including bit error rate (BER), power spectral density (PSD), probability of detection (pd), and probability of false alarm (pfa) were researched and evaluated for 500 and 1000 samples. The simulation findings show that the projected algorithms perform better than the traditional algorithms with minimum sidelobes of – 3024 and pfa effects and achieve a throughput gain of 5 and 4.7 dB compared with the conventional algorithms.