The correlation between radio spectral index and redshift has been exploited to discover high redshift radio galaxies, but its underlying cause is unclear. It is crucial to characterise the particle acceleration and loss mechanisms in high redshift radio galaxies to understand why their radio spectral indices are steeper than their local counterparts. Low frequency information on scales of $\sim$1 arcsec are necessary to determine the internal spectral index variation. In this paper we present the first spatially resolved studies at frequencies below 100 MHz of the $z = 2.4$ radio galaxy 4C 43.15 which was selected based on its ultra-steep spectral index ($α< -1$; $S_ν \sim ν^α$ ) between 365 MHz and 1.4 GHz. Using the International Low Frequency Array (LOFAR) Low Band Antenna we achieve sub-arcsecond imaging resolution at 55 MHz with VLBI techniques. Our study reveals low-frequency radio emission extended along the jet axis, which connects the two lobes. The integrated spectral index for frequencies $

14 pages; 9 figures; 4 tables; Accepted for publication in MNRAS