Photolith morphotypes differ between plant species which can be utilized to reconstruct past vegetation. More recently, the role of phytoliths in soil carbon (C) storage and soil C and silicon (Si) cycling has received increasing attention. The aim of this study was to investigate the impact of recent land cover change on soil phytolith assemblage, soil phytolith concentration, and phytolith-occluded carbon (PhytOC) storage. Mineral soil samples (0–10 cm) were collected from a tussock grassland (n = 18) and an adjacent 32-year-old pine forest (n = 21) in Otago, New Zealand. The pine forest was established on tussock grassland. Microwave digestion was followed by sedimentation and flotation procedures to obtain a purified phytolith extract to identify soil phytolith morphotypes by microscopy and to quantify PhytOC concentrations using an elemental analyzer. Soil phytolith assemblage was similar under tussock grassland and pine forest. Bulliform and short cells which were derived from grass species accounted for more than 80% of the phytoliths. Woody plant-derived phytoliths found under tussock grassland (1) may originate from shrubs which are encroaching into the tussock grassland and/or (2) are a legacy of the past woody-dominated vegetation. Soil phytolith concentration ranged between 1 and 3%. Soil PhytOC storage was 0.15 kg C/m2 and 0.14 kg C/m2 under tussock grassland and pine forest, respectively, and accounted for around 3% of total soil carbon storage. Soil phytolith assemblage, soil phytolith concentration, and soil PhytOC storage did not differ significantly between the tussock grassland and the pine forest that was converted from tussock grassland recently. The dominance of grass-derived phytoliths under the pine forest may reflect the legacy of the tussock vegetation which dominated the study site before the afforestation with pine in 1992. This study also revealed that the intrinsic feature of tussock grass species and the accumulation of phytoliths over centuries is likely the cause for the high soil phytolith and PhytOC concentrations.