Fast and accurate midline shift (MLS) estimation has a significant impact on diagnosis and treatment of patients with Traumatic Brain Injury (TBI). In this paper, we propose an automated method to calculate the amount of shift in the midline structure of TBI patients. The MLS values were annotated by a neuroradiologist. We first select a number of slices among all the slices in a CT scan based on metadata as well as information extracted from the images. After the slice selection, we propose an efficient segmentation technique to detect the ventricles. We use the ventricular geometric patterns to calculate the actual midline and also anatomical information to detect the ideal midline. The distance between these two lines is used as an estimate of MLS. The proposed methods are applied on a TBI dataset where they show a significant improvement of the the proposed method upon existing approach.