Fuzzy inference systems have been successfully applied to many real-world applications. Traditional fuzzy inference systems are only applicable to problems with dense rule bases by which the entire input domain is fully covered, whilst fuzzy rule interpolation (FRI) is also able to work with sparse rule bases that may not cover certain observations. Thanks to their abilities to work with fewer rules, FRI approaches have also been utilised to reduce system complexity by removing those rules which can be approximated by their neighbouring ones for complex fuzzy models. A number of important fuzzy rule base generation approaches have been proposed in the literature, but the majority of these only target dense rule bases for traditional fuzzy inference systems. This paper proposes a novel sparse fuzzy rule base generation method to support FRI. The approach first identifies important rules that cannot be accurately approximated by their neighbouring ones to initialise the rule base. Then the raw rule base is optimised by fine tuning the membership functions of the fuzzy sets. Experimentation is conducted to demonstrate the working principles of the proposed system, with results comparable to those of traditional methods.