A fuzzy modeling method is proposed to build the dynamic model of a walking-beam reheating furnace from the recorded data. In the proposed method, the number of membership function on each variable is increased individually and the modeling accuracy is evaluated iteratively. When the modeling accuracy is satisfied, the membership functions on each variable are fixed and the structure of fuzzy model is determined. Because the training data is limited, in this process, as the number of membership function increase, it is highly possible that some rules are missing, i.e., no data in the training set corresponds to the consequent part of a missing rule. To complete the rulebase, the output of the model constructed at the previous step is used to generate the consequent part of the missing rules. Finally, in the real time application, a rolling update scheme to rulebase is introduced to compensate the change of system dynamics and fine tune the rulebase. The proposed method is verified by the application to the modeling of a reheating furnace.