Making predictions according to historical values has long been regarded as common practice by many researchers. However, forecasting solely based on historical values could lead to inevitable over-complexity and uncertainty due to the uncertainties inside, and the random influence outside, of the data. Consequently, finding the inherent rules and patterns of a time series by eliminating disturbances without losing important details has long been a research hotspot. In this paper, we propose a novel forecasting model based on multi-valued neutrosophic sets to find fluctuation rules and patterns of a time series. The contributions of the proposed model are: (1) using a multi-valued neutrosophic set (MVNS) to describe the fluctuation patterns of a time series, the model could represent the fluctuation trend of up, equal, and down with degrees of truth, indeterminacy, and falsity which significantly preserve details of the historical values; (2) measuring the similarities of different fluctuation patterns by the Hamming distance could avoid the confusion caused by incomplete information from limited samples; and (3) introducing another related time series as a secondary factor to avoid warp and deviation in inferring inherent rules of historical values, which could lead to more comprehensive rules for further forecasting. To evaluate the performance of the model, we explored the Taiwan Stock Exchange Capitalization Weighted Stock Index (TAIEX) as the major factor we forecast, and the Dow Jones Index as the secondary factor to facilitate the predicting of the TAIEX. To show the universality of the model, we applied the proposed model to forecast the Shanghai Stock Exchange Composite Index (SHSECI) as well.