Edge-based intelligent data analytics supports the Industrial Internet of Things (IIoT) to enable efficient manufacturing. Incremental learning in the edge-based data analytics has the potential to analyze continuously collected real-time data. However, additional efforts are needed to address performance, latency, resource utilization and storage of historical data challenges. This paper introduces an incremental learning approach based on Long-Short Term Memory (LSTM) autoencoders, by sparsening the weight matrix and taking samples from previously trained sub-datasets. The aim is to minimize the resources utilized while training redundant knowledge for edge devices of IIoT. The degree of sparsity can be determined by the redundancy of patterns, and the inverse of the coefficient of variation has been utilized to recognize it. A higher value of the inverse of the coefficient of variation shows that the values of the weight matrix are close to each other, which indicates the redundancy of knowledge, and vice versa. In addition, the coefficient of variation has been applied for limiting the size of samples from the previously trained sub-datasets. The experiment conducted using the IIoT testbed dataset demonstrates substantial enhancements in resource optimization without compromising performance.