In this paper, we suggest a mechanism for implementing a distributed application using RMI based on JAVA threads. The application is parallel matrices multiplication depending on distributed the products of rows and columns on different machines. One server and three clients are run to find the product of matrix multiplication. The server distributes the determine blocks of rows and columns on the registered clients. The clients return their product blocks to a server, which calculate the final product of matrix multiplication. Applications of this type will allow loaded servers to transfer part of the load to clients to exploit the computing power available at client side. The time of matrix multiplication with size of 256 times 256 is reduced by 52.5 % by using 3-client and this time can be decreased more in the case of increasing the number of clients.