Public areas, such as train stations and airports, providing wireless Local Area Network (WLAN) services are increasing and expanding because of the rapid development of WLANs based on IEEE 802.11 standard. Moreover, because of the advances in smartphone tethering technology, portable access points (APs) such as mobile Wi-Fi routers are being utilized more frequently. Consequently, there are increasing circumstances where a user needs to select and connect to one of the many APs. AP selection significantly determines the quality of service of the subsequent communication session. Existing AP selection algorithms consider user movement but not AP movement. We propose an AP selection method that handles both types of movement effectively. Moreover, we show that the proposed method improves the throughput significantly compared to the existing method.