Ultra dense small cell networks represent a key future\ud network solution that can help meet the exponentially rising traffic\ud requirements of modern wireless networks. Backhauling these small\ud cells is an emerging challenge to the extent that various cells\ud are likely to have different backhaul constraints. The user-centric\ud backhaul scheme has been proposed in the literature to jointly exploit\ud the diversity in users’ requirement and backhaul constraints. In\ud this work, we propose a novel scheme, termed the Memory-based\ud Hybrid Scheme, that additionally also exploits the predictability in\ud a users mobility. We compare the novel scheme to two variants\ud of memory-less user-centric backhaul implementations and show\ud significant gains in convergence time (15%), user-centric KPIs (51%\ud and 82%) at the negligible cost 2% loss in cumulative throughput.\ud The novel scheme requires additional memory in user-devices to\ud store learned values, which is nonetheless well justified in view of\ud the considerable gains achieved.