Face alignment is an important issue in many computer vision problems. The key problem is to find the nonlinear mapping from face image or feature to landmark locations. In this paper, we propose a novel cascaded approach with bidirectional Long Short Term Memory (LSTM) neural networks to approximate this nonlinear mapping. The cascaded structure is used to reduce the complexity of this problem and accelerate the algorithm by conducting the coarse-to-fine search. In each cascaded module, features of landmarks are delivered as inputs into the bidirectional LSTM network. The depth of the network guarantees the ability to learn highly complex mapping. The recurrent connections in LSTM explore the relationships of different landmarks and ensure that the shape of the face is maintained. On several challenging public databases, our approach achieves state-of-the-art performances.