Link prediction is one of hot research topics in social network analysis. Link prediction problem is to find a small set of node pairs in the networks that are not directly connected, but will be very likely to be connected in the future. To improve the prediction accuracy, many works have attempted to consider the community information, if available, in the social network structure. One common strategy of the prior community-aware link prediction algorithms is that they devised a sort of unified link prediction formulation that simply includes a premium term to express whether a link is structurally in the same community or not. However, since the formulation of the premium term relies on the structural formation of communities only, it cannot take into account the fact that the communities in different social networks, though they form almost identical community structures, can make different levels of influence on the link prediction. To cope with this limitation, we propose an adaptive approach, in which we use two separate link predictions depending on inter or intra links in community, and then balance the links based on the degree of community influence on link prediction. In the meantime, we provide a set of experimental results to show how much the proposed approach is effective.