The SOPHYA-cohort-study investigated whether the objectively characterized and perceived residential neighborhood of Swiss youth predict accelerometer-measured physical activity and activity in specific domains (participation in a sports club and cycling) five years later.At baseline in 2014, 1230 children and adolescents aged 6 to 16 years participated and wore accelerometers for 7 days. Of these children, 447 participated again in the follow-up study in 2019 and provided longitudinal accelerometer measurements. Sociodemographic factors and perceptions of the local neighbourhood were assessed by questionnaire. Specific objective environmental data (e.g. built environment or social environment) was modelled to the children's address at baseline. Multivariate linear and logistic regression models were applied to identify short- and long-term characteristics that are associated with accelerometer-based physical activity, cycling and participation in organised sport.If the neighborhood-score as perceived by the parents in 2014 was in the middle or lowest tertile, children were significantly less active cross-sectionally in 2014 (-41.1 (-78.0;-4.2) and -52.4 (-88.6;-16.2) counts per minute, cpm), and five years later (-52.4 (-88.6;-16.2) and 48.1 (-86.6;-9.7) cpm). In addition, they were also less likely to accumulate active minutes above the median at both measuring points compared to peers of the same age and sex. Using objective environmental data modeled around the children's residential address, similar associations were found: In the tertile with the lowest proportion of green space children achieved less cpm in 2014, while a high main street density and a low socioeconomic environment, respectively, hindered physical activity tracking above the median longitudinally. Also for cycling and participation in a sport club, the associations with the perceived and objective environment were more pronounced in the longitudinal analyses.The results suggest that growing up in a physical activity friendly neighborhood increases the likelihood of remaining active during adolescence and early adulthood. Interventions should be implemented to ensure that children growing up in an unfavorable neighborhood do not fall behind at an early stage.