Decisions made at early stages of the design are of the utmost importance for the energy-efficiency of buildings. Wrong decisions and design failures related to a building’s general layout, shape, façade transparency or orientation can increase the operational energy tremendously. These failures can be avoided in advance through simple changes in the design. Using extensive parametric energy simulations by DesignBuilder, this paper investigates the impact of geometric factors for the energy-efficiency of high-rise office buildings in three climates contexts: Amsterdam (Temperate), Sydney (Sub-tropical) and Singapore (Tropical). The investigation is carried out on 12 plan shapes, 7 plan depths, 4 building orientations and discrete values for window-to-wall ratio. Among selected options, each sub-section determines the most efficient solution for different design measures and climates. The optimal design solution is the one that minimizes, on an annual basis, the sum of the energy use for heating, cooling, electric lighting and fans. The results indicate that, the general building design is an important issue to consider for high-rise buildings: they can influence the energy use up to 32%. For most of the geometric factors, the greatest difference between the optimal and the worst solution occurs in the sub-tropical climate, while the tropical climate is the one that shows the smallest difference. In case of the plan depth, special attention should be paid in a temperate climate, as the total energy use can increase more than other climates. Regarding energy performance, the following building geometry factors have the highest to lowest influence: building orientation, plan shape, plan depth, and window-to-wall ratio.