In the present work, we define harmonic complex balancing numbers by considering well-known balancing numbers and inspiring harmonic numbers. Mainly, we investigate some of their basic characteristic properties such as the Binet formula and Cassini identity, etc. In addition, one type of symmetric matrix family whose entries are harmonic complex balancing numbers is constructed. Additionally, some linear algebraic properties are obtained. Furthermore, some inequalities are stated by exploiting the well-known inequalities between various matrix norms. Finally, we illustrate the results with some numerical examples.