We construct a set of $2^n$ points in $\mathbb{R}^n$ such that all pairwise Manhattan distances are odd integers, which improves the recent linear lower bound of Golovanov, Kupavskii and Sagdeev. In contrast to the Euclidean and maximum metrics, this shows that the odd-distance set problem behaves very differently to the equilateral set problem under the Manhattan metric. Moreover, all coordinates of the points in our construction are integers or half-integers, and we show that our construction is optimal under this additional restriction.