The factors affecting the self-assembly process in low molecular weight gelators (LMWGs) were investigated by tuning the gelation properties of a well-known gelator N-(4-pyridyl)isonicotinamide (4PINA). The N―H∙∙∙N interactions responsible for gel formation in 4PINA were disrupted by altering the functional groups of 4PINA, which was achieved by modifying pyridyl moieties of the gelator to pyridyl N-oxides. We synthesized two mono-N-oxides (INO and PNO) and a di-N-oxide (diNO) and the gelation studies revealed selective gelation of diNO in water, but the two mono-N-oxides formed crystals. The mechanical strength and thermal stabilities of the gelators were evaluated by rheology and transition temperature (Tgel) experiments, respectively, and the analysis of the gel strength indicated that diNO formed weak gels compared to 4PINA. The SEM image of diNO xerogels showed fibrous microcrystalline networks compared to the efficient fibrous morphology in 4PINA. Single-crystal X-ray analysis of diNO gelator revealed that a hydrogen-bonded dimer interacts with adjacent dimers via C―H∙∙∙O interactions. The non-gelator with similar dimers interacted via C―H∙∙∙N interaction, which indicates the importance of specific non-bonding interactions in the formation of the gel network. The solvated forms of mono-N-oxides support the fact that these compounds prefer crystalline state rather than gelation due to the increased hydrophilic interactions. The reduced gelation ability (minimum gel concentration (MGC)) and thermal strength of diNO may be attributed to the weak intermolecular C―H∙∙∙O interaction compared to the strong and unidirectional N―H∙∙∙N interactions in 4PINA.