Personalized recommendation for online learning courses stands as a critical research topic in educational technology, where algorithmic performance directly impacts learning efficiency and user experience. To address the limitations of existing studies in multimodal heterogeneous data fusion and high-order relationship modeling, this research proposes a Heterogeneous Hypergraph and Attention-based Online Course Recommendation (HHAOCR) algorithm. By constructing a heterogeneous hypergraph structure encompassing three entity types (students, instructors, and courses), we innovatively designed hypergraph convolution operators to achieve bidirectional vertex-hyperedge information aggregation, integrated with a dynamic attention mechanism to quantify important differences among entities. The method establishes computational frameworks for hyperedge-vertex coefficient matrices and inter-hyperedge attention scores, effectively capturing high-order nonlinear correlations within multimodal heterogeneous data, while employing temporal attention units to track the evolution of user preferences. Experimental results on the MOOCCube dataset demonstrate that the proposed algorithm achieves significant improvements in NDCG@15 and F1-Score@15 metrics compared to TP-GNN (enhanced by 0.0699 and 0.0907) and IRS-GCNet (enhanced by 0.0808 and 0.0999). This work provides a scalable solution for multisource heterogeneous data fusion and precise recommendation for online education platforms.