This dataset encompasses responses from first-year undergraduate students enrolled in an ICT program at Fluminense Federal University. The survey was completed by 61 students via an online platform between June 28th and July 4th, 2023. The findings were subsequently published in an article titled "Ethics and AI in Higher Education: A Study on Students' Perceptions" presented at the ICITS'24 conference. Article abstract:This initial study investigates the complex ethical concerns surrounding the integration of artificial intelligence (AI) in education, with a particular focus on undergraduate students' perceptions of AI tools in their academic efforts. A notable issue is the educational application of these tools, coupled with a pressing need for comprehensive public policies that ensure ethics and privacy are protected. Through qualitative research involving 61 students in an Information and Communication Technology (ICT) course, we explored the teaching of ethics related to the use of AI tools in an academic context. Our findings reveal a tendency among students to favor commercial AI tools that are not tailored for educational use, pointing to a potential shortfall in the educational AI domain. This study underscores the importance of promoting critical thinking and the responsible use of AI tools in academic settings. However, it is crucial to conduct further research with university students and instructors to refine and improve educational frameworks utilizing AI tools.