
This paper presents an AI-assisted virtual keyboard controlled entirely through eye gaze and blink detection, offering a fully hands-free typing interface for users with motor impairments. The system integrates MediaPipe for eye landmark tracking, OpenCV for real-time gaze estimation, and a Tkinter-based graphical interface for virtual keyboard interaction. Users can type via sustained gaze (dwell selection) or blink-triggered actions, with an adaptive debounce mechanism to prevent accidental inputs. To enhance typing fluency, a dual-layer language model is implemented: a lightweight bigram model derived from the Brown corpus for offline prediction, and an optional transformer-based GPT-2 engine for contextual and semantically rich suggestions. Experimental evaluation with two participants demonstrated high blink classification accuracy (94.6%), stable gaze-to-cursor mapping (91.3%), and improved typing speed (up to 9.4 WPM) during AI-assisted sessions. Visual plots of cursor smoothing, blink timelines, and accuracy breakdowns validated system responsiveness and usability. The interface was rated intuitive and fatigue-free, with participants preferring blink overrides and GPT suggestions for longer phrases. The proposed model offers a cost-effective, real-time communication tool that bridges computer vision and AI for assistive technology, operating entirely on standard webcams without proprietary hardware.
Eye tracking, HCI, GPT, assistive technology, human computer interaction, virtual keyboard, predictive text, blink interaction, GPT-2
Eye tracking, HCI, GPT, assistive technology, human computer interaction, virtual keyboard, predictive text, blink interaction, GPT-2
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
