Skip to content

Eye tracking for analysing reception of machine translation and sign language (EyeSign)

 

Project no.: S-MIP-24-32

Project description:

Recent advancements in the field of natural language processing (NLP) make it clear that language-related AI will play a fundamental role in shaping the digital transformation of society. AI-enhanced machine translation has already offered invaluable solutions for media accessibility. This study addresses comprehension, subjective perception and emotional reception of human translated vs. machine-translated texts when reading texts or understanding texts in sign language. It is based on an eye-tracking data analysis involving typical readers and deaf and hard of hearing participants. The eye-tracking data will provide insights into the cognitive processes during language comprehension of both populations allowing us to analyze aspects such as text understanding, subjective perception and emotional reception of the texts. The proposed project will have a direct impact on advancing eye-tracking research in Lithuania. Additionally, the research into machine translation will bring insights regarding the use of machine translation and AI technologies for enhanced inclusiveness of the deaf and heard of hearing.

Project funding:

Projects funded by the Research Council of Lithuania (RCL), Projects carried out by researchers’ teams


Project results:

Based on the research results obtained during the project, an eye tracking dataset, 2 research papers, 3 conference papers and a scientific monograph are being prepared.

Period of project implementation: 2024-09-02 - 2027-06-30

Project coordinator: Kaunas University of Technology

Head:
Ramunė Kasperė

Duration:
2024 - 2027

Department:
Academic Centre of Social Sciences, Arts and Humanities, Faculty of Social Sciences, Arts and Humanities