TÁVKÖZLÉSI ÉS MÉDIAINFORMATIKAI TANSZÉK
Budapesti Műszaki és Gazdaságtudományi Egyetem - Villamosmérnöki és Informatikai Kar

Témák listája

Computer Vision and Natural Language Processing in machine learning
Computer vision (CV) and Natural Language Processing (NLP) are two main subfields of machine learning, and a lot of research is going on there. These two subfields overlap together in tasks such as text generation out of image (image2text) or vice-versa (text2image). A main obstacle in the way of teaching models (supervised learning) which are able to perform such tasks is the lack of labeled data, and a way to overcome this is to follow unsupervised learning approach. The task of the student(s) is to get familiar with those tasks and try to reproduce available solutions in order to be able to improve them later. No. of students: 1 - 3 contact email: alshouha@edu.bme.hu
COMPUTER VISION AND NATURAL LANGUAGE PROCESSING IN MACHINE LEARNING
Computer vision (CV) and Natural Language Processing (NLP) are two main subfields of machine learning, and a lot of research is going on there. These two subfields overlap together in tasks such as text generation out of image (image2text) or vice-versa (text2image). A main challenge that is facing these models (and ML based models in general) is the explaination of the model's output, e.g.: why a certain object appears in a certain image captioning. The task of the student(s) is to get familiar with those tasks and try to reproduce available XAI (explainable AI) algorithms in order to utilize them later. Number of students: 1 - 2.
COMPUTER VISION AND NATURAL LANGUAGE PROCESSING IN MACHINE LEARNING
Computer vision (CV) and Natural Language Processing (NLP) are two main subfields of machine learning, and a lot of research is going on there. These two subfields overlap together in tasks such as text generation out of image (image2text) or vice-versa (text2image). A new subfield has emerged, i.e. Story Visualization, with the help of the advancement of GANs and Diffusion models. The task of the student(s) is to explore Story Visualization topic by investigating and utilizing the state-of-the-art models in the field. No. of students: 1 - 3 contact email: alshouha@edu.bme.hu
BlinkTalk: Turning Eye Blinks into Speech
This project aims to develop a simple assistive communication system that can convert eye-blink patterns into speech or text. The idea is especially useful for people who cannot speak or move easily but can still control their eye blinks. Students will explore how eye blinks can be detected using a webcam, simple computer vision methods, or lightweight machine learning models. The detected blink patterns can then be mapped to commands, letters, words, or short spoken messages.
RoboTalk: Human–Robot Interaction with Speech and Gestures
This project focuses on developing a simple human–robot interaction system that allows a humanoid robot or simulated robot to communicate with users through speech, gestures, and basic visual understanding. The goal is to make robot interaction more natural, friendly, and useful in real-life scenarios such as education, assistance, reception, or elderly care. Students will explore how text-to-speech, gesture detection, and simple AI-based dialogue systems can be combined to create a basic interactive robot interface. The project can be implemented using a simulated robot/avatar interface on a computer. The system may allow the user to speak to the robot, receive spoken answers, recognize simple gestures or commands, and react in a human-like way. This project combines human-computer interaction, speech technology, artificial intelligence, computer vision, and assistive robotics. The final outcome can be a small prototype or demo showing how a robot can understand simple human inputs and respond through speech, movement, or screen-based interaction. This project is suitable for students interested in AI, robotics, speech technology, human-computer interaction, accessibility, and smart interactive systems.