PECULIARITIES OF APPLICATION OF OBJECT RECOGNATION SYSTEM IN REAL TIME ON MICROCONTROLLERS WITH SUBSEQUENT VOISE OUTPUT OF INFORMATION FOR PEOPLE WITH VISUAL IMPAIRMENTS

Authors

  • ROSTYSLAV DENISOV National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Kyiv, Ukraine
  • PAVLO POPOVYCH National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Kyiv, Ukraine

DOI:

https://doi.org/10.30857/2786-5371.2024.3.2

Keywords:

image recognition systems, microcontrollers, voice output of information, convolutional neural networks, TensorFlow, English, MobileNet

Abstract

Purpose. The study of the minimum and maximum time required to complete one full cycle of object name recognition-announcement taking into account different word lengths, different object recognition speeds, as well as physical characteristics of visually impaired people for real-time object recognition systems on microcontrollers with subsequent voice output.

Methodology. Creating variants of combinations of words of different lengths, taking into account the possibility of setting the speed of speech generation in Espeak, and the average speed of speech in Ukraine. Calculation of the minimum and maximum distance to the object at the start of the recognition-announcement cycle. The minimum and maximum time required for a full cycle of object name recognition-announcement is set.

Findings. On the basis of the Espeak language synthesizer and the peculiarities of the Ukrainian language and speech, the time required to announce the names of objects of different lengths was investigated. The minimum and maximum time for completing the full cycle of information recognition-announcement is set, taking into account the physical characteristics of people with visual impairments, their speed of movement and the speed of reaction to voice information. The minimum and maximum distance to the object at the start of the cycle was also obtained, depending on the time required to complete one complete cycle.

Originality. The minimum and maximum time needed to complete the full cycle of information recognition and announcement was obtained, taking into account the physical characteristics of visually impaired people, the technical capabilities of modern neural networks and programs for speech synthesis, as well as the minimum and maximum distance to the object at the time of the start of the cycle. The minimum and maximum distance to the object at the start of the recognition-announcement cycle was studied.

Practical value. The obtained results can be used in the practical creation of online object recognition systems, to assess the possibility of using certain neural networks, based on the obtained minimum and maximum time for passing the complete cycle of recognition-announcement of information, as well as the time required for passing each of its separate elements.

Downloads

Download data is not yet available.

Author Biographies

ROSTYSLAV DENISOV, National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Kyiv, Ukraine

https://orcid.org/0000-0003-1146-9114

PAVLO POPOVYCH, National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Kyiv, Ukraine

PhD, Associate Professor, Department of Acoustic and Multimedia Electronic Systems

http://orcid.org/0000-0002-1572-3127

Scopus Author ID: 55225965700

Researcher ID: J-6574-2017

Published

2024-07-29

How to Cite

ДЕНІСОВ, Р., & ПОПОВИЧ, П. (2024). PECULIARITIES OF APPLICATION OF OBJECT RECOGNATION SYSTEM IN REAL TIME ON MICROCONTROLLERS WITH SUBSEQUENT VOISE OUTPUT OF INFORMATION FOR PEOPLE WITH VISUAL IMPAIRMENTS. Technologies and Engineering, (3), 21–30. https://doi.org/10.30857/2786-5371.2024.3.2

Issue

Section

INFORMATION TECHNOLOGIES, ELECTRONICS, MECHANICAL AND ELECTRICAL ENGINEERING