INTERNATIONAL JOURNAL OF LATEST TECHNOLOGY IN ENGINEERING,

MANAGEMENT & APPLIED SCIENCE (IJLTEMAS)

ISSN 2278-2540 | DOI: 10.51583/IJLTEMAS | Volume XIII, Issue XI, November 2024

www.ijltemas.in Page 79

Artificial Intelligence (AI)-Powered Line Follower Robot with

Hurdle Detection and Voice Control

Rana Qamar Hayat

, Fida Hussain

, Umer Masood

Research Scholar, Faculty of Computing, University of Okara, Pakistan

Research Scholar, Faculty of Computing, University of Education Lahore, Pakistan

ranaqamarhayat@gmail.com

DOI: https://doi.org/10.51583/IJLTEMAS.2024.131109

Received: 27 November 2024; Accepted: 02 December 2024; Published: 05 December 2024

Abstract: In this paper, we propose a voice-controlled line following robot with the ability to trace the set path and avoid hurdles

while moving autonomously. Line-following robots have been around for decades, but this setup uses AI algorithms and Fresnel

lenses to improve accuracy. More Traditional line-following robots often face drawbacks in dealing with intricate environments,

but those are addressed here via user control over voice recognition, as well as obstacle detection through ultrasonic sensors. The

robot is controlled over an Arduino UNO microcontroller, and the advanced features that it offers allow the robot to operate

independently with fewer human interactions. The applications of such a robot will span across Transportation & logistics,

Industrial Automation, and Personal Assistance. This study reveals the potential of this robot to improve precision and flexibility

in a realistic usage condition, thereby providing an important tool for automation with safety and productivity.

Keywords: Artificial Intelligence, Line follower, Autonomous Robot, Hurdle Detection, Obstacle Avoidance, Ultrasonic Sensor,

Voice Control

I. Introduction

The rapid development of artificial intelligence (AI) has transformed nearly every sector, including robotics. In this study, a new

robotic system is designed for the purpose of improving the efficiency and safety of transportation and logistics tasks [1].

Focusing on significantly reducing the presence of humans, this robot integrates several advanced line following features,

obstacle avoiding capabilities, and vocal controls to optimize performance.

Generally, robots that follow lines are mostly used for straightforward and simple tasks, and do not perform well in more

demanding settings that have many obstacles [2]. To overcome this limitation, a forward-looking robot has integrated artificial

intelligence technology, which helps it follow an assigned route while avoiding possible collisions [3]. By doing so in an

intelligent manner, the robot feels no barriers and continues operating without damage or throwing behaviors.

In addition to control, voice control systems are quite sophisticated and easy to use. It is because, instead of buttons, this robot

can respond to user commands and be directed inside the operational space for various tasks [4]. Such a feature also enhances its

usability in the healthcare industry, which is replete with verbal instructions.

Purpose of the Project

For the purpose of creating an intelligent robotic system that can distinguish caution zones within industrial spaces and move

along pre-determined paths while avoiding obstacles and obeying voice commands [5], [6]. This system intends to provide

improvements in the efficiency, security, and flexibility of material handling activities in factories.

Applications of the Project

• Hospitality: The effectiveness and security are furthermore improved in the hospitality industry by means of robots, since they

can deliver food and drink to guests, cut down medical staff interactions, and do room service [7].

• Industrial: It may also bridge gaps in factory processes by moving parts from one workstation to another, delivering documents

and mail within the US and other places, or helping with mining [8].

• Personal: Also, the robot may act as a personal aid, by bringing items of interest from the given place, and it may also provide

entertainment in the form of games [9].

Theoretical Bases and Organization

The design of this autonomous robot makes it capable of moving along any set path, avoiding any obstructions, and following

voice commands, allowing it to be useful in a variety of fields [10]. This system does not depend on Bluetooth or Wi-Fi

controlled robots and can work over long ranges without any operator. The effective working of the robot can be carried out by

using several advanced tools such as sensors, AI algorithms, and voice recognition.

INTERNATIONAL JOURNAL OF LATEST TECHNOLOGY IN ENGINEERING,

MANAGEMENT & APPLIED SCIENCE (IJLTEMAS)

ISSN 2278-2540 | DOI: 10.51583/IJLTEMAS | Volume XIII, Issue XI, November 2024

www.ijltemas.in Page 80

II. Literature Review

Most of the research applied in existing literature for line-following robots has been on basic features such as path following and

reacting to hurdles [11]. Though they serve as a basis in the quest for theoretical studies, they have at some point operated in

manual modes or with basic artificial intelligence [12]. With the improvement of the level of artificial intelligence and more

advanced sensor technologies, a more complex robot has been developed that can perform specific assignments and interact with

its surroundings more intelligently.

Line Following Robots: In the scope of line following applications, prior research has been done with optical sensors, magnetic

markers, and infrared line following. The works of S. Mamadapur et al. showed that microcontrollers can be utilized in line-

following robots for navigation and obstacle avoidance [13]. There has also been work done by A. Rajee and M. R. I. Marof that

examined the use of sensors and controllers in proportionally accurate tracking of lines. [12]

Obstacle Detection – An obstacle detection feature has always been present in line-tracking robots. However, newer works

address the concern of the improvement of obstacle avoidance systems and strategies [14]. Work has been done incorporating

ultrasonic sensors, infrared sensors, and computer vision methods to help the robot avoid running into obstacles.

Voice Control – The use of voice control technology in robots is an enormous enhancement in the way they can be employed as

a man-machine interface [10]. Although few lines of research have been done on voice-controlled line-following robots,

significant development in natural language processing and speech recognition makes these changes possible.

AI-Powered Line Followers – The trend of combining the abilities of line following, obstacle detection, in addition to voice

control capabilities and Artificial Intelligence, is expected to develop many smart and multi-functional robots [15], [16]. AI

allows robots to operate in a completely new way, i.e., self-learning robots, where they learn from their mistakes and take action

based on the situation in their environment. This research is aimed at making AI line following robots able to achieve

autonomously and efficiently more complex tasks than present.

Their Limitations and Bottlenecks

The existing research regarding line followers, obstacle avoidance, and voice control robots is lacking in certain areas:

• Line Following Robot: Lack of human guidance to maintain a path makes it rugged and insecure. Also, robots tend to stray

and go off the path when a strip of color is to be followed [17]. Limited ability to counter the environmental restrictions.

• Obstacle avoidance was difficult owing to the limitations of the sensors and the complexity of the environment [18]. Such a

system rarely has a better detection limit than 90%, regardless.

• Such errors were attributed to a litany of reasons, including noise, different accents, and speech that resulted in

misunderstanding of voice commands [19].

Hardware and Software Components

The important hardware components used in the design of the Artificial Intelligence (AI)-Powered Line Follower Robot with

Hurdle Detection and Voice Control are described in this paper. This includes the Arduino UNO microcontroller, L298 motor

driver module, ultrasonic sensor, IR sensor, servo motor, BO motors, a 4WD chassis kit, a battery, an IR receiver module, and an

HC-05 BT module. The paper also provides information on the software applications, such as Arduino IDE used for

programming and MIT App Inventor used for Simulation, Development, and Mobile Application Creation [20], [21].

III. Methodologies

The method of carrying out the research includes the creation and implementation of an intelligent line following robot, which is

self-navigating, obstacle-avoiding, and controllable through voice. The robot follows the specific instructions by mapping the

specific route while constantly detecting and avoiding the barriers present. The robot is partially under control through voice

commands as well.

Hardware and Software:

• Hardware: It is programmed that the robot will also come with an Arduino UNO microcontroller, line sensors, ultrasonic

sensors, microphones, motors, and a power supply.

• Software: As for the microcontroller programming, the programming software will be the Arduino IDE, and in the mobile

platform, MIT App Inventor will be used for developing an application which will be used during manual and autonomous

control of the robot [20], [21].

Control Systems:

• Line Following: Sensors on the robot are to be used so that it can stick to a predetermined path as it implements control

algorithms such as PID control to facilitate precision tracing [12], [15].

• Obstacle Detection: The robot will be tactical in its movement by virtue of using ultrasonic sensors to identify any such

obstacles and take measures to circumvent them [15].

INTERNATIONAL JOURNAL OF LATEST TECHNOLOGY IN ENGINEERING,

MANAGEMENT & APPLIED SCIENCE (IJLTEMAS)

ISSN 2278-2540 | DOI: 10.51583/IJLTEMAS | Volume XIII, Issue XI, November 2024

www.ijltemas.in Page 81

• Voice Control: The system will be designed to enable the acquisition and processing of voice commands through the

integration of a speech recognition module, thus enabling manual control and task reconfiguration [4].

• Autonomous Operation: The robot will move and execute all the maneuvers oriented at maintaining the defined trajectory

and evading obstacles until disposed of, turned off, or located in a situation that cannot be crossed. In such cases, the robot

will then only go back where it came from or backtrack to where it originated in search of a new path [10].

AI Integration:

• Machine learning: AI will also be incorporated into the robot so that it can learn and adjust from its past experiences and

perform better over time.

• Decision-making: In relation to the management of autonomous robots, the Artificial Intelligence system will be in charge of

various tasks such as managing the sensors, receiving voice commands and images, and making the relevant decisions in real

time [1].

Testing and Evaluation:

• Simulated environments: The robot will undergo evaluations carried out in simulated environments to determine its

functionality in various circumstances.

• Real-world scenarios: The robot will also be taken through real-time efficiency tests to determine how well it can perform in

a complex environment.

In line with this approach, we create an autonomous line-following robot that is fully equipped with the capabilities to walk

through an area, avoid barriers, and follow verbal messages, which can be useful in many industries.

Figure 3.1.1 Schematic Diagram

Figure 3.1.2 Flowchart for Line Follower

INTERNATIONAL JOURNAL OF LATEST TECHNOLOGY IN ENGINEERING,

MANAGEMENT & APPLIED SCIENCE (IJLTEMAS)

ISSN 2278-2540 | DOI: 10.51583/IJLTEMAS | Volume XIII, Issue XI, November 2024

www.ijltemas.in Page 82

Figure 3.1.3 Flowchart for Obstacle Avoidance

The working of the L298 motor driver is shown in the table given below.

Table 3.2.1 Working of L298 Motor Driver

IN 1

IN 2

IN 3

IN 4

Direction

Stop

Forward

Reverse

Left

Right

IV. Results and Conclusion

The developed robotic system has improved characteristics as compared to such basic constructions as a line-following robot. It

can move along specified trajectories, fully control its movement to avoid obstacles, and even understands spoken utterances.

Thanks to the integration of AI systems, the robot is not limited to preset tasks but is capable of recognizing changes in the

environment and making decisions accordingly, which surpasses the previous systems.

This study supports the use of AI technologies in line following robots and illustrates some possible application areas of such

robots. The robot's navigational autonomy, obstacle avoidance features, and responsiveness to verbal commands are essential to

perform works that necessitate accuracy, speed, and versatility.

Even though this research lays out basic principles, additional effort and development are recommended. Upcoming studies could

aim at extending the application of the robot in real-world situations, improving the robot's tolerance to various light conditions,

as well as finding other uses of this concept.

We invite readers to consider our results in further research on AI-powered line-following robots.

V. Summary

In this study, a multi-functional line following robot with the abilities of self-navigation, obstacle avoidance, and voice control is

described. The robot is constructed according to a given design and programmed in the Arduino IDE and MIT App Inventor.

However, there might be limitations to the project; a step towards the growth of AI robots is undertaken. The ability of the robot

to not only follow lines but also detect obstacles and respond to voice commands proves that the robot has practical applications.

VI. Future Work

In accordance with the conclusions of this study, as well as the existing body of literature, there are still several gaps that need to

be addressed. The next stage will be to realize the robot’s learning potential, applying deep and reinforcement learning [1], adding

cameras to improve the perception and object recognition [11], implementing dynamic obstacle and complex terrain avoidance

algorithms [14], embedding context and NLP for the voice interaction [4], developing the IoT capabilities of the robot [3] and

studying the coopetition us and using the robot in domestic and industrial work [7], [5].

In further detail, one of the suggested future improvements for the robot is a camera whereby the robot would not only be able to

map out its surroundings easily but also recognize and locate certain objects, make use of extra details such as augmented reality

and texts or pictures, recognize faces in an effort to improve the interaction between the users and the robot and allow users to see

how the robot functions [11], [9].

For these reasons, further studies can extend the available functionality of AI line-following robots, which are equipped with

hurdle detection and voice control features.

INTERNATIONAL JOURNAL OF LATEST TECHNOLOGY IN ENGINEERING, 
MANAGEMENT & APPLIED SCIENCE (IJLTEMAS) 
ISSN 2278-2540 | DOI: 10.51583/IJLTEMAS | Volume XIII, Issue XI, November 2024 
www.ijltemas.in                                                                                                                                                  Page 83 
References 
1.  M. Soori, B. Arezoo, and R. Dastres, "Artificial intelligence, machine learning and deep learning in advanced robotics, a 
review," Cognitive Robotics, vol. 3, pp. 54–70, 2023. https://doi.org/10.1016/j.cogr.2023.04.001 
2.  F. Rubio, F. Valero, and C. Llopis-Albert, “A review of mobile robots: Concepts, methods, theoretical framework, and 
applications,” Int. J. Adv. Robot. Syst., vol. 16, no. 2, 2019. https://doi.org/10.1177/1729881419839596 
3.  H.  Kabir,  M.-L.  Tham,  and  Y.  C.  Chang,  "Internet  of  robotic  things  for  mobile  robots:  Concepts,  technologies, 
challenges, applications, and future directions," Digital Communications and Networks, vol. 9, no. 6, pp. 1265–1290, 
2023. https://doi.org/10.1016/j.dcan.2023.05.006 
4.  L.  M.  John,  N.  Vishwakarma,  and  R.  Sharma,  “Voice  Control  Human  Assistance  Robot,”  International  Journal  of 
Engineering  Research  &  Technology  (IJERT),  vol.  9,  no.  3,  NTASU  –  2020,  pp.  1–4,  2021. 
DOI: 10.17577/IJERTCONV9IS03084 
5.  M.  Dhanda,  B.  A.  Rogers,  S.  Hall,  E.  Dekoninck,  and  V.  Dhokia,  “Reviewing  human-robot  collaboration  in 
manufacturing:  Opportunities  and  challenges  in  the  context  of  industry  5.0,”  Robotics  and  Computer-Integrated 
Manufacturing, vol. 93, 2025, Art. no. 102937. https://doi.org/10.1016/j.rcim.2024.102937 
6.  F. Rubio, F. Valero, and C. Llopis-Albert, “A review of mobile robots: Concepts, methods, theoretical framework, and 
applications,”  International  Journal  of  Advanced  Robotic  Systems,  vol.  16,  2019. 
https://doi.org/10.1177/1729881419839596 
7.  Z. Baran et al., “Robotization and smart technologies in the hospitality industry,” Handbook of Research on Innovation, 
Differentiation, and New Technologies in Tourism, Hotels, and Food Service, G. P. Fernandes and A. S. Melo, Eds. 
Hershey, PA, USA: IGI Global Scientific Publishing, 2023, pp. 1–31. https://doi.org/10.4018/978-1-6684-6985-9.ch001 
8.  M. Misaros, O.-P. Stan, I.-C. Donca, and L.-C. Miclea, “Autonomous robots for services—State of the art, challenges, 
and research areas,” Sensors, vol. 23, no. 10, p. 4962, May 2023. https://doi.org/10.3390/s23104962 
9.  J. T. Licardo, M. Domjan, and T. Orehovački, “Intelligent robotics—A systematic review of emerging technologies and 
trends,” Electronics, vol. 13, no. 3, p. 542, Feb. 2024. https://doi.org/10.3390/electronics13030542 
10.  M.  Getkar,  S.  Lokhande,  A.  Bais,  S.  Chaudhari,  and  S.  Bhutekar,  “Arduino  Obstacle  Avoiding+  Voice  Control+ 
Bluetooth  Control  Robot,”  International Journal  of  Advanced Research  in  Science, Communication and  Technology 
(IJARSCT), vol. 3, no. 2, pp. 528–533, 2023. https://doi.org/10.48175/ijarsct-13887 
11.  W. J. H. Brigido and J. M. P. de Oliveira, “The line follower robot: a meta-analytic approach,” PeerJ Computer Science, 
vol. 11, Art. no e2744, Mar. 2025. https://doi.org/10.7717/peerj-cs.2744 
12.  A. Rajee and M. R. I. Marof, Project Report on Line Follower Robot: A System Design Using Microcontroller, 2024. 
https://doi.org/10.13140/RG.2.2.31415.33448 
13.  S. Mamadapur,  D.  R.  L.  Reddy,  A.  K.  V.,  J.  G.  P.,  and K.  H.,  “Line  Following  Robot  with  Object  Avoidance  using 
Arduino,” in Proc. Int. Conf. Emerging Innovations in Engineering (ICEI), Int. J. Eng. Res. Technol. (IJERT), vol.. 10, 
no. 11, 2022. https://doi.org/10.17577/IJERTCONV10IS11009 
14.  K. Katona, H. A. Neamah, and P. Korondi, “Obstacle avoidance and path planning methods for autonomous navigation 
of a mobile robot,” Sensors, vol. 24, no. 11, p. 3573, 2024. https://doi.org/10.3390/s24113573 
15.  K.  Rishabh,  Design  of  Autonomous  Line  Follower  Robot  with  Obstacle  Avoidance,  2021. 
https://doi.org/10.13140/RG.2.2.11652.86403 
16.  W.  J.  H.  Brigido  and  J.  M.  P.  de  Oliveira,  “The  line  follower  robot:  A  meta-analytic  approach,”  PeerJ  Computer 
Science, vol. 11, Art. no e2744, Mar. 2025. https://doi.org/10.7717/peerj-cs.2744 
17.  A. Roy and M. M. Noel, “Design of a high-speed line following robot that smoothly follows tight curves,” Computers & 
Electrical Engineering, vol. 56, pp. 732–747, 2016. https://doi.org/10.1016/j.compeleceng.2015.06.014 
18.  A.  Mahant,  D.  Kashyap,  and  K.  Boora,  "Autonomous  Line  Follower  Robot  with  Obstacle  Avoidance  Design,"  in 
Proceedings  of the  2024  2nd  International  Conference  on  Self  Sustainable  Artificial Intelligence  Systems  (ICSSAS), 
Erode, India, 2024, pp. 1679–1684, https://doi.org/10.1109/ICSSAS64001.2024.10760682 
19.  P.  Panek and  P.  Mayer,  “Challenges  in  adopting  speech  control  for  assistive  robots,”  in  Ambient Assisted Living, R. 
Wichert and H. Klausing, Eds. Cham, Switzerland: Springer, 2015, pp. 3–14. https://doi.org/10.1007/978-3-319-11866-
6_1 
20.  Arduino, “Arduino IDE,” Arduino.cc. https://www.arduino.cc/en/software [Accessed: July. 18, 2021]. 
21.  MIT App Inventor, “MIT App Inventor,” Massachusetts Institute of Technology. https://appinventor.mit.edu/ [Accessed: 
Aug. 09, 2021]. 