Enhancing Non-Player Characters (NPC) Behaviour in Video Games Using Reinforcement Learning
Keywords:
NPC, Video Game, RL Algorithms, Game EnvironmentAbstract
NPCs enrich the immersive experience of a video game, and traditionally exist along purely rule- or script-based paradigms, denying adaptability or intelligent decision-making very often. The research integrates RL into the NPC behaviour to allow for the more realistic, dynamic interactions and responsive behaviour that today's gaming environments require. We will review state-of-the-art RL algorithms and validate improvements implemented in our own RL model within a sandbox game environment into NPC decision-making and player engagement. According to our results, RL makes NPCs adaptive, tactically deep, and realistic while the classical ones fail. The study provides rigorous methodology and analysis to demonstrate the feasibility and advantages of using RL for the design of a new generation of games.
References
“Artificial intelligence in video games - Wikipedia.” Accessed: Jun. 05, 2025. [Online]. Available: https://en.wikipedia.org/wiki/Artificial_intelligence_in_video_games
“Video Games and AI in 2023 | Filament Games.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.filamentgames.com/blog/video-games-and-ai-in-2023/
OpenAI et al., “Dota 2 with Large Scale Deep Reinforcement Learning,” Dec. 2019, Accessed: Jun. 05, 2025. [Online]. Available: https://arxiv.org/pdf/1912.06680
“How AI is Revolutionizing NPC Behavior in Modern Games | by Konna Giann | Apr, 2025 | GoPenAI.” Accessed: Jun. 05, 2025. [Online]. Available: https://blog.gopenai.com/how-ai-is-revolutionizing-npc-behavior-in-modern-games-814568b423f5
“ML and AI in Game Development in 2025 - Analytics Vidhya.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.analyticsvidhya.com/blog/2023/03/ml-and-ai-in-game-development/
“What is AI in Gaming Industry (40+ AI Powered Games in 2025) | Engati.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.engati.com/blog/ai-for-gaming
R. P. Mexas, F. R. Leta, and E. W. G. Clua, “Comparison of Reinforcement and Imitation Learning algorithms in autonomous sailboat Digital Twins,” IEEE Lat. Am. Trans., vol. 20, no. 9, pp. 2153–2161, Sep. 2022, doi: 10.1109/TLA.2022.9878171.
R. S. Sutton and A. G. Barto, “Reinforcement learning : an introduction,” p. 526.
“Best AI games 2024: Released and upcoming games with AI.” Accessed: Jun. 05, 2025. [Online]. Available: https://inworld.ai/blog/best-ai-games-2023
L. M. Howells, “Howells LM 2023 Public”, [Online]. Available: https://espace.curtin.edu.au/bitstream/handle/20.500.11937/92828/Howells LM 2023 Public.pdf?sequence=1.
“Q-learning - Wikipedia.” Accessed: Jun. 05, 2025. [Online]. Available: https://en.wikipedia.org/wiki/Q-learning
H. H. Tseng, Y. Luo, S. Cui, J. T. Chien, R. K. Ten Haken, and I. El Naqa, “Deep reinforcement learning for automated radiation adaptation in lung cancer,” Med. Phys., vol. 44, no. 12, pp. 6690–6705, Dec. 2017, doi: 10.1002/MP.12625.
R. Raguraman, S. P, and J. S. Raju, “Adaptive Npc in Serious Games Using Artificial Intelligence,” 2024, doi: 10.2139/SSRN.4806061.
A. Sestini, A. Kuhnle, and A. D. Bagdanov, “Deep Policy Networks for NPC Behaviors that Adapt to Changing Design Parameters in Roguelike Games,” Dec. 2020, Accessed: Jun. 05, 2025. [Online]. Available: https://arxiv.org/pdf/2012.03532
R. J. Williams, “Simple statistical gradient-following algorithms for connectionist reinforcement learning,” Mach. Learn. 1992 83, vol. 8, no. 3, pp. 229–256, May 1992, doi: 10.1007/BF00992696.
“Policy gradient method - Wikipedia.” Accessed: Jun. 05, 2025. [Online]. Available: https://en.wikipedia.org/wiki/Policy_gradient_method
“AlphaGo: How it works technically? | by Jonathan Hui | Medium.” Accessed: Jun. 05, 2025. [Online]. Available: https://jonathan-hui.medium.com/alphago-how-it-works-technically-26ddcc085319
G. Wang and H. Zhang, “Value iteration algorithm for continuous-time linear quadratic stochastic optimal control problems,” Sci. China Inf. Sci., vol. 67, no. 2, pp. 1–11, Feb. 2024, doi: 10.1007/S11432-023-3820-3/METRICS.
“(PDF) AI-Powered Procedural Content Generation: Enhancing NPC Behaviour for an Immersive Gaming Experience.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.researchgate.net/publication/376480816_AI-Powered_Procedural_Content_Generation_Enhancing_NPC_Behaviour_for_an_Immersive_Gaming_Experience
M. B. Rizqi Alvian, S. Bukhori, and M. ‘Ariful Furqon, “Implementation of Finite State Machine to Determine The Behaviour of Non-Playabale Character in Leadership Simulation Game,” J. Games, Game Art, Gamification, vol. 9, no. 1, pp. 11–21, Jun. 2024, doi: 10.21512/JGGAG.V9I1.10894.
“AlphaStar: Grandmaster level in StarCraft II using multi-agent reinforcement learning - Google DeepMind.” Accessed: Jun. 05, 2025. [Online]. Available: https://deepmind.google/discover/blog/alphastar-grandmaster-level-in-starcraft-ii-using-multi-agent-reinforcement-learning/
“Oragent computational model. Figure 1 shows the computational model of... | Download Scientific Diagram.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.researchgate.net/figure/Oragent-computational-model-Figure-1-shows-the-computational-model-of-an-oragent_fig1_259603948
“Redfall - Wikipedia.” Accessed: Jun. 05, 2025. [Online]. Available: https://en.wikipedia.org/wiki/Redfall
“Redfall | Redfall Wiki | Fandom.” Accessed: Jun. 05, 2025. [Online]. Available: https://redfall.fandom.com/wiki/Redfall_(game)
“Working on Details for Game Environments.” Accessed: Jun. 05, 2025. [Online]. Available: https://80.lv/articles/working-on-details-for-game-environments
“Adventure game - Wikipedia.” Accessed: Jun. 05, 2025. [Online]. Available: https://en.wikipedia.org/wiki/Adventure_game
J. Wexler, “Artificial Intelligence in Games: A look at the smarts behind Lionhead Studio’s ‘Black and White’ and where it can and will go in the future”.
“Solved Music Genre Classification Project using Deep Learning.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.projectpro.io/article/music-genre-classification-project-python-code/566
“Proposal: Semantic Feedback System for Privacy-Respecting User Intent Mining (Research + Privacy) - ChatGPT / Feature requests - OpenAI Developer Community.” Accessed: Jun. 05, 2025. [Online]. Available: https://community.openai.com/t/proposal-semantic-feedback-system-for-privacy-respecting-user-intent-mining-research-privacy/1273099
“Software or hardware information | Download Scientific Diagram.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.researchgate.net/figure/Software-or-hardware-information_tbl2_371633185
“(PDF) Reinforcement learning for non-player characters in the video game industry.” Accessed: Dec. 18, 2024. [Online]. Available: https://www.researchgate.net/publication/361452041_Reinforcement_learning_for_non-player_characters_in_the_video_game_industry
“ML-Agents Overview - Unity ML-Agents Toolkit.” Accessed: Jun. 05, 2025. [Online]. Available: https://unity-technologies.github.io/ml-agents/ML-Agents-Overview/
“Introduction to RL and Deep Q Networks | TensorFlow Agents.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.tensorflow.org/agents/tutorials/0_intro_rl
“Top 7 Python Libraries For Reinforcement Learning | GeeksforGeeks.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.geeksforgeeks.org/top-7-python-libraries-for-reinforcement-learning/
“(PDF) Leveraging Reinforcement Learning for Adaptive Decision- Making in Complex, Uncertain Environments.” Accessed: Jun. 05, 2025. [Online]. Available: https://www.researchgate.net/publication/386503269_Leveraging_Reinforcement_Learning_for_Adaptive_Decision-_Making_in_Complex_Uncertain_Environments
D. Jagdale, “Finite State Machine in Game Development,” Int. J. Adv. Res. Sci. Commun. Technol., vol. 10, no. 1, 2021, doi: 10.48175/IJARSCT-2062.
“Part 1: Key Concepts in RL — Spinning Up documentation.” Accessed: Jun. 05, 2025. [Online]. Available: https://spinningup.openai.com/en/latest/spinningup/rl_intro.html

Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 50sea

This work is licensed under a Creative Commons Attribution 4.0 International License.