No Cover Image

Journal article 201 views 56 downloads

Hybrid Reinforcement Learning With Optimized SARSA for Improved Face Recognition Systems

Anil Kumar Yadav Orcid Logo, Purushottam Sharma Orcid Logo, Cheng Cheng Orcid Logo, Nirmal Kumar Gupta Orcid Logo

Journal of Electrical and Computer Engineering, Volume: 2025, Issue: 1

Swansea University Author: Cheng Cheng Orcid Logo

  • 70224.VoR.pdf

    PDF | Version of Record

    Copyright © 2025 Anil Kumar Yadav et al. This is an open access article under the terms of the Creative Commons Attribution License.

    Download (592.7KB)

Check full text

DOI (Published version): 10.1155/jece/3305430

Abstract

Face recognition is a key technique in modern image processing, yet it faces challenges such as achieving high accuracy, reducing computational time, and optimizing memory usage. This research proposes a hybrid model that integrates an enhanced State-Action-Reward-State-Action (SARSA) reinforcement...

Full description

Published in: Journal of Electrical and Computer Engineering
ISSN: 2090-0147 2090-0155
Published: Wiley 2025
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa70224
Abstract: Face recognition is a key technique in modern image processing, yet it faces challenges such as achieving high accuracy, reducing computational time, and optimizing memory usage. This research proposes a hybrid model that integrates an enhanced State-Action-Reward-State-Action (SARSA) reinforcement learning (RL) framework to address these challenges in face recognition tasks. The model utilizes principal component analysis (PCA) for dimensionality reduction and initial feature extraction, followed by a SARSA-based online Q-learning algorithm to refine classification accuracy and resolve state overlap issues. During training, facial datasets are processed to extract critical features, and a state-action value table is constructed to guide decision-making during testing. This reinforcement-driven learning enables the system to dynamically update its policy based on the most rewarding actions, improving adaptability and performance. Experimental results demonstrate that the proposed approach enhanced traditional models in terms of recognition accuracy, classification efficiency, and training speed. Integrating optimized feature selection and policy learning mechanisms makes the model a promising solution for real-time and resource-efficient face recognition applications.
Keywords: classification; face recognition; feature extraction; learning agent; reward; SARSA
College: Faculty of Science and Engineering
Funders: Swansea University. Grant Number: RS718; Engineering and Physical Sciences Research Council. Grant Number: EP/W020408/1
Issue: 1