Quantum-Inspired Algorithms for Scalable Optimization in Big Data Analytics
M. Venkata Subramanian, Amjad Ali Syed, Ashish Avasthi +3 more
As modern data environments continue to scale in volume and dimensionality, classical metaheuristics like Genetic Algorithms (GA) and Particle Swarm Optimization (PSO) struggle to balance convergence efficiency with solution quality. The challenge is further amplified in big data optimization, where stagnation in local minima and prohibitive computation time impede real-time applicability. Existing methods fail to simultaneously address the need for global search intelligence and computational scalability, especially under high-dimensional constraints and distributed workloads. To bridge this gap, we propose QIESO—a Quantum-Inspired Evolutionary Swarm Optimizer that integrates quantum amplitude encoding, probabilistic gate rotation, swarm coordination, and tunnelingbased mutation to escape local traps and accelerate convergence. Unlike traditional optimizers, QIESO leverages quantum principles simulated classically to maintain coherence across the search space while reducing evaluation overhead. Empirical validation across datasets up to 100 million records shows QIESO achieves a 51.7% reduction in runtime over GA and 42.7% faster convergence than PSO, with a relative error margin consistently under 2.1%. The method exhibits sublinear scalability in time complexity due to dimensionality-agnostic encoding. This work significantly advances scalable optimization for high-throughput environments, making it ideal for applications in autonomous systems, real-time analytics, and next-gen intelligent infrastructures.
International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT)•Oct 31, 2025•0 citations