Secure Big Data Analytics for Blockchain Transaction Fee Prediction and Scheduling in Distributed Systems
Research Square
Abstract This paper introduces an Intelligent and Secure Big Data Analyt-ics framework based on Explainable Hyper-Heuristic Optimization for dynamic blockchain transaction fee prediction and scheduling in distributed systems. The proposed framework is motivated by the volatility and complexity of large-scale blockchain fee markets, such as Ethereum’s EIP-1559 mechanism, which generate high-dimensional, time-varying transactional data characteristic of modern distributed and IoT-enabled ecosystems. The framework integrates a machine learning–based fee prediction module with an adaptive hyper-heuristic optimization engine that solves a mixed-integer scheduling problem over large-scale blockchain transaction datasets. In addition, a SHAP-based explainability layer is incorporated to support transparent, interpretable, and auditable decision-making, enabling trustworthy analytics in secure distributed environments. Experimental evaluation using six months of Ethereum mainnet data demonstrates that the proposed approach reduces median transaction costs by up to 14.8% and improves average confirmation delays by 8.3% compared with heuristic and fixed-fee baselines. Secure Big Data Analytics for Blockchain Scheduling Further analysis highlights the benefits of combining predictive analyt-ics, adaptive heuristic selection, and exact refinement under dynamic network conditions, while explainability results identify key transac-tional and network features influencing fee behavior and scheduling decisions. Overall, the proposed framework advances intelligent and secure big data analytics for distributed systems by improving efficiency , transparency, and trust in decentralized transaction management , with applications in wallets, decentralized applications, and latency-sensitive financial services. Future work will extend the framework to multi-chain environments, integrate Layer-2 scaling solutions, and explore real-time deployment in production blockchain systems.
