Traditional association rule mining algorithms face the dual challenges of exponential increase in algorithm complexity with the increase of dimensions and difficulty in capturing the dynamic evolution characteristics of user behavior by static models when dealing with such high-dimensional sparse data. Therefore, this study proposes a multi-dimensional association mining algorithm framework of e-commerce user behavior named DW-PMARS (Dynamic Weighted Parallel Multi-dimensional Association Rule Mining System), which integrates big data analysis. The framework consists of four core layers: data preprocessing and feature engineering layer, dynamic weight modeling and dimensionality reduction layer, parallel association mining layer, and dynamic rule generation and evaluation layer. In the data preprocessing stage, the Spark platform is used to integrate heterogeneous data and construct a multi-dimensional behavior-feature hypergraph covering product ID, category and behavior type. In the dynamic weight modeling, the quantification and screening of feature importance are realized by combining the static basic weight and the formula assignment of dynamic adjustment weight; In the parallel mining layer, the improved weighted parallel FP-Growth algorithm is used to calculate the support of itemsets with the sum of weights, and the parallel mining is realized in Spark MLlib framework. The dynamic rule layer updates the weights and rules in real time with Flink stream processing technology, combines information entropy to measure and evaluate rules, and introduces attenuation mechanism to eliminate low confidence rules. At the same time, it integrates graph neural network (GNN) to mine indirect associations, and identifies potential strong associations through node embedding vector similarity. The experimental results show that the running time of DW-PMARS is only 285s and the peak memory consumption is 12.7GB, which is significantly higher than that of FP-Growth(1245s, 38.5GB), and the proportion of high promotion rules is 53.8%, far exceeding that of FP-Growth (18.3%). In the simulated promotion scenario, DW-PMARS can respond to the sudden change of behavior pattern in real time, and the prediction accuracy quickly rises after a short fluctuation, while the static FP-Growth accuracy drops sharply.
Kong et al. (Sun,) studied this question.