PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 29, 2026Mathematics0 citationsOpen Access

An Enhanced ABC Algorithm with Hybrid Initialization and Stagnation-Guided Search for Parameter-Efficient Text Summarization

View Full Paper
YLYun LiuYYYingjing YaoWPWenyu Pei

Key Points

  • The aim is to develop a robust method for text summarization that effectively optimizes hyperparameters using a hybrid algorithm.
  • Proposed a unified framework combining low-rank adaptation and an enhanced Artificial Bee Colony algorithm.
  • Introduced hybrid initialization to leverage prior knowledge for better starting points.
  • Implemented a stagnation-guided local search mechanism to refine useful solutions during optimization.
  • Tested the approach on Chinese summarization benchmarks and an industrial pipeline communication corpus.
  • The proposed framework outperforms full fine-tuning and several evolutionary optimization baselines in ROUGE metrics.
  • Achieved consistent performance improvements across both datasets with modest additional computational costs.
  • Eliminated the need for expert-dependent hyperparameter tuning.

Abstract

The digital transformation of oil and gas pipeline networks has generated substantial volumes of unstructured maintenance documentation from communication systems, creating an urgent need for automated summarization to improve operational efficiency. However, domain-specific text summarization for pipeline communication maintenance remains challenging due to scarce labeled data and the high computational cost of fine-tuning large pretrained models. Parameter-efficient fine-tuning alleviates this issue, but its effectiveness strongly depends on appropriate hyperparameter selection. This paper proposes a unified framework that combines weight-decomposed low-rank adaptation with an enhanced Artificial Bee Colony algorithm for automated hyperparameter optimization. The enhanced algorithm addresses two specific limitations of the standard Artificial Bee Colony algorithm: uninformed random initialization that ignores promising regions, and premature abandonment of stagnated solutions that discards partially useful search directions. These two components represent principled design choices, each targeting a distinct bottleneck in applying swarm intelligence search to high-dimensional mixed-type hyperparameter spaces. The method introduces a hybrid initialization strategy to exploit prior knowledge and a stagnation-guided local search mechanism to refine stagnated solutions instead of discarding them, achieving a better balance between exploration and exploitation. Experimental results on a public Chinese summarization benchmark and an industrial oil and gas pipeline communication maintenance corpus show that the proposed approach consistently outperforms full fine-tuning, manually tuned parameter-efficient methods, and several evolutionary optimization baselines in terms of ROUGE metrics. The automated search introduces modest additional computational overhead compared to manual tuning while eliminating expert-dependent hyperparameter configuration and achieving consistent performance gains across both datasets. Overall, the proposed framework provides an efficient and robust solution for adapting large language models to specialized summarization tasks in the context of pipeline communication system maintenance.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Liu et al. (2026) studied this question.

synapsesocial.com/papers/69c8c30dde0f0f753b39daddhttps://doi.org/10.3390/math14071120
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1An external attention-based feature ranker for large-scale feature selection2023 · 55 citations
  2. 2Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces1997 · 29,431 citations
  3. 3A New Metaheuristic Bat-Inspired Algorithm2010 · 4,786 citations
  4. 4Overview of the NLPCC 2017 Shared Task: Single Document Summarization2018 · 32 citations
  5. 5Partial Connection Based on Channel Attention for Differentiable Neural Architecture Search2022 · 87 citations