PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 21, 2026TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES0 citationsOpen Access

Automated software size measurement using multilingual domain-adapted language models

View Full Paper
STSamet TenekeciHÜHÜSEYİN ÜNLÜBKBURAK KEÇECİ

Key Points

  • To create a low-resource solution for accurate software size measurement using domain-adapted models.
  • Developed automated software size measurement approach based on supervised regression.
  • Constructed Turkish and English software engineering corpora for model pre-training.
  • Fine-tuned SE-BERT and SE-BERTurk on a multilingual annotated dataset with COSMIC Function Points.
  • Evaluated models using regression and classification metrics.
  • SE-BERT achieved an accuracy improvement from 66.9% to 68.2% over BERT.
  • SE-BERTurk improved accuracy from 65.7% to 69.3% over BERTurk.
  • Both models showed lower normalized errors compared to previous models, indicating better performance.

Abstract

Software Size Measurement (SSM) is crucial for estimating required project effort as well as budget and schedule. However, many small and medium-sized companies struggle to apply objective SSM due to limited resources and lack of expertise. This often leads to inaccurate estimates and project overruns. There is a need for practical, low-resource solutions that support these tasks without requiring expert involvement. Motivated by this challenge, this study proposes an automated software size measurement approach that formulates the measurement task as supervised regression over natural language requirements, using domain-adapted transformer models. We construct large-scale Turkish and English software engineering corpora to pre-train two models: SE-BERT and SE-BERTurk. These models are fine-tuned on a multilingual, organization-specific dataset annotated with COSMIC Function Points (CFP) and MicroM size by domain experts. We evaluate the models using various regression and classification metrics. Results show that SE-BERT improves exact match accuracy from 66. 9% to 68. 2% compared to BERT, while SE-BERTurk improves from 65. 7% to 69. 3% over BERTurk. Both models also achieve lower normalized errors than previous domain-adapted baselines BERTSE and RE-BERT, demonstrating superior generalization. These findings highlight the effectiveness of domain-specific pre-training for software engineering tasks and its potential to support accurate software size estimation, especially in low-resource languages like Turkish and in real-world, organization-specific contexts.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Tenekeci et al. (2026) studied this question.

synapsesocial.com/papers/69be36086e48c4981c6749cchttps://doi.org/10.55730/1300-0632.4172
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Automating Software Size Measurement from Code Using Language Models2025
  2. 2BERT Fine-Tuning for Software Requirements Classification: Impact of Model Components and Dataset Size2025
  3. 3Baselining Large Language Model Performance in Systems Engineering Using SysEngBench2026
  4. 4A survey on large language models for software engineering2026 · 12 citations
  5. 5Fuzzy ensemble of fined tuned BERT models for domain-specific sentiment analysis of software engineering dataset2024 · 10 citations