Guided Texture Segmentation via Coordinate-Aware Class-Ratio Mapping
Bishal Swain · Kyung Cheoi · Jaepil Ko
Abstract
Segmenting texture-rich images is challenging due to the presence of various local ambiguities. These are common in domains like metallography, where scanning electron microscopy (SEM) images must be segmented to quantify different elements that determine material properties. Conventional encoder–decoder models often struggle in these scenarios because they rely solely on local features and lack global distributional awareness. We propose a guided segmentation framework that introduces coordinate-aware class-ratio mapping. It is a mechanism that transforms expected class proportions into spatial maps and integrates them with encoder features via a adaptive gate fusion module. This enforces consistency between global class ratios and local pixel predictions, allowing the model to resolve ambiguous textures more effectively. Unlike traditional methods, we condition the model on image-specific global ratios, which can be obtained from experts or estimated in an auto-regressive method. Extensive experiments on metallographic SEM benchmarks demonstrate that our framework consistently improves performance across diverse backbones, achieving up to +6.1\% Dice score improvements with minimal parameter overhead ($<$2\%). Ablation studies confirm that both coordinate-aware class-ratio mapping and the adaptive gate fusion module contribute complementary benefits. In addition, we demonstrate that segmentation performance improves provided that the accuracy of the input class ratios is at least 60\%. The private data and code will be made available upon publication.
Successful Page Load