基于 Transformer 的知识继承式模糊神经网络的故障诊断方法
CSTR:
作者:
作者单位:

大连理工大学电子信息与电气工程学部

作者简介:

通讯作者:

中图分类号:

TP273

基金项目:

本工作部分得到了国家自然科学基金项目(批准号:62473074、62073056、61876029)以及辽宁省重点研发计划项目(批准号:2024JH2/102400006)的资助。


Transformer-Based Knowledge-Inheriting Fuzzy Neural Network for Fault Diagnosis
Author:
Affiliation:

Fund Project:

This work was supported in part by the National Natural Science Foundation of China under Grant 62473074, Grant 62073056, Grant 61876029, and Grant 62076050, and in part by Liaoning Province Key Research and Development Project under Grant 2024JH2/102400006.

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为了构建兼具高性能与内在可解释性的故障诊断模型, 本文提出了一种基于 Transformer 的知识继承式模糊神经网络 (TKI-FNN) 模型. 首先由训练好的先验 Transformer 分类器模块生成 logit 向量(未归一化的概率分布). 随后, 知识蒸馏模块通过调节蒸馏温度参数, 将 logit 向量转换为携带类间相似性知识的软标签. 这些软标签不仅包含目标类别信息, 还隐含刻画不同故障类别之间的潜在关联关系. 最后,知识继承的 Takagi–Sugeno–Kang(TSK)模块通过其后件接收软标签, 并执行可解释的故障诊断推理. 该模型采用梯度下降方法优化由交叉熵、软标签正则化构成的复合目标函数. 这种全新的知识继承范式使得所提 TKI-FNN 在通过软标签正则化有效避免过拟合、提升故障诊断性能的同时,仍能够保持下游 TSK 模块的语义可解释性不受破坏. 在涵盖真实工业过程的一系列实验中, 所提出模型在故障诊断精度与可解释性方面均表现出显著优势.

    Abstract:

    To develop a fault diagnosis model that combines high performance with intrinsic interpretability, this paper proposes a Transformer-based knowledge-inheritance fuzzy neural network (TKI-FNN). Specifically, a pre-trained Transformer classifier is first employed to generate logit vectors (i.e., unnormalized probability distributions). Subsequently, the knowledge distillation module transforms these logit vectors into soft labels by adjusting the temperature parameter, thereby embedding inter-class similarity information. These soft labels not only contain target class information but also implicitly characterize latent relationships among different fault categories. Finally, the knowledge-inherited Takagi–Sugeno–Kang (TSK) module receives soft labels through its consequent part and performs interpretable fault diagnosis inference. The model is optimized using gradient descent based on a composite objective function consisting of cross-entropy loss and soft-label regularization. This novel knowledge-inheritance paradigm enables the proposed TKI-FNN to effectively mitigate overfitting and improve fault diagnosis performance through soft-label regularization, while preserving the semantic interpretability of the downstream TSK module. In a series of experiments involving real industrial processes, the proposed model demonstrates significant advantages in both fault diagnosis accuracy and interpretability.

    参考文献
    相似文献
    引证文献
引用本文
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-01-20
  • 最后修改日期:2026-04-20
  • 录用日期:2026-04-21
  • 在线发布日期: 2026-05-06
  • 出版日期:
文章二维码