TDQE：a quality evaluation method for text data in deep learning

Text data quality is an important factor affecting the performance of language models. and its evaluation methodology is considered decisive for model training effectiveness. To address the issues of high computational costs and incomplete evaluation metrics in existing text data quality assessment...

Full description

Bibliographic Details

Published in:	大数据
Main Authors:	LUO Chunxu, XIONG Haixu, YE Yazhen, DING Yan, ZONG Shize, XIONG Yun, ZHU Yangyong
Format:	Article
Language:	Chinese
Published:	China InfoCom Media Group 2025-01-01
Subjects:	deep learning text data data evaluation quality evaluation
Online Access:	http://www.j-bigdataresearch.com.cn/zh/article/111999072/