详细信息
SelectDataset: Enabling Dataset Exploration Through Enriched Descriptive Metadata and Hierarchical Model-Based Application Topic Classification ( CPCI-S收录)
文献类型:会议论文
英文题名:SelectDataset: Enabling Dataset Exploration Through Enriched Descriptive Metadata and Hierarchical Model-Based Application Topic Classification
作者:Yuan, Ruixin[1,2];Li, Ning[1];Peng, Qiantai[1];Zhang, Hengrun[1];Yu, HuiQun[1];Fan, Guisheng[1]
机构:[1]East China Univ Sci & Technol, Shanghai 200237, Peoples R China;[2]Shanghai Key Lab Comp Software Evaluating & Testi, Shanghai 200235, Peoples R China
会议论文集:21st International Conference on Intelligent Computing-ICIC-Annual
会议日期:JUL 26-29, 2025
会议地点:Ningbo, PEOPLES R CHINA
语种:英文
外文关键词:Text Classification; Hierarchical Model; Descriptive Metadata; Dataset Search
摘要:The rapid expansion of datasets across various domains is driven by advancements in data collection, storage technologies, and the growing demand for high-quality data. However, this has created a messy and scattered situation. While dataset search platforms have contributed to dataset accessibility, significant challenges remain in dataset search and utilization, including the lack of sufficient datasets, unified and rich descriptive metadata, and a dataset classification model. We address these issues by developing a global dataset repository with a unified metadata structure and an automated dataset classification system. Our repository aggregates datasets from reputable sources and organizes them using a two-level hierarchical categorization system that classifies datasets by data type and application topic. To automate dataset classification, we introduce SelectDataset, a hierarchical model that utilizes large language models (LLMs) for inference augmentation, improving classification accuracy for complex and lengthy textual descriptions. Our approach also incorporates decoupling training to address class imbalance, further enhancing model robustness. Through comprehensive experiments, we demonstrate that SelectDataset offers a more efficient and accurate solution.
参考文献:
正在载入数据...
