data synthesis

4 items

RESEARCHarXiv CS.CL·4/17/2026

How to Fine-Tune a Reasoning Model? A Teacher-Student Cooperation Framework to Synthesize Student-Consistent SFT Data

This research proposes TESSY, a Teacher-Student Cooperation Data Synthesis framework, to address performance drops when fine-tuning reasoning models with teacher-generated data. TESSY enables the generation of synthetic sequences that inherit advanced reasoning from the teacher while maintaining stylistic consistency with the student model's distribution.

data synthesis machine learning code generation large language models

RESEARCHarXiv CS.AI·17d ago

MindLoom: Composing Thought Modes for Frontier-Level Reasoning Data Synthesis

MindLoom is a framework for synthesizing frontier-level reasoning data, addressing the challenge of limited diversity and unstable difficulty in existing methods. It achieves this by decomposing problem solutions into "thought mode chains" and training a retrieval model to guide the reasoning process.

data synthesis Thought Modes LLMs AI frameworks

RESEARCHarXiv CS.CL·26d ago

ToolWeave: Structured Synthesis of Complex Multi-Turn Tool-Calling Dialogues

ToolWeave is a structured framework for synthesizing realistic multi-turn tool-calling dialogues, essential for LLMs to function as autonomous agents. It addresses challenges in existing synthetic data generation by supporting realistic multi-step workflows and reducing parameter hallucination.

data synthesis LLMs tool-calling dialogue systems

RESEARCHarXiv CS.LG·6d ago

Geometry-Aware Tabular Diffusion

Geometry-Aware Tabular Diffusion (GATD) is introduced to improve tabular synthesis by augmenting denoisers with pairwise angles and lengths computed from column value differences. It achieves state-of-the-art performance with fewer parameters, reducing Shape and Trend error, and showing that explicit relational supervision drives the gains.

Diffusion Models data synthesis deep learning machine learning