Table-LLM-Specialist: Language Model Specialists for Tables using Iterative Fine-tuning

Language models such as GPT and Llama have shown remarkable ability on diverse natural language tasks, yet their performance on complex table tasks (e.g., NL-to-Code, data cleaning, etc.) continues to be suboptimal. To improve their performance, task-specific fine-tuning is often needed, which, however, require expensive human labeling and is prone to over-fitting. In this work, we propose TABLE-SPECIALIST, a self-trained fine-tuning paradigm specifically designed for table tasks. Our insight is that for each table task, there often exist two dual versions of the same task, one generative and one classification in nature. Leveraging their duality, we propose a Generator-Validator paradigm to iteratively generate-then-validate training data from language models, to finetune stronger TABLE-SPECIALIST models that can specialize in a given task, without using manually-labeled data. Extensive evaluations of TABLE-SPECIALIST on Llama, GPT-3.5 and GPT-4 suggest that our TABLE-SPECIALIST has (1) strong performance on diverse tasks over vanilla languagemodels -for example, TABLE-SPECIALIST fine-tuned on GPT-3.5 not only outperforms vanilla GPT-3.5, but can often surpass GPT-4 level quality, (2) lower cost to deploy, because when TABLE-SPECIALIST fine-tuned on GPT-3.5 achieve GPT-4 level quality, it becomes possible to deploy smaller models with lower latency/cost at comparable quality, and (3) better generalizability when evaluated across multiple benchmarks, since TABLE-SPECIALIST is fine-tuned on a broad range of training data systematically generated from diverse real tables. Our code is available at microsoft/Table-Specialist. Specialist models fine-tuned using TABLE-SPECIALIST have been integrated into Microsoft Excel for use cases such as automated data cleaning.