2025年2月28日 · Large Language Models (LLMs) have transformed the natural language processing landscape and brought to life diverse applications. Pretraining on vast web-scale …

A taxonomy of post-training approaches for **LLMs**, categorized into Fine-tuning, Reinforcement Learning, and Test-time Scaling methods. We summarize the key techniques used in recent …

2024年8月17日 · Build a Large Language Model (from Scratch) is a highly focused book dedicated to coding LLMs from the ground up in PyTorch, covering everything from pre …

2025年3月7日 · LLM Post-Training: A Deep Dive into Reasoning Large Language Models. This survey provides a systematic exploration of post-training methodologies, analyzing their role in …

2024年7月15日 · This fully automated training and evaluation pipeline sets the stage for continuous advancements in various LLMs via post-training. Notably, Arena Learning plays a …

2024年1月16日 · In this paper, we present a plug-and-play solution for post-training pruning of LLMs. The proposed solution has two innovative components: 1) **Relative Importance and …

2024年6月10日 · To address this, we propose accelerating pretrained LLMs through post-training shift-and-add reparameterization, creating efficient multiplication-free models, dubbed …

Models (LLMs), the survey systematically covers various aspects: • Different types of human (and non-human) feedback (Section 7.3), • The training methods in RLHF (Section 7.6), • …

2025年2月18日 · With the recent explosion of interest in large language models (LLMs), they often seem almost magical. But let’s demystify them. I wanted to step back and unpack the …

训练后量化 (ptq) 已成为一种有前途的技术，可减少大语言模型中的内存消耗和计算成本 (llms)。 然而，目前缺乏对各种量化方案、模型族和量化位精度的系统检查。