How Can We Effectively Expand the Vocabulary of LLMs with 0.01GB of Target Language Text?
"持续预训练" 相关文章
IKnow: Instruction-Knowledge-Aware Continual Pretraining for Effective Domain Adaptation
DACIP-RC: Domain Adaptive Continual Instruction Pre-Training via Reading Comprehension on Business Conversations
DACP: Domain-Adaptive Continual Pre-Training of Large Language Models for Phone Conversation Summarization
LLM Research Papers: The 2024 List
如何在大模型基础上训练一个特定领域的专业模型
如何在大模型基础上训练一个特定领域的专业模型
MachineLearningLM: Scaling Many-shot In-context Learning via Continued Pretraining
PLaMo 2 Technical Report
Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models
A Practice of Post-Training on Llama-3 70B with Optimal Selection of Additional Language Mixture Ratio
Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training
HanjaBridge: Resolving Semantic Ambiguity in Korean LLMs via Hanja-Augmented Pre-Training
单向VLM变双向！人大斯坦福等提出MoCa框架：双向多模态编码器
Noteworthy AI Research Papers of 2024 (Part One)
Aquila-Med LLM：开创性的全流程开源医疗语言模型
