AILLM推理与部署

解码策略 (Decoding Strategies)

订阅后可继续阅读剩余内容立即订阅

微调 (Fine-tuning)

Previous Page

量化 (Quantization)

Next Page

On this page

确定性解码 (Deterministic Methods)1. Greedy Search (贪婪搜索)2. Beam Search (束搜索)随机性解码 (Stochastic Methods)1. Temperature (温度)2. Top-k Sampling 3. Top-p (Nucleus) Sampling 惩罚机制 (Penalties)Repetition Penalty (重复惩罚)总结