v0.9.4

What's new in 0.9.4 (2024-03-21)

These are the changes in inference v0.9.4.

New features

• FEAT: Support CodeShell model by @hainaweiben in #1166
• FEAT: Supports sglang backend by @ChengjieLi28 in #1161

Enhancements

• ENH: vLLM latest models support by @1572161937 in #1155

Bug fixes

• BUG: remove best_of from benchmark by @qinxuye in #1150
• BUG: fix _eval_qwen_chat_arguments parsing problem by @channingxiao18 in #1098
• BUG: Fix OpenAI compatibility issue during chat by @mujin2 in #1159

Documentation

• DOC: Update doc by @codingl2k1 in #1156

Others

• Chore: add assign workflow by @qinxuye in #1131

New Contributors

• @channingxiao18 made their first contribution in #1098
• @1572161937 made their first contribution in #1155

Full Changelog: v0.9.3...v0.9.4