↓Skip to main content

🏒 UC San Diego

Efficiently Serving LLM Reasoning Programs with Certaindex
·3238 words·16 mins· loading · loading
AI Generated πŸ€— Daily Papers Natural Language Processing Large Language Models 🏒 UC San Diego
Dynasor은 LLM μΆ”λ‘  ν”„λ‘œκ·Έλž¨μ˜ μžμ› μ‚¬μš©μ„ μ΅œμ ν™”ν•˜λŠ” μ‹œμŠ€ν…œμœΌλ‘œ, certaindexλΌλŠ” μƒˆλ‘œμš΄ μ§€ν‘œλ₯Ό ν™œμš©ν•˜μ—¬ μ–΄λ €μš΄ μ§ˆμ˜μ—λŠ” 더 λ§Žμ€ 연산을, κ°„λ‹¨ν•œ μ§ˆμ˜μ—λŠ” 적은 연산을 ν• λ‹Ήν•˜κ³ , 전망이 μ—†λŠ” μ§ˆμ˜λŠ” 쑰기에 μ’…λ£Œν•¨μœΌλ‘œμ¨ 정확도, 지연 μ‹œκ°„ 및 λΉ„μš©μ„ κ· ν˜• 있게 맞μΆ₯λ‹ˆλ‹€.