Under 1,000 tokens for the system prompt and tool defs is the number that matter... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

sage981 37 days ago | parent | context | favorite | on: Pi's Minimalism Is Its Advantage

Under 1,000 tokens for the system prompt and tool defs is the number that matters here. Everything else is downstream of not crowding the context.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact