Chat Modes: Configuring the LLM for Each Turn
RubyLLM::Modes is an extension for RubyLLM: before each chat turn, a router picks the instructions, tools, model, and thinking for that reply. The router uses Jev through the new RubyLLM.judge: about 350 ms and $0.04 per 1,000 turns.
Post a comment