-
Book Overview & Buying
-
Table Of Contents
Model Context Protocol for LLMs
By :
While servers provide resources, tools, and prompts, clients control how model outputs are generated and persisted. MCP defines three client-side features, which we will see at a very high level.
Sampling controls how text is generated from the model. Parameters include temperature, top-p (nucleus) sampling, and stop sequences. Clients may set a global sampling policy or adjust settings for specific turns. For example, a client might generate a creative draft with a high temperature and then reduce the temperature when calling a tool to ensure deterministic arguments.
For example, suppose the user asks the model to brainstorm product names. The client could set temperature=0.9 and top_p=0.95 to encourage diverse outputs. Once the model chooses a name and prepares to call the createProduct tool, the client reduces temperature to 0 to ensure that the arguments match the schema.
Roots provide a persistent filesystem-like storage accessible...