The prompt node allows you to send requests to language models. You can send multiple prompts in parallel, constrain responses to specific formats, and allow language models to use any Runchats as tools.

Prompt Input

The prompt input is where you describe what you want the language model to do. This is exactly the same as the text input to chatGPT, Claude or any other language model chatbot on the internet. In Runchat, the prompt is typically used to describe some kind of task or action you want the language model to take. This includes things like:

• Does this meet criteria X? (output true / false)
• Format this as Y (output an object)
• Generate a list of options for Z (output an array)
• Save this to a Google Sheet for me (use Google Sheet tool)

Context Input

The context input is where you provide any additional information to help the language model with understanding the context of your prompt. This is exactly the same as the conversation history in most chatbots. In Runchat, the context is typically used for:

• Conversation history from previous prompts
• Images / Documents for the prompt to act on
• Input from a user running the Runchat as an App

Format

The Format input is where you can specify an exact format for the language model to respond in. The default is text. In Runchat, the format is typically used for:

• Generating lists of content to be run in parallel by other nodes
• Creating structured data from unstructured inputs (e.g. parsing a blog to header and content fields)
• Formatting data for external APIs
• Flow control (outputting true / false values)

For more information on Formatted outputs, see this guide.