guidance

We have hosted the application guidance in order to run this application in our online workstations with Wine or directly.

Quick description about guidance:

Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case�while reducing latency and cost vs. conventional prompting or fine-tuning. It allows users to constrain generation (e.g. with regex and CFGs) as well as to interleave control (conditionals, loops, tool use) and generation seamlessly.

Features:

• Write pure Python, with additional LM functionality
• Constrain generation with selects (i.e., sets of options), regular expressions, and context-free grammars, as well as with pre-built components
• Documentation available
• Examples available
• Call and deploy tools easily with automatic interleaving of control and generation
• Gain speed with stateful control + generation functions�no need for intermediate parsers

Programming Language: Python.
Categories: