Guidance enables you to control modern language models more effectively and efficiently than traditional prompting or chaining. Guidance programs allow you to interleave generation, prompting, and logical control into a single continuous flow matching how the language model actually processes the text.

Install

Guidance can be installed from PyPI:

pip install guidance

Contents

• Tutorials
  • Introduction to guidance
  • Token healing
  • Regular expression constraints
  • Guidance acceleration
  • Example: generating and running code
  • Chat dialog
  • Multi-step chat with hidden blocks
• API reference
  • functions
  • context blocks
  • models
• API examples
  • functions
  • models
• The Art of Prompt Design
  • Use clear syntax
  • Prompt Boundaries and Token Healing
  • Getting language models to use external tools (a.k.a. function calls)
  • ReAct Design Pattern
  • Retrevial Augmented Generation (RAG)