Latitude

The open-source prompt engineering platform for product teams

Freemium

Description

Latitude is an open-source platform designed to assist product teams in managing the lifecycle of prompts for AI applications. It provides tools to implement best practices, enabling the delivery of reliable AI products with greater confidence. The platform facilitates the tracking and evaluation of prompts, utilizing real data for refinement before deployment.

Users can import prompts into a central manager, test them at scale using advanced templating and batch experiments, and subsequently evaluate their performance through methods like LLM-as-judge, human-in-the-loop, or ground truth comparisons. Latitude supports deploying updated prompts via an SDK or gateway and includes features for creating high-quality datasets for testing or fine-tuning purposes. It also offers observability features for logging and debugging requests.

Key Features

Prompt Manager: Collaborate with your team to write and iterate prompts.
Playground: Iterate prompts at scale before pushing them to production.
Evaluations: Run LLM-as-judge, code, or human evaluations on generated logs.
Datasets: Create datasets from logs or synthetically for testing prompts or evaluations.
Observability: Automatically log and debug all your requests.
Refiner: Automatically improve your prompts based on their evaluations.
Deployment Integration: Push prompts to production and fetch via SDK or gateway.
Advanced Prompt Templating: Craft complex prompts effectively.