Laminar

Laminar is an open-source platform where you can trace your LLM app, run evaluations, label production data and use it to improve your prompts. Laminar is fast, reliable and offers best-in-class DX. It’s written in Rust and built on top of a modern tech stack.
Good AI engineering is all about data and it boils down to three things – collect data, analyze data, use data. Laminar enables teams to do all of that in a single platform.

Unbelievable alpha in looking at data ©️ Hamel Husain (https://x.com/HamelHusain/status...)

Collect data – Tracing

• Trace every execution step of your LLM application by adding just 2 lines of code.
• Laminar automatically traces common LLM SDKs (OpenAI, Anthropic …), and popular LLM frameworks (Langchain …)
• We support images, and soon audio!

Analyze data – Labeling

• Laminar provides tools for your team to efficiently label the data and analyze human labels distribution.
• Use this labeled data to better align LLM-as-a-judge with your app requirement