Braintrust Weekly Update

We’ve been heads down at Braintrust working on an exciting new feature. We’ll announce it soon! In the meantime, we’ve shipped some user experience improvements and fixes this week:

New OpenAI and Open Source models in playground

We wanted to try out open source models like Mistral, Codellama, Llama2, etc. and compare them to OpenAI's new models. So, we added them to the playground and also used Perplexity's API for the OS models. They are so fast!

Release notes:

• Improved selectors for diffing and comparison modes on experiment view
• Added support for new OpenAI models (GPT4 preview, 3.5turbo-1106) in playground
• Added support for open source models (Mistral, Codellama, Llama2,etc.) in the playground using Perplexity's APIs

Fun links and mentions:

• OpenAI's reproducible outputs makes evals and testing 10x better
• Have fun building AI apps with your team

Braintrust is the enterprise-grade stack for building AI products. From evaluations, to prompt playground, to data management, we take uncertainty and tedium out of incorporating AI into your business.

Sign up now, or check out our pricing page for more details.