Braintrust Blog 前天 00:48
Braintrust集成Vercel,简化AI应用评估与监控
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

Braintrust现已登陆Vercel Marketplace,为开发者提供一个在Vercel仪表板内即可运行评估、监控模型质量和用户体验、并对OpenAI、Anthropic、Gemini等模型进行基准测试的解决方案。通过简单的几步操作,即可自动将Vercel应用AI追踪数据发送至Braintrust,全面洞察AI应用在生产环境中的表现。该集成旨在解决AI应用上线后团队面临的回归检测、变更追踪以及将实际使用转化为改进等挑战。Braintrust提供系统化评估、实时可观测性、生产级规模的数据处理以及模型灵活性,帮助团队减少对脆弱的内部工具和手动审查的依赖,自信地发布更新。

🚀 **无缝集成与便捷部署**:Braintrust已上线Vercel Marketplace,允许用户直接从Vercel仪表板内安装和配置。用户只需简单几步操作,即可创建Braintrust项目并将其与Vercel账户关联,随后即可选择性地将AI追踪数据发送至Braintrust,极大地简化了AI应用的评估和监控流程。

💡 **全面的AI应用可观测性**:该集成解决了AI应用在生产环境中可能出现的各种问题,包括回归检测、追踪变更以及将用户实际使用数据转化为可行的改进。通过实时监控和在线评分,Braintrust帮助团队确切了解AI功能是否有效,不良响应是否触达用户,从而在无猜测的情况下提升模型质量。

🛠️ **强大的AI工程基础设施**:Braintrust为AI工程提供了关键的基础设施层,包括构建可靠的系统化评估测试套件以在生产前捕获问题;提供实时可观测性,通过监控和在线评分追踪生产中的AI应用;利用专为AI工作负载设计的Brainstore数据库,实现80倍于常规的速度查询、过滤、分析和审查日志;以及通过Braintrust的代理实现模型灵活性,无需重写代码即可比较和替换不同的LLM提供商。

16 October 2025Ornella Altunyan

"I've never seen a workflow transformation like the one that incorporates evals into 'mainstream engineering' processes before. It's astonishing." – Malte Ubl, CTO at Vercel

Braintrust is now available on the Vercel Marketplace. This means you can run evals, monitor model quality and user experience, and benchmark across models from OpenAI, Anthropic, Gemini, and more all from your Vercel dashboard. With just a few clicks, you can automatically send your Vercel application's AI traces to Braintrust, giving you comprehensive visibility into your AI application's performance in production.

As AI applications move to production, teams need infrastructure that catches regressions, tracks what changed, and turns real usage into improvements. With Braintrust on Vercel Marketplace, you can ship agents and AI features with built-in evaluation and observability -- going from vibes to verified through the complete development loop.

How do you know your AI feature actually works? Are bad responses reaching users? Can your team improve quality without guesswork?

AI systems fail in unpredictable ways. Teams rely on fragile in-house tooling, ad-hoc manual reviews, and have no visibility into production errors. This leads to unhappy users, wasted engineering time debugging mystery issues, and teams afraid to ship updates because they can't predict what will break.

Braintrust provides the infrastructure layer required for AI engineering:

    Systematic evals: Build reliable test suites that catch issues before they reach productionReal-time observability: Track production AI applications with monitoring and online scoringProduction-grade scale: Query, filter, analyze, and review logs 80x faster with Brainstore, our database purpose-built for AI workloadsModel flexibility: Compare and swap LLM providers using Braintrust's proxy without rewriting code

From the Vercel Marketplace listing, select Install. You will be prompted to create a new Braintrust account. On the next screen, select either the Free plan or the Pro installation plan and select Continue. Create a name for your Braintrust project in the Product Name field and select Create. This creates a Braintrust project and links it to your Vercel account.

From here, either select Done to go to your integration page or Add Drain to start sending logs to Braintrust.

In the Add Drain panel, select Traces and Next. Create a name for the drain and choose which Vercel projects you want to send traces to Braintrust. You can select All Projects or designate one or several specific projects. Adjust the sampling rate to designate what percentage of Vercel logs are sent to Braintrust.

Once you've added the integration, you need to configure OpenTelemetry on each project that's sending traces to Braintrust. In your Next.js project, create an instrumentation.ts file and call registerOtel. Check out the Vercel docs on initializing OTel for an example.

The Vercel AI Cloud enables developers to build, scale, and deploy modern web and AI apps. With the Braintrust integration, AI developers on Vercel can now:

    Add evals directly into their workflowsMonitor model quality and user experience across environmentsBenchmark across models from OpenAI, Anthropic, Mistral, Gemini, and moreManage accounts and billing in one place

You can add Braintrust to your Vercel project today. Check out our documentation, read customer stories on our blog, and bookmark Vercel's changelog for more updates.

Have questions or feedback? Join our Discord or book a demo.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

Braintrust Vercel AI AI评估 模型监控 可观测性 AI工程 Braintrust integration Vercel Marketplace AI evaluation model monitoring observability AI engineering
相关文章