What's Next in Voice AI Infrastructure?

Welcome back, and hello to our new readers! We've grown the newsletter quite a bit since its conception to over 600 Voice AI enthusiasts. We here at Bluejay warmly and excitedly welcome you to the Voice AI community :)

As a recap:

1. Bluejay is a testing and monitoring platform for Conversational AI agents. Companies ranging from Fortune 10 enterprises to fast-growth startups in the Silicon Valley use Bluejay to make sure their voice and text agents work in production (monitoring) and development (testing) environments.
2. Our team, now seven strong, works around the clock to make sure your agent behaves when talking to customers.
3. This newsletter is 100% human written. It always has been, and it always will be. Ask yourself about what you are consuming. If the writer hasn't read it, why should you?

We hosted a deeply technical event earlier this week with Deepgram, Daily/Pipecat, and Parakeet Health, hosted at Obvious Ventures, to talk about Voice AI Infrastructure. Here's what the audience learned:

Kwin, Founder of Daily, described the mental framework he, and therefore, Pipecat, uses to create multi-agent flows: State Machines. He explained how agents can be broken down into a series of states, where each state has a system prompt and access to a select set of tools. It makes sense to break down multi-step workflows into these states to reduce the likelihood of any single agent hallucinating.

Natalie, VP of Product at Deepgram, shed some light on why the interruption problem in Voice AI is so hard: voice agents do not have access to the visual modality. They aren't able to perceive subtle head nods, active body language, or a subtle raise of the chin that humans do to visually indicate that they want to speak.

Aaron, CTO at Parakeet Health, told a story about how some patients liked the Parakeet agent so much that they would go wildly off-topic, and their agent would have to handle scenarios that were totally unrelated to the call intent without being rude.

I talked about what an A+ evaluation suite looks like for builders who want to maintain a high quality bar: simulations that test each flow, feature, tool call, and customer scenario. Varied audio qualities, background noises, and levels of interruptions. Production observability that monitors every call and runs customized, post-call evals. Alerts that notify you of production failures. The works!

This is what I love about the Voice AI community. Everyone is so passionate, excited, and willing to share their learnings. Audience members asked amazing questions, people mingled for hours after the event ended (we had to migrate everyone outside!!), and new friendships were made! The Voice AI community is growing, and we're so happy to facilitate its growth here at Bluejay. After all, it plays directly into our mission:

Announcements

Here's what happened at Bluejay last week:

• Bluejay hosted a meetup Advances in Voice AI Infrastructure Meetup with Deepgram, Daily / Pipecat, and Parakeet Health with attendees from all corners of the SF Voice AI community. This was Abhived's first time hosting the panel, and he absolutely killed it!
• Rohan flew to Chicago to represent Bluejay at an enterprise conference and made some waves. We've thought since the beginning that Conversational AI evals is a no-brainer; we are glad others see it this way, too.
• Yash went to an invite-only enterprise dinner representing Bluejay and came back with a huge lead – go Yash!
• Last week, the team pushed 44,645 lines of code to make Conversational AI reliable.

Feature Spotlight: Redesigned Docs!

We recently released a redesigned documentation platform. This one was a long time coming. You can now chat with Bluejay's docs via an AI assistant, learn how to use Bluejay via Bluejay University (with four courses and counting!), and stay up-to-date via our Changelog (RSS-feed enabled!). The best part? All of our API endpoints have copy-able prompts for AI agents to one-shot integrate into your codebase.

Nifty, right?

Coming Soon

• Bluejay MCP: Bluejay will soon be accessible to all AI agents via MCP!
• Redesigned Workflow Builder: Our new workflow builder, equipped with a descriptive action suite for Agents and Digital Humans, will be released this week!

That's all for now. I'll see you next time!

Faraz Siddiqi
Co-Founder & CTO @ Bluejay