As foundation models begin to plateau in raw capability, the frontier is shifting toward building reliable systems: how agents are designed, deployed, evaluated, and improved in real-world environments.

Agents introduce new layers of complexity: orchestration, memory, tool use, and multi-step reasoning. But without robust evaluation, feedback loops, and human-in-the-loop systems, even the most promising agents fail in production.

The next wave of progress won’t come from better models alone, but from how we operationalize them.

Join us for a closed-door conversation with leaders building and deploying agentic systems across research, startups, and enterprise.

Speakers:
Aman Mehta - Senior Researcher at Snowflake. Connect with Aman
Pratik Mehta - GenAI Architect at NVIDIA. Connect with Pratik.
Other Panelists TBA

Moderator:
Viviana Márquez - DevRel Engineer, Prolific. Connect with Viviana.

Together, we’ll explore what it takes to move from demos to durable systems: how agents are evaluated, where they break, and how feedback, data, and infrastructure come together to make them reliable at scale.

Topics will include:

Designing agentic workflows and orchestration systems
Evaluating multi-step reasoning and tool use
Human-in-the-loop feedback and reward design
Failure modes in production and how to mitigate them
Building scalable evaluation pipelines for agents

Agenda:

5:00 – 6:00 — Arrival, networking, and refreshments
6:00 – 6:10 — Welcome and introductions
6:10 – 7:00 — Panel
7:00 – 8:30 — Networking

Attendance is limited and curated. Requests will be reviewed.

About the hosts:

Prolific powers high-quality human data for model evaluation and training. Learn more about Prolific.

AI Circle curates high-agency operators across research, startups, and enterprise. Learn more about AI Circle.

Our event will be hosted at the SignalFire office in SF. They raised a $1B fund last year focused on AI and data. Learn more about SignalFire.

Limited capacity.
Apply to attend.

Marketing Disclaimer

By submitting this form, you agree to receive marketing communications from SignalFire. You can unsubscribe at any time by clicking on the unsubscribe link at the bottom of our emails. See our privacy policy available on our website.

Operationalizing Agents with Prolific and AI Circle