OverviewWe are looking for a Senior Quality Engineer to help ensure the reliability, safety, and business correctness of AI-powered billing and collections workflows.
This role focuses on AI agents, evaluations, integrations, backend services, APIs, event-driven workflows, and production observability.
The person will help define what "good" looks like for AI-enabled workflows, build automated evaluations that detect meaningful regressions, investigate failures across application behavior and cloud evidence, and create confidence as changes move quickly from refinement through production.
This is not primarily a browser automation or end-of-cycle manual testing role.
Browser-based end-to-end coverage is important, but the core of this position is validating AI-agent behavior and the financial, operational, and integration workflows around it.
The idóneo candidate is comfortable working with imperfect requirements, non-deterministic AI behavior, external systems, asynchronous processing, and high-consequence workflows where incorrect outputs can affect invoices, collections activity, customer experience,



or operational decisions.ResponsibilitiesDefine what "good" looks like for AI-enabled workflows and production quality.Build automated evaluations that detect meaningful regressions in AI agents, integrations, and workflows.Investigate failures across application behavior and cloud evidence to determine root causes.Establish confidence as changes move from refinement through production, including observability and monitoring for AI-powered processes.Focus on validating AI-agent behavior, financial and operational workflows, and integration points (backend services, APIs, event-driven processes).
QualificationsExperience with quality engineering for AI-enabled systems and complex, high-consequence workflows.Ability to work with imperfect requirements and non-deterministic AI behavior.Familiarity with external systems, asynchronous processing, and production observability.Understanding that outputs can impact invoices, collections activity, customer experience, or operational decisions.
#J-*****-Ljbffr

📌 Quality Engineer - Ai Agents, Evals & Integrations (Bogotá)
🏢 Cafeto Software USA
📍 Bogotá