Quito Applaudo
About you
You are an engineer passionate about building reliable, observable, and secure AI systems at scale. You enjoy working at the intersection of product metrics, evaluation frameworks, and production-grade infrastructure.

You are comfortable translating abstract KPIs into measurable signals, designing deployment safeguards, and ensuring AI systems behave safely, efficiently, and consistently in real-world environments.


You thrive in fast-paced, cloud-native environments, value automation and rigor, and enjoy collaborating with product, engineering, and AI teams to continuously improve system quality.


You bring to Applaudo the following competencies:
Bachelor's degree in computer science, Software Engineering, Computer Engineering, or related field — or equivalent professional experience.
Strong experience with AI/ML evaluation, including metric definition, evaluation pipelines, golden datasets, and automated judge systems.
Proficiency in observability and monitoring, including structured logging, tracing, and OpenTelemetry.
Solid background in CI/CD automation and modern deployment strategies (canary, blue-green, gated deployments).
Knowledge of AI safety practices, including PII scrubbing, deterministic guardrails, and secure handling of model inputs and outputs.
Experience working with multi-agent systems and translating product KPIs into measurable agent performance metrics.
Hands-on experience with AWS, including CDK, ECS/ECR, WAF, SES, Bedrock, CloudWatch, and DevOps Guru.
Strong experience with Docker, Kubernetes, and cloud-native tooling.
Familiarity with Azure for identity management and basic exposure to GCP environments.
Strong analytical thinking, attention to detail, and problem-solving skills.
Excellent communication skills to collaborate across product, platform, and AI teams.
English proficiency required for collaboration with global stakeholders.

You will be accountable for the following responsibilities:
Translate product KPIs into measurable agent and system-level metrics for effectiveness, efficiency, robustness, and safety.
Design and implement end-to-end observability using structured logging, metrics, and tracing with OpenTelemetry.
Curate and maintain golden datasets and manage judge systems for scalable, repeatable AI evaluation.
Implement evaluation-gated deployments within CI/CD pipelines.
Orchestrate pre-merge and post-merge validation workflows to ensure quality before release.
Apply canary and blue-green deployment strategies, enabling fast and safe rollbacks.
Enforce layered security controls, including PII scrubbing, deterministic guardrails, and AI-based filtering of inputs and outputs.
Monitor and analyze latency, error rates, token usage, and cost metrics across AI systems.
Track production quality indicators such as correctness, relevance, and helpfulness.
Convert failures, incidents, and negative feedback into automated regression tests.
Manage multi-agent interoperability and coordination across AI components.
Continuously update and adapt guardrails and safety controls as new risks and threats emerge.

Additional Information
Here at Applaudo Studios values as trust, communication, respect, excellence and teamwork are our keys to success. We know we are working with the best and thus treat each other with respect and admiration without asking.

Submit your application today, and don't miss this opportunity to join the Best Digital team in the Region


We truly appreciate all the hard and outstanding work our team makes every day at Applaudo Studios, and that's why the perks that we offer, are deeply thought and designed as a way to thank them for their commitment and excellence.


Some of our perks and benefits:
Celebrations
Special discounts*Entertainment area*Modern Workspaces*Great work environment
Private medical insurance**Benefits may vary according to your location and/or availability. Request further information when applying.
Show more Show less

  • Quito Applaudo $60.000 - $120.000 per year

    We are looking for an engineer passionate about building reliable, observable, and secure AI systems at scale. You will be accountable for translating product KPIs into measurable agent and system-level metrics. ...


  • Quito Springer Capital $105.000 - $180.000 per year

    The role involves developing AI/ML models for business intelligence automation analyzing real estate investment data extracting insights using data science tools researching implementing machine learning algorithms techniques supporting building predictive models related to asset ...


  • Quito Source Meridian Full time$100.000 - $120.000 per year

    We're looking for a Senior Data Engineer to join Source Meridian, and you could be the perfect fit. · 4+ years of experience as a data engineer · Spark · Python · SQL · Airflow · AWS/GCP · DataBricks · Git · Permanent contract · A culture of learning and continuous growth · ...


  • Quito Source Meridian Full time

    We're looking for a Senior Full Stack Developer to join Source Meridian and you could be the perfect fit. Source Meridian is a development software company that works to solve the industry's most challenging problems in healthcare practices. We are laser-focused on specific techn ...


  • Quito Kin Analytics $30.000 - $60.000 per year

    We are seeking a student in the final semesters of Data Science, Engineering, Economics, or related fields, interested in exploring the intersection between data, technology, and business. · As a Sales and Data Science Intern, you will have the opportunity to work closely with a ...


  • Quito Scale Up Recruiting Partners $100.000 - $150.000 per year

    We are looking for a visionary AI Experience Engineer to own the end-to-end design and development of AI-powered internal tools. · Architect and design core GenAI user experiences including chat agents, summarization tools, document interfaces, and context-aware workflows. · Deve ...

  • Senior Data Engineer

    hace 3 semanas


    Quito Talan $40.000 - $80.000 per year

    We are looking for a Senior Data Engineer to join our dynamic and ambitious team. The successful candidate will participate in Markets Data Hub tasks as a Data Engineer in the definition and automation of processes developed using Big Data technologies. · Min 5 years experience: ...

  • Senior Data Engineer

    hace 3 semanas


    Quito Talan Full time$40.000 - $80.000 per year

    Participation in Markets Data Hub tasks as a Data Engineer in the definition and automation of processes developed using Big Data technologies (Spark Scala, Databricks, Airflow) in Market Risk. · Min 5 years experience: Experience in technology-related projects, High knowledge of ...


  • Quito Source Meridian Full time$60.000 - $120.000 per year

    Seeking a senior backend engineer to help integrate our AI engagement-call agent into modern contact center platforms. · Build and scale backend services in AWS using Python and .NET Core. · Integrate our AI agent with Zoom Contact Center and Twilio, handling call flows, call con ...

  • 113. Mid QA Automation

    hace 2 meses


    Quito Source Meridian Full time$15.000 - $30.000 per year

    We're looking for a Mid QA Automation to join Source Meridian, and you could be the perfect fit. Source Meridian is a software development company dedicated to solving the most challenging problems in the healthcare industry. We specialize in healthcare technology, artificial int ...


  • Quito Source Meridian Full time$30.000 - $60.000 per year

    We're looking for a Tech Customer Success to join Source Meridian and you could be the perfect fit. Source Meridian is a development software company that works to solve the industry's most challenging problems in healthcare practices. We are laser-focused on specific technologie ...

  • Technical Author

    hace 1 mes


    Quito TripleTen Part time$40 - $85

    Nebius Academy is an educational platform that helps experienced software developers stay at the forefront of technological innovation. We create specialized courses that teach professionals how to effectively use AI tools in real-world development workflows. · Collaborate with u ...

  • Technical Author

    hace 1 mes


    Quito TripleTen Part time$40 - $85

    We are seeking experienced developers and technical experts (5+ years) with hands-on AI tools experience, a proven track record in tech leadership or mentoring, and the ability to explain complex concepts clearly. · We are looking for someone who is fluent in English, detail-orie ...


  • Quito PwC Internship$30.000 - $60.000 per year

    Estudiantes de últimos niveles de carreras relacionadas a Contabilidad y Auditoria, Administración de Empresas, Economía, Finanzas. Con disponibilidad para realizar sus pasantías 30 horas semanales. · Apoyar al equipo de Auditoría en la ejecución de tareas y procesos de auditoría ...

  • Technical Author

    hace 1 mes


    Quito TripleTen Part time$40 - $85

    Nebius Academy is an educational platform that helps experienced software developers stay at the forefront of technological innovation. We create specialized courses that teach professionals how to effectively use AI tools in real-world development workflows. · Collaborate with u ...

  • Technical Author

    hace 1 mes


    Quito TripleTen Part time$40 - $85

    Nebius Academy is an educational platform that helps experienced software developers stay at the forefront of technological innovation. We create specialized courses that teach professionals how to effectively use AI tools in real-world development workflows. · We are seeking exp ...

  • Technical Author

    hace 1 mes


    Quito TripleTen Part time$40 - $85

    Nebius Academy is an educational platform that helps experienced software developers stay at the forefront of technological innovation. We create specialized courses that teach professionals how to effectively use AI tools in real-world development workflows. · Collaborate with u ...

  • Technical Author

    hace 1 mes


    Quito TripleTen Part time$40 - $85

    Nebius Academy is an educational platform that helps experienced software developers stay at the forefront of technological innovation. We create specialized courses that teach professionals how to effectively use AI tools in real-world development workflows. · Collaborate with u ...

  • Account Executive

    hace 2 semanas


    Quito TripleTen Full time$3.000 - $4.000

    As an Account Executive supporting the LATAM market you will play a pivotal part in the growth team's success in scaling our prospective customer base, finding promising market needs, improving our customer acquisition funnel, and increasing the number of clients. · Manage the fu ...

  • Account Executive

    hace 2 semanas


    Quito TripleTen $3.000 - $4.000

    We help companies in Argentina and across the region adopt Artificial Intelligence at scale with programs designed for both technical teams and business teams. As an Account Executive supporting the LATAM market you will play a pivotal part in the growth team's success in scaling ...

  • BIA Tutor

    hace 2 meses


    Quito TripleTen $20.000 - $30.000 per year

    As an Instructor you will be a core part of students' educational process and will host regular live Q&A sessions to help students unblock and progress confidently, offer personalized support through 1:1 video calls to answer questions and guide assignments, occasionally respond ...