You are an engineer passionate about building reliable, observable, and secure AI systems at scale. You enjoy working at the intersection of product metrics, evaluation frameworks, and production-grade infrastructure.
You are comfortable translating abstract KPIs into measurable signals, designing deployment safeguards, and ensuring AI systems behave safely, efficiently, and consistently in real-world environments.
You thrive in fast-paced, cloud-native environments, value automation and rigor, and enjoy collaborating with product, engineering, and AI teams to continuously improve system quality.
You bring to Applaudo the following competencies:
Bachelor's degree in computer science, Software Engineering, Computer Engineering, or related field — or equivalent professional experience.
Strong experience with AI/ML evaluation, including metric definition, evaluation pipelines, golden datasets, and automated judge systems.
Proficiency in observability and monitoring, including structured logging, tracing, and OpenTelemetry.
Solid background in CI/CD automation and modern deployment strategies (canary, blue-green, gated deployments).
Knowledge of AI safety practices, including PII scrubbing, deterministic guardrails, and secure handling of model inputs and outputs.
Experience working with multi-agent systems and translating product KPIs into measurable agent performance metrics.
Hands-on experience with AWS, including CDK, ECS/ECR, WAF, SES, Bedrock, CloudWatch, and DevOps Guru.
Strong experience with Docker, Kubernetes, and cloud-native tooling.
Familiarity with Azure for identity management and basic exposure to GCP environments.
Strong analytical thinking, attention to detail, and problem-solving skills.
Excellent communication skills to collaborate across product, platform, and AI teams.
English proficiency required for collaboration with global stakeholders.
You will be accountable for the following responsibilities:
Translate product KPIs into measurable agent and system-level metrics for effectiveness, efficiency, robustness, and safety.
Design and implement end-to-end observability using structured logging, metrics, and tracing with OpenTelemetry.
Curate and maintain golden datasets and manage judge systems for scalable, repeatable AI evaluation.
Implement evaluation-gated deployments within CI/CD pipelines.
Orchestrate pre-merge and post-merge validation workflows to ensure quality before release.
Apply canary and blue-green deployment strategies, enabling fast and safe rollbacks.
Enforce layered security controls, including PII scrubbing, deterministic guardrails, and AI-based filtering of inputs and outputs.
Monitor and analyze latency, error rates, token usage, and cost metrics across AI systems.
Track production quality indicators such as correctness, relevance, and helpfulness.
Convert failures, incidents, and negative feedback into automated regression tests.
Manage multi-agent interoperability and coordination across AI components.
Continuously update and adapt guardrails and safety controls as new risks and threats emerge.
Additional Information
Here at Applaudo Studios values as trust, communication, respect, excellence and teamwork are our keys to success. We know we are working with the best and thus treat each other with respect and admiration without asking.
Submit your application today, and don't miss this opportunity to join the Best Digital team in the Region
We truly appreciate all the hard and outstanding work our team makes every day at Applaudo Studios, and that's why the perks that we offer, are deeply thought and designed as a way to thank them for their commitment and excellence.
Some of our perks and benefits:
Celebrations
Special discounts*Entertainment area*Modern Workspaces*Great work environment
Private medical insurance**Benefits may vary according to your location and/or availability. Request further information when applying.
Show more Show less
-
AgentOps (Artificial Intelligence Engineer)
hace 4 semanas
Quito Applaudo $60.000 - $120.000 per yearWe are looking for an engineer passionate about building reliable, observable, and secure AI systems at scale. You will be accountable for translating product KPIs into measurable agent and system-level metrics. ...
-
Quito Springer CapitalWe are seeking a Data Scientist to assist in developing and refining AI/ML models for business intelligence and automation. · ...
-
Mid–Senior Machine Learning Engineer
hace 2 semanas
Quito Prex Technologies $60.000 - $80.000 per yearEste rol requiere una mentalidad altamente analítica, dominio técnico y experiencia construyendo modelos que escalan en producción. · ...
-
Senior Data Engineer
hace 2 meses
Quito Talan Full time$40.000 - $80.000 per yearParticipation in Markets Data Hub tasks as a Data Engineer in the definition and automation of processes developed using Big Data technologies (Spark Scala, Databricks, Airflow) in Market Risk. · Min 5 years experience: Experience in technology-related projects, High knowledge of ...
-
Senior Data Engineer
hace 2 meses
Quito Talan $40.000 - $80.000 per yearWe are looking for a Senior Data Engineer to join our dynamic and ambitious team. The successful candidate will participate in Markets Data Hub tasks as a Data Engineer in the definition and automation of processes developed using Big Data technologies. · Min 5 years experience: ...
-
123. Senior Kotlin Multiplatform Mobile Engineer (KMP)
hace 3 semanas
Quito Source Meridian Full time$40.000 - $50.000 per year· We're looking for a Senior Kotlin Multiplatform Mobile Engineer (KMP) to join Source Meridian — and you could be the perfect fit · Build and maintain a Kotlin Multiplatform Mobile (KMP) codebase targeting Android and iOS. · Develop UI and screens using Compose / Compose Multip ...
-
118. Senior Backend Engineer
hace 2 meses
Quito Source Meridian Full time$60.000 - $120.000 per yearSeeking a senior backend engineer to help integrate our AI engagement-call agent into modern contact center platforms. · Build and scale backend services in AWS using Python and .NET Core. · Integrate our AI agent with Zoom Contact Center and Twilio, handling call flows, call con ...
-
Ingeniero SMO
hace 4 semanas
Quito Devsu $120.000 - $180.000 per yearBuscamos un Ingeniero SMO altamente capacitado para unirse a nuestro equipo de operaciones tecnológicas. · ...
-
120. Middle Tech Customer Success
hace 2 meses
Quito Source Meridian Full time$30.000 - $60.000 per yearWe're looking for a Tech Customer Success to join Source Meridian and you could be the perfect fit. Source Meridian is a development software company that works to solve the industry's most challenging problems in healthcare practices. We are laser-focused on specific technologie ...
-
Account Executive
hace 1 mes
Quito TripleTen Full time$3.000 - $4.000As an Account Executive supporting the LATAM market you will play a pivotal part in the growth team's success in scaling our prospective customer base, finding promising market needs, improving our customer acquisition funnel, and increasing the number of clients. · Manage the fu ...
-
Account Executive
hace 1 mes
Quito TripleTen $3.000 - $4.000We help companies in Argentina and across the region adopt Artificial Intelligence at scale with programs designed for both technical teams and business teams. As an Account Executive supporting the LATAM market you will play a pivotal part in the growth team's success in scaling ...
-
Training Leagues AI Native
hace 7 días
Quito Sofka TechnologiesBienvenido a este equipo con propósito claro: "TRANSFORMAR la vida de las personas siendo el aliado TECNOLÓGICO más confiable" · Prepárate y únete a esta aventura · ...
-
QA Automation Engineer
hace 1 mes
Quito Devsu Full time$3.500 - $8.000 per year+En Devsu estamos buscando un QA Engineer con sólida experiencia para garantizar la calidad e implementar automatización. · ++Capacidad para trabajar en equipo. · Pensamiento analítico. · ...
-
QA Automation Engineer
hace 1 mes
Quito Devsu $45.000 - $70.000 per yearEn Devsu estamos buscando un QA Engineer con experiencia sólida en pruebas manuales automatización para garantizar la calidad estabilidad correcto funcionamiento aplicaciones web modernas. · ...
-
Conversational Designer
hace 2 semanas
Quito OneSeven Tech (OST) $10.000 - $14.400 per yearWe're looking for a Conversational Designer to craft clear, natural, and effective AI-driven conversations. · 3+ years of experience in Conversational Design, UX Writing, or CopywritingAcademic background in Humanities (Linguistics, English, Literature,) with the ability to apply ...
-
Functional Analyst
hace 4 semanas
Quito NEORIS $60.000 - $120.000 per yearWe are looking for a Functional Expert – Transactional Switch to work closely with development teams and implement a new Transactional Switch, ensuring accurate documentation and process mapping for payment-related operations. · Collaborate with development teams on the implement ...
-
Functional Expert – Transactional Switch
hace 2 meses
Quito NEORIS Full time$40.000 - $80.000 per yearWe are looking for a Functional Expert to implement a new Transactional Switch, ensuring accurate documentation and process mapping for payment-related operations. · Collaborate with development teams on the implementation of a new Transactional Switch. · Gather and document proc ...
-
Site Reliability Engineer
hace 2 meses
Quito myCloudDoor $40.000 - $80.000 per yearBuscamos un Site Reliability Engineer con experiencia en automatización y observabilidad para trabajar en uno de nuestros principales clientes en modalidad freelance. Se requiere experiencia en scripting, procesos de automatización, Cloud, Grafana, Application Insights, OpenTelem ...
-
Crypto Senior UI/UX Engineer
hace 2 semanas
Quito Token MetricsWe are looking for a dynamic Senior UI/UX Engineer who will be responsible for the UI and UX design of our various digital assets. The job requires designing adaptive solutions to UI/UX problems by staying up to date with best practices and emerging trends in user experience desi ...
-
Data and Insight Engineer
hace 2 meses
Quito Nearsure $80.000 - $120.000 per yearAs a Sr Data and Insight Engineer, you will play a pivotal role in ensuring the accuracy, reliability, and accessibility of our data, enabling the organization to derive meaningful insights and make informed decisions. · Collaborate with cross-functional teams to understand data ...
-
Sr. AI
hace 2 meses
Quito North Highland $40.000 - $80.000 per yearAs the world's leading change and transformation consultancy, we're helping businesses move from strategy to reality by taking a pragmatic and practical approach to build solutions that last. · We're seeking a Sr. AI & Data Engineer in Quito to help us take vision to value and cr ...
