Save Job
Posted 2w ago

Software Engineer

@ Mastek
India
OnsiteFull Time
Responsibilities:designing tests, building harnesses, validating integrations
Requirements Summary:3-7 years experience testing AI-native applications and enterprise AI workflows; expertise in AI testing strategies, automation frameworks, API validation, cloud-native testing, and observability.
Technical Tools Mentioned:AWS Bedrock, Amazon Q Developer, AWS Kiro/Cairo, Claude, OpenAI, GitHub Copilot, LangChain, LangGraph, Postman, SoapUI, SQL, Python, Docker, Kubernetes, Azure DevOps, GitHub Actions
Save
Mark Applied
Hide Job
Report & Hide
Job Description

Exp-3-7 years


Role Summary


We are looking for a highly skilled QA Engineer specializing in AI-enabled systems, intelligent automation, and enterprise AI validation. The role involves testing AI-native applications, AI agents, orchestration workflows, cloud-integrated systems, and AI-assisted SDLC solutions across multiple delivery tracks including CGS, SDS, ETL, modernization, APIs, cloud-native systems, and legacy platforms.


The ideal candidate should possess strong expertise in AI testing strategies, automation frameworks, cloud-native testing, API validation, AI harness creation, and scalable deployment validation.




Key Responsibilities



  • Design and execute testing strategies for AI-native applications, AI agents, and enterprise AI workflows.

  • Build AI testing harnesses and automated validation frameworks for LLM-based systems.

  • Validate RAG pipelines, prompt flows, agent orchestration, APIs, and enterprise integrations.

  • Perform functional, integration, regression, security, and performance testing for AI-enabled systems.

  • Validate AI agent behavior, hallucination risks, guardrails, prompt responses, and orchestration reliability.

  • Work with AI-assisted testing ecosystems including Amazon Q Developer, AWS Kiro/Cairo, GitHub Copilot, Claude, OpenAI, and related tools.

  • Support testing and validation of scalable deployments across Docker, Kubernetes, and cloud-native environments.

  • Collaborate with developers, architects, DevOps teams, and business stakeholders to ensure production readiness.

  • Support continuous testing within Azure DevOps/GitHub CI/CD pipelines.

  • Drive observability, logging validation, monitoring validation, and runtime issue analysis for AI workloads.




Required Technical Skills


AI & Automation Ecosystem



  • Hands-on exposure to:


    • AWS Bedrock

    • Amazon Q Developer

    • AWS Kiro/Cairo

    • Claude/OpenAI ecosystems

    • GitHub Copilot


  • Understanding of:


    • AI agents

    • RAG architectures

    • Prompt engineering

    • Vector databases

    • LangChain/LangGraph

    • AI orchestration workflows



QA & Automation Expertise



  • Strong experience in:


    • API testing

    • Automation testing

    • Functional testing

    • Regression testing

    • Integration testing

    • Data validation


  • Hands-on with:


    • Postman

    • SoapUI

    • SQL

    • Python

    • AI testing harnesses

    • Test automation frameworks



Cloud & Platform Knowledge



  • Understanding of:


    • AWS cloud ecosystem

    • Docker containerization

    • Kubernetes orchestration

    • CI/CD pipelines

    • Azure DevOps

    • GitHub Actions

    • Cloud-native deployments



Security & Governance



  • Understanding of:


    • IAM/security concepts

    • AI guardrails

    • Prompt security

    • Enterprise governance

    • Runtime monitoring and observability





Mandatory Practical Experience



  • Must demonstrate hands-on testing experience for AI-enabled enterprise applications and AI agents.

  • Experience validating AI workflows, orchestration pipelines, and enterprise integrations.

  • Must have worked on automation-heavy delivery environments and AI-assisted SDLC ecosystems.

  • Experience validating scalable deployments across containerized/cloud-native environments.

  • Strong troubleshooting, analytical, and stakeholder communication capabilities.

  • High learning agility with ability to rapidly adapt to evolving AI ecosystems and enterprise technology stacks.