I break systems — so they come back stronger

Vinay B R

AI Engineer AI QA & Test Automation

I bring rigorous testing discipline to building and validating AI systems — agents, RAG pipelines, and LLM-powered products that behave reliably, accurately, and safely in production.

4+Years Experience
3Industry Awards
60%Faster Regression Suites
40%Faster Test Creation via LLMs
Resume (PDF) Contact Me
Scroll
Vinay B R

About

From breaking systems to building them.

I'm an AI Quality Engineer with 4 years of experience spanning automation testing, software development, and testing AI agents & LLM-powered systems. Currently a Senior SDET at OpenText, previously at RedBus (MakeMyTrip Group) and Mindtree.

My career started in hardcore test engineering — Selenium grids, API frameworks, CI/CD pipelines, performance testing. That discipline taught me exactly how software breaks. As LLMs entered production systems, I moved to the frontier: evaluating AI agents for output accuracy, hallucination, tool-use reliability, and edge-case behavior — and building AI-powered tooling of my own.

That's my differentiator: I understand how AI systems are built and how they break. Most engineers pick a side — I bridge both, applying QA rigor (evaluation frameworks, quality gates, automation) to the non-deterministic world of agents, RAG pipelines, and prompt chains.

Dayananda Sagar College of Engineering

B.E. in Electronics and Instrumentation Engineering · 2017 – 2021

GPA: 9.10 / 10.0 · Bangalore, Karnataka

Focus areas

  • Testing AI Agents & Autonomous Systems
  • LLM Evaluation — hallucination detection, output accuracy, tool-use reliability
  • RAG Pipeline & Prompt Chain Validation
  • Agentic Decision Loop Testing
  • AI-Driven QA & Intelligent Test Generation
  • CI/CD Optimization

Experience

Where I've built and broken things

  1. OpenText

    Aug 2025 – Present

    Senior SDET (AI Quality Engineer) · Bangalore, KA

    ★ Best QA Award

    • Architected and delivered a production-grade end-to-end test framework within 4 days, fully integrated with CI/CD pipelines — recognized with the Best QA Award.
    • Designed scalable evaluation frameworks for testing AI agents and autonomous systems, covering output accuracy, hallucination detection, tool-use reliability, and edge-case behavior.
    • Built AI-assisted testing workflows using Claude, GitHub Copilot, and Cursor, accelerating test generation, code review, and debugging speed significantly.
    • Integrated AI model output validation (OpenAI, Claude, Gemini) into CI/CD quality gates for continuous LLM quality assurance.
    • Designed frameworks for testing complex microservices architectures and AI-driven system behaviors at scale.

  2. RedBus (MakeMyTrip Group)

    2022 – Aug 2025

    SDET (Automation, API & AI-Driven Testing) · Bangalore, KA

    ★ Technology Excellence Award — AI innovation on RailBot 2.0

    • Built an internal LLM-powered test case generator using prompt engineering, accelerating test creation by 40% and improving coverage quality.
    • Implemented n8n workflow automation for Auto Bug Creation with Smart Filtering, reducing manual triage effort and streamlining defect management.
    • Designed and deployed Test Data Management automation pipelines using n8n, enabling on-demand provisioning and cleanup across environments.
    • Optimized Jenkins-based CI/CD pipelines with Dockerized test environments, reducing deployment time by 50% and achieving a 95% reduction in manual intervention.
    • Engineered scalable parallel execution frameworks using Selenium Grid, reducing regression suite runtime by 60%.
    • Developed REST API testing frameworks using Postman and RestAssured, achieving 100% sanity coverage and reducing production API defects by 50%.
    • Built end-to-end mobile automation test suites with Appium, enabling cross-device testing with 100% sanity coverage across major devices.
    • Implemented performance and load testing with k6; verified async messaging via Kafka and RabbitMQ, ensuring 100% message integrity in distributed systems.

  3. Mindtree

    2021 – 2022

    Software Engineer · Bangalore, KA

    ★ CI/CD Excellence

    • Revamped Jenkins-based CI/CD pipelines by optimizing Docker layer caching and parallelizing test stages, reducing time-to-production by 30%.

Skills

Two disciplines, one toolkit

AI / LLM Engineering

  • AI Agent Evaluation
  • LLM Output Validation
  • Hallucination Testing
  • RAG Pipeline Testing
  • Prompt Engineering (CoT, Few-shot, Zero-shot)
  • LLM Observability
  • Function Calling
  • Embedding Models
  • LangChain
  • DeepEval
  • OpenAI API (GPT-4o)
  • Claude
  • Gemini
  • LLaMA
  • n8n

QA & Test Automation

  • Selenium & Selenium Grid
  • Playwright
  • Appium
  • TestNG
  • JUnit
  • RestAssured
  • Postman
  • JMeter
  • k6
  • CI/CD Quality Gates
  • Jenkins
  • Extent Reports

Languages, Backend & Cloud

  • Java
  • Python
  • SQL
  • FastAPI
  • Flask
  • Streamlit
  • REST APIs
  • MySQL
  • PostgreSQL
  • MongoDB
  • Docker
  • AWS
  • Kafka
  • RabbitMQ
  • Microservices
  • Git

Projects

Selected work

OpenText

AI Agent Evaluation Framework

Scalable evaluation framework for AI agents and autonomous systems — measuring output accuracy, hallucination rates, tool-use reliability, and edge-case behavior, wired into CI/CD as continuous LLM quality gates.

  • Python
  • OpenAI
  • Claude
  • Gemini
  • CI/CD

RedBus · Technology Excellence Award

RailBot 2.0 — AI in Test Automation

Award-winning application of AI/ML to test automation, recognized company-wide for cutting-edge AI innovation. [ADD DETAILS — what RailBot 2.0 does, your role, outcomes]

  • AI/ML
  • Test Automation
  • Python

RedBus

LLM-Powered Test Case Generator

Internal tool that generates test cases from requirements using prompt engineering — accelerated test creation by 40% and improved coverage quality across teams.

  • Prompt Engineering
  • OpenAI API
  • Python

RedBus

Auto Bug Creation with Smart Filtering

n8n workflow automation that files bugs automatically from failures with smart filtering, cutting manual triage effort and streamlining defect management end to end.

  • n8n
  • JIRA
  • Workflow Automation

RedBus

Test Data Management Pipelines

Automated test-data provisioning and cleanup pipelines built on n8n — on-demand, environment-aware data management that removed a chronic bottleneck for automation suites.

  • n8n
  • SQL
  • Automation

RedBus

Dockerized Parallel Test Infrastructure

Jenkins CI/CD pipelines with Dockerized test environments and Selenium Grid parallel execution — 50% faster deployments, 60% faster regression runs, 95% less manual intervention.

  • Docker
  • Jenkins
  • Selenium Grid
  • CI/CD

Contact

Let's talk about reliable AI

Building an AI product that has to work every time? That's the problem I love solving. Whether you're shipping agents, RAG pipelines, or LLM-powered features — or you need someone who can prove they actually work — I'd love to hear from you.

Emailvbr1058@gmail.com Phone+91 76194 15101 LinkedInlinkedin.com/in/vinay-b-r-8398a6191