Jobs › Caterpillar

This position has closed. Caterpillar removed this listing from their careers page on Oct 5, 2026. The interview prep below is still useful, and there are similar open roles at the bottom of this page.

Senior Manager, Software Test Engineering

Caterpillar · Chicago, IL · $159,120–$258,570 a year · Full time

Posted Sep 25, 2026 · We last checked this listing on Oct 4, 2026

Likely interview questions for this role

Written from this job description, not a generic list. Each one notes what the interviewer is really checking.

About your past

Tell me about a time you built a test organization or significantly changed how one worked.

What they are checking: Leadership experience shaping a team's practices, structure and culture at scale.

Tell me about a serious defect that reached the field on your watch. What did you change?

What they are checking: Ownership and learning from failure without blaming individual engineers.

What would you do

A program leader wants to skip part of your test plan to hit a customer date. What do you do?

What they are checking: Whether they can protect safety and quality under pressure while offering options grounded in risk.

How do you get development teams to treat quality as their job, not just the test team's job?

What they are checking: Ability to influence engineering culture so testing shifts left instead of piling up at the end.

About the work

How would you define an end-to-end testing strategy for AI and autonomy software that runs on heavy machines?

What they are checking: Whether they can lay out frameworks, tooling, quality gates and automation for systems where failures can hurt people.

How do you test a system whose outputs aren't always the same, like an AI model or a perception stack?

What they are checking: Understanding of statistical, scenario-based and simulation testing when exact expected results don't exist.

What quality gates would you require before autonomy software goes onto a machine at a customer site?

What they are checking: Clear, defensible release criteria that balance safety, coverage and the need to ship.

How have you used AI tools to improve software testing itself?

What they are checking: Real experience using AI for test generation or triage, since the posting asks this leader to build such tools.

How do you balance simulation testing with real-world testing on machines?

What they are checking: Judgment about what simulation can prove and when only physical testing gives enough confidence.

How do you measure whether your test strategy is actually working?

What they are checking: Whether they track escaped defects, coverage and cycle time, and act on what those numbers show.

Practice this interview out loud.

Offer builds a real interview for this exact role at Caterpillar from your resume and this job description, asks the questions one at a time, and tells you what landed. The first one is free.

Practice this out loud

The full job description

As published by Caterpillar.

Career Area: Technology, Digital and Data Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it. Job Summary: Caterpillar is seeking a Senior Manager of Test Engineering to lead a critical program supporting the company’s AI and autonomy efforts. In this role, you will shape the test strategy, quality standards, and execution model for intelligent systems that power the next generation of connected, autonomous, and software-defined machines. This leader will guide cross-functional teams through complex technical challenges, build AI tools that improve software testing products, advance modern test automation and AI-enabled quality practices, and ensure Caterpillar delivers safe, reliable, and scalable technology for customers working in the world’s most demanding environments. What You Will Do: • Define and own the end‑to‑end AI testing strategy, including frameworks, tooling, quality gates, and automation approaches for machine‑learning and traditional software systems. • Lead, mentor, and develop a team of software test leads, setting clear expectations, elevating technical depth, and fostering a culture of quality engineering excellence. • Architect scalable AI test solutions, such as model‑validation pipelines, data‑quality checks, bias and drift detection, and performance benchmarking for AI/ML models. • Partner with engineering, product, and data science leaders to align testing practices with roadmap priorities, ensuring AI features meet reliability, safety, and compliance standards. • Drive continuous improvement across test operations, introducing modern automation, observability, and tooling that increase coverage, speed, and defect detection accuracy. • Establish governance and best practices for AI quality, including documentation standards, risk assessments, and audit‑ready processes for regulated or high‑impact systems. What You Will Have: • Organizational Leadership: Knowledge of leadership concepts and ability to use strategies and skills to enlist others in setting, embracing and achieving objectives. • Software Development: Knowledge of software development tools and activities; ability to produce software products or systems in line with product requirements. • Software Development Life Cycle: Knowledge of software development life cycle; ability to use a structured methodology for delivering and managing new or enhanced software products to the marketplace. • Software Integration Engineering: Knowledge of software integration processes and functions; ability to design, develop and maintain interfaces and linkage to alternative platforms and software packages. • Software Test Architecture: Knowledge of software product design; ability to convert market requirements into the software product design. • Software Quality Assurance and Testing: Knowledge of software quality assurance and testing; ability to apply appropriate processes, tools, and techniques for assuring a high level of quality in computer software products and systems. Top candidates will also have: • Background: Typical candidate will have 15+ years of software engineering experience with 7+ years leading test engineering teams • Gen AI Assisted Development: Practical experience leveraging AI-assisted development tools (such as GitHub Copilot or automated agent workflows) to accelerate code generation, boilerplate reduction, and automated testing across multiple teams. Demonstrated experience with AI Test architecture • Managing Managers: Demonstrated ability to lead and develop engineering managers, setting clear expectations, coaching through complexity, and ensuring consistent execution, talent growth, and accountability across multiple teams. • Vision & Execution at Scale: Proven ability to set a clear platform and engineering vision and drive multiple complex initiatives in parallel through a large organization of 30+ software test engineers, aligning teams, managing dependencies, and delivering outcomes with consistency and accountability. • Experience with tools such as Java, AWS bedrock, playwright, karat, ect.. Additional Details: • This position requires the candidate to be based in Chicago, IL • Relocation assistance is NOT available for this position • Visa sponsorship is NOT available for this position Summary Pay Range: $159,120.00 - $258,570.00 Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar. Benefits: Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits. • Medical, dental, and vision benefits* • Paid time off plan (Vacation, Holidays, Volunteer, etc.)* • 401(k) savings plans* • Health Savings Account (HSA)* • Flexible Spending Accounts (FSAs)* • Health Lifestyle Programs* • Employee Assistance Program* • Voluntary Benefits and Employee Discounts* • Career Development* • Incentive bonus* • Disability benefits • Life Insurance • Parental leave • Adoption benefits • Tuition Reimbursement * These benefits also apply to part-time employees Visa Sponsorship is not available for this position. Posting Dates: September 25, 2026 - October 4, 2026 Any offer of employment is conditioned upon the successful completion of a drug screen. Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply. Not ready to apply? Join our Talent Community .