Jobs › Direct Supply

Senior AI Engineer

Direct Supply · Milwaukee, WI · Full time

Posted Aug 21, 2026 · We last checked this listing on Oct 6, 2026

Apply at Direct Supply

Likely interview questions for this role

Written from this job description, not a generic list. Each one notes what the interviewer is really checking.

About your past

Tell me about an AI-enhanced application you led from design to production. What decisions did you own?

What they are checking: Real ownership of complex AI solutions, which the posting expects at senior level.

How do you mentor engineers who are new to building with AI?

What they are checking: Ability to raise a team's AI skills, which the posting lists as part of the role.

Tell me about a time you pushed for an AI-driven approach and the team was skeptical.

What they are checking: How they advocate for new methods while listening to legitimate concerns.

What would you do

How do you explain the financial trade-offs of an AI feature to business leaders?

What they are checking: Ability to connect model choices to costs and value, which the posting highlights.

An AI feature looks great in testing but users say the answers feel unreliable. How do you investigate?

What they are checking: Debugging approach for AI behavior gaps between test sets and real usage.

About the work

How do you decide between calling a hosted model, fine-tuning, or building a smaller custom model for a feature?

What they are checking: Architecture judgment on cost, quality, latency and maintenance trade-offs for AI features.

Walk me through how you would evaluate and monitor an AI feature that helps caregivers make decisions.

What they are checking: Rigor in testing AI where wrong answers could affect seniors' care.

What automation frameworks and AI development tools have changed how you build software, and how?

What they are checking: Hands-on depth with the AI tools the posting asks them to advocate for.

How do you handle data privacy and security when building AI on top of healthcare-related data?

What they are checking: Awareness of sensitive data handling, which matters in senior care settings.

How do you design AI-enhanced systems so they degrade gracefully when the model fails or is slow?

What they are checking: Reliability thinking that keeps the product usable when AI components misbehave.

Practice this interview out loud.

Offer builds a real interview for this exact role at Direct Supply from your resume and this job description, asks the questions one at a time, and tells you what landed. The first one is free.

Practice this out loud

The full job description

As published by Direct Supply.

Position Summary: Direct Supply is building the future of healthcare technology with industry-leading products, solutions and platforms to help improve the lives of millions of seniors and those who care for them. In the Senior AI Engineer position, you’ll lead the development of intelligent, adaptive, and scalable applications by leveraging AI-powered development tools, machine learning models, and automation frameworks. Beyond writing code, you will play a key role in setting technical direction, mentoring engineers, and driving AI-first software strategies. You’ll work on a cross-functional team dedicated to creating high-quality, scalable web-based products, mobile applications, or server-based systems. As a senior engineer, you will take ownership of complex AI-enhanced solutions, influence architectural decisions, and advocate for AI-driven development methodologies. Your leadership will help the team develop a deep understanding of business context, financial trade-offs, and the strategic impact of AI-powered solutions. Skills Needed: • Applies AI and Technology – Identifies opportunities to boost efficiency and add value using AI and tech. Embraces and applies digital innovations and tech solutions to build business. Eagerly learns and integrates new technologies where they matter most. • Champions Innovation – Propels teams to unlock value with cutting-edge, tech-enabled innovations. Stays ahead of the tech curve, ready to embrace the next big thing. Leads with an entrepreneurial mindset and takes calculated risks. • Leads Through Change & Ambiguity – Navigates the unknown with confidence, steering through change and uncertainty with a clear vision and unwavering determination. • Ability to mentor and lead engineers in AI-first development methodologies, fostering a culture of innovation and technical excellence. • Technical expertise in AI integration across natural language processing, computer vision, and generative models. What You’ll Do and Impact: • Lead and mentor engineers in AI-first development methodologies and best practices. • Architect and scale AI-enhanced systems, ensuring security, scalability, and high performance. • Integrate AI-driven capabilities such as chatbot assistants, image-based diagnostics, and automated content creation into products. • Drive adoption of AI-powered engineering tools (e.g., LLM-augmented IDEs, automation frameworks) to enhance development efficiency. • Implement observability and monitoring systems to track AI application performance and ensure proactive issue resolution. • Design and optimize AI-driven APIs and microservices for seamless interaction with models, applications, and databases. • Stay engaged with AI and engineering communities, bringing cutting-edge practices and insights back to the team. • Mentor engineers on technical execution, business impact, and AI-first strategic thinking. • Balance execution speed with innovation, rapidly testing and iterating AI-driven features. • Work in an agile environment, ensuring high-quality, scalable software solutions. Experience: • 3-5+ years of software development experience, including 2+ years working on AI-powered applications or AI-integrated solutions. • Bachelor’s degree in Computer Science, Computer Engineering, or a related field. • Hands-on experience developing and deploying AI-driven applications (provide examples using models like Hugging Face or APIs like OpenAI, Anthropic). • Proficiency in Microsoft environments (Visual Studio, VS Code) and cloud services (AWS, Azure) for scalable AI applications. • Strong understanding of AI model cost optimization, infrastructure scaling, and performance tuning. • Experience integrating LLMs, agentic workflows, and autonomous AI systems into production environments. • Proven ability to mentor engineers and lead AI-first engineering transformations. Additional Items of Interest: • Contributions to open-source AI projects or AI research. • Experience with agentic AI frameworks (LangChain, AutoGPT). • Thought leadership through conferences, research, or industry engagement in AI-first development. • Expertise in AI-powered UI/UX development and human-computer interaction. • Strong proficiency in containerization (Docker, Kubernetes) and cloud-native AI deployments. • Diligence in unit testing, integration testing, and AI-driven problem-solving. Job to be performed in the location listed. Generous benefit package available. © 2013 to 2026 Direct Supply, Inc. All rights reserved.

Apply at Direct Supply

More senior ai engineer roles