Machine Learning Engineering Technical Leader - CX AI
Cisco · San Jose, United States · 15d ago
This is a Hybrid role requiring 3 days per week in the San Jose, CA office.
Meet the Team
Cisco's CX AI Foundations team owns the foundational AI platform behind intelligent customer experiences across Cisco — the shared layer that application and agent teams across CX build on, in cloud, on-premises, and fully air-gapped customer environments.
Our charter spans the platform end to end: the model and inference layer (including SLM specialization and the LLM-compatible API), evaluation systems for shipped AI behavior, agentic and orchestration infrastructure, foundational AI services and APIs, and the packaging and upgrade machinery that makes AI supportable in the field — including the on-prem AI appliance now shipping to customers. The portfolio is expanding as Cisco's AI footprint grows.
This is a small, deeply technical team with production commitments.
Your Impact
As a senior hands-on technical leader in Cisco’s CX Engineering organization, you will architect, build, and deliver foundational, enterprise-scale AI services that power critical platform capabilities. Operating as a builder rather than a coordinator, you will own complex technical challenges end-to-end—driving model selection and fine-tuning, inference optimization, agentic infrastructure, multi-tenant API contracts, and air-gapped deployments across diverse compute targets. You will establish the benchmark for scientific rigor and statistical evaluation—treating regression gating, judge calibration, and drift detection as mandatory release criteria—while mentoring senior engineers through technical depth and influence rather than positional authority. In this role, you will bridge cutting-edge AI research with reliable production engineering, collaborating across product, security, and executive leadership to drive architectural roadmaps, uphold responsible AI governance, and champion engineering excellence across the organization.
Minimum Qualifications:
- Bachelor's degree with 11+ years of related experience, or Master's degree with 7+ years of related experience.
- Machine learning experience to include model development, training and adaptation, and evaluation.
- Experience with Python and modern ML frameworks such as PyTorch or JAX or similar.
- Experience taking machine learning work from research or prototype through to production.
- Production experience in at least one foundational AI platform area — model serving and inference, evaluation systems for generative AI, agentic/orchestration infrastructure, or AI platform services and APIs.
- Experience leading full lifecycle projects.
Preferred Qualifications:
Technical & Architectural Leadership
- Production Platform Ownership: Track record architecting and operating shared AI/ML inference platforms and APIs consumed across multiple teams, including API contract design, versioning, and backward compatibility.
- Incubation to Delivery: Proven experience leading concurrent technical workstreams and navigating AI solutions from experimental incubation through to supported, enterprise-grade production products.
- Engineering Mentorship: Demonstrated success mentoring, coaching, and elevating senior engineers and applied researchers.
Applied Machine Learning & Inference Systems Depth
- High-Performance Inference: Hands-on experience deploying and profiling LLM/SLM serving engines (vLLM, TensorRT-LLM, Triton, SGLang, llama.cpp) utilizing optimizations such as continuous batching, KV-cache management, quantization, and speculative decoding.
- Model Specialization & Adaptation: Deep expertise in fine-tuning, distillation, transfer learning, and PEFT/LoRA, as well as designing OpenAI-compatible interfaces over specialized models.
- Rigorous Generative Evaluation: Experience building statistical evaluation frameworks for non-deterministic AI systems—including golden datasets, LLM-as-a-judge calibration, human-agreement metrics, regression gates, and drift detection.
- Agentic Architectures: Production experience designing multi-turn agentic workflows, autonomous tool integration, and advanced retrieval (RAG) architectures.
Enterprise, Edge & MLOps Infrastructure
- Hybrid & Air-Gapped Deployments: Experience packaging and delivering AI services into cloud, customer-managed, air-gapped, and resource-constrained compute environments (CPU, NPU, small GPU) with strict upgrade safety and supportability.
- Production MLOps: Hands-on foundation in modern AI infrastructure practices, including automated CI/CD pipelines for models, model registries, experiment tracking, and real-time telemetry/observability.
- Security & Governance: Comprehensive understanding of enterprise security reviews, data boundary isolation, privacy controls, and responsible AI compliance.
Thought Leadership & External Influence
- Industry Impact: Record of external technical contributions via patents, peer-reviewed publications, open-source AI projects, or conference presentations.
Why Cisco?
At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint.
Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere.
We are Cisco, and our power starts with you.
Message to applicants applying to work in the U.S. and/or Canada:
The starting salary range posted for this position is $256,900.00 to $333,400.00 and reflects the projected salary range for new hires in this position in U.S. and/or Canada locations, not including incentive compensation*, equity, or benefits.Individual pay is determined by the candidate's hiring location, market conditions, job-related skillset, experience, qualifications, education, certifications, and/or training. The full salary range for certain locations is listed below. For locations not listed below, the recruiter can share more details about compensation for the role in your location during the hiring process.
U.S. employees are offered benefits, subject to Cisco’s plan eligibility rules, which include medical, dental and vision insurance, a 401(k) plan with a Cisco matching contribution, paid parental leave, short and long-term disability coverage, and basic life insurance. Please see the Cisco careers site to discover more benefits and perks. Employees may be eligible to receive grants of Cisco restricted stock units, which vest following continued employment with Cisco for defined periods of time.
U.S. employees are eligible for paid time away as described below, subject to Cisco’s policies:
10 paid holidays per full calendar year, plus 1 floating holiday for non-exempt employees
1 paid day off for employee’s birthday, paid year-end holiday shutdown, and 4 paid days off for personal wellness determined by Cisco
Non-exempt employees** receive 16 days of paid vacation time per full calendar year, accrued at rate of 4.92 hours per pay period for full-time employees
Exempt employees participate in Cisco’s flexible vacation time off program, which has no defined limit on how much vacation time eligible employees may use (subject to availability and some business limitations)
80 hours of sick time off provided on hire date and each January 1st thereafter, and up to 80 hours of unused sick time carried forward from one calendar year to the next
Additional paid time away may be requested to deal with critical or emergency issues for family members
Optional 10 paid days per full calendar year to volunteer
For non-sales roles, employees are also eligible to earn annual bonuses subject to Cisco’s policies.
Employees on sales plans earn performance-based incentive pay on top of their base salary, which is split between quota and non-quota components, subject to the applicable Cisco plan. For quota-based incentive pay, Cisco typically pays as follows:
.75% of incentive target for each 1% of revenue attainment up to 50% of quota;
1.5% of incentive target for each 1% of attainment between 50% and 75%;
1% of incentive target for each 1% of attainment between 75% and 100%; and
Once performance exceeds 100% attainment, incentive rates are at or above 1% for each 1% of attainment with no cap on incentive compensation.
For non-quota-based sales performance elements such as strategic sales objectives, Cisco may pay 0% up to 125% of target. Cisco sales plans do not have a minimum threshold of performance for sales incentive compensation to be paid.
The applicable full salary ranges for this position, by specific state, are listed below:
New York City Metro Area:
$256,900.00 - $383,500.00Non-Metro New York state & Washington state:
$234,400.00 - $341,100.00* For quota-based sales roles on Cisco’s sales plan, the ranges provided in this posting include base pay and sales target incentive compensation combined.
** Employees in Illinois, whether exempt or non-exempt, will participate in a unique time off program to meet local requirements.