ML Engineer at Okta

About The Company

Okta is a leading provider of identity and access management solutions, dedicated to enabling secure and seamless digital experiences for organizations worldwide. With a focus on innovation, Okta offers a comprehensive platform that integrates identity management, authentication, and security services, empowering businesses to protect their data and streamline user access across applications and devices. As a trusted partner for enterprise security, Okta continuously advances its technology to meet the evolving needs of the digital landscape, fostering a secure environment for users and organizations alike.

About The Role

We are seeking a highly skilled Staff Machine Learning Engineer to join our AI Frameworks and Services team at Okta, specifically within the AIFS (Auth0) division. In this role, you will play a pivotal part in shaping and accelerating our Generative AI strategy by developing scalable, production-ready AI and machine learning systems. You will work across the entire AI stack—from model development and infrastructure to platform services—driving innovation in AI-driven features and tools.

This position offers an exciting opportunity to lead initiatives that integrate large language models, retrieval-augmented generation, and knowledge-base workflows into our security and authentication products, ensuring they are resilient, secure, and scalable. Collaborating with cross-functional teams, you will influence the future of AI-powered identity solutions and contribute to building foundational frameworks that enable rapid AI innovation across the organization.

Qualifications

• Strong programming expertise in Python; familiarity with Go or Typescript is a plus
• Proven experience building and deploying AI/ML systems at scale, including LLMOps, CI/CD, and infrastructure-as-code
• Hands-on experience with modern Generative AI platforms such as AWS Bedrock, OpenAI, or Anthropic
• Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows
• Proficiency with ML frameworks like FastAPI, PyTorch, TensorFlow, and Spark ML
• Experience with workflow orchestration tools such as Airflow
• Familiarity with AI agent frameworks including LiteLLM, LangGraph, LangChain, DSPy, LlamaIndex, MCP, or similar
• Experience with containerized applications using Docker and Kubernetes, and cloud-native environments
• Ability to collaborate effectively with product managers, researchers, and engineering teams
• Experience in building tools or infrastructure for AI/ML applications, understanding the developer lifecycle in an AI-native environment
  
  

Responsibilities

• Design and implement scalable infrastructure and platform services for large-scale Generative AI use cases
• Drive technical decision-making to balance simplicity, flexibility, reliability, and performance
• Architect, develop, and deploy robust machine learning and Generative AI systems, ensuring seamless integration with platform services and scalable LLMOps pipelines
• Lead initiatives to optimize, tune, and deploy agentic applications in production with a focus on performance, security, and reliability
• Collaborate with product, platform engineering, and security teams to ensure solutions are production-ready and resilient
• Build reliable data processing pipelines, LLMOps infrastructure, and model inference systems
• Utilize containerization and orchestration tools such as Docker and Kubernetes for efficient deployment
• Mentor and coach team members, contributing to the growth and development of the engineering community
• Engage in cross-functional collaboration to shape the future of Agentic AI and authentication solutions
  
  

Benefits

• Competitive salary package aligned with industry standards
• Comprehensive health, dental, and vision insurance coverage
• Retirement savings plan with company match (RRSP in Canada)
• Healthcare spending account and access to telemedicine services
• Paid leave policies including PTO and parental leave
• Opportunities for professional development and career growth
• Inclusive and collaborative work environment fostering innovation and community engagement
• Participation in social impact initiatives and community-building activities
  
  

Equal Opportunity

Okta is an Equal Opportunity Employer. We are committed to creating a diverse and inclusive workplace where all qualified applicants are considered without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or protected veteran status.