About the Job
Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate...
This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk.
Have you ever considered what powers the intelligent features behind seamless product experiences? The GenAI team is at the forefront of enabling AI-powered security and intelligent innovation across our organization. From crafting AI powered security services, to intuitive generative AI-powered chat experiences tha...
Key Responsibilities
Spearhead the design of scalable, observable ML and Generative AI systems that integrate retrieval, inference, and evaluation pipelines.
Develop and iterate on structured prompting, context retrieval, and RAG workflows that improve accuracy, safety, and cost efficiency in Claude-based systems.
Build and refine automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
Implement schema validation, structured output enforcement, and other guardrails that keep AI outputs reliable, auditable, and compliant with enterprise standards.
Mentor and coach engineers, contributing to the growth of the team and the larger engineering community.
Required Skills & Abilities
7+ years of software development experience, with strong programming expertise in Python (and familiarity with Go or Typescript a plus).
Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or other related AI agent frameworks.
Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).
Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.
Proven ability to collaborate with product and engineering teams to drive greenfield initiatives forward, navigate unknowns, and iterate quickly and frequently.
Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native world.
Experience integrating AI-driven systems with identity, authentication, or security products.
Exposure to ethical AI, model risk, or compliance frameworks.
Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
Please note that we encourage candidates to apply even if you do not have experience with all of the criteria or technologies listed above; these are provided to give insight into the tech stack and general responsibilities for the role.
#LI-HYBRID
#LI-SH1
P-2652_3522731
Below is the annual salary range for candidates located in Canada. Your actual salary will depend on factors such as your skills, qualifications, and experience. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental, and vision insurance, RRSP with a match, healthcare spending, telemedicine, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program, please visit: https://rewards.okta.com/can.
The annual base salary range for this position for candidates located in Canada is between:
$168,000—$231,000 CAD
The Okta Experience
Supporting Your Well-Being
Driving Social Impact
Developing Talent and Fostering Connection + Community
We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one.
Okta is an
