AI/ML Engineer
Greenlight
We are looking for an AI/ML Engineer to join our AI team. The AI/ML Engineer designs, builds, and ships production Generative AI applications, AI agents, and ML systems for customer-facing and internal products. The role pairs deep expertise in large language models and agentic architectures with senior-level software engineering to deliver scalable, secure AI solutions. This engineer leads technical design of complex AI systems, drives cross-functional collaboration with product, platform, and security teams, and shapes the strategic direction of AI/ML capabilities across the organization.
Your day-to-day:
- Design, build, and deploy production AI agents and multi-agent orchestration systems with prompt engineering, LLM chaining, and tool-calling patterns for complex, multi-step workflows.
- Architect RAG pipelines with vector search, hybrid retrieval, and knowledge base management for AI-driven question-answering and decision-support.
- Integrate third-party AI platforms and LLM providers, designing authentication flows, tool schemas, and agent-to-backend communication.
- Design AI agent security architectures including token exchange, delegated access, and user verification flows for systems acting on behalf of users.
- Build production microservices and APIs (FastAPI, Flask, Node.js) serving as orchestration layers and tool endpoints for AI agent systems.
- Architect authentication and authorization for AI services: identity provider integration, token validation, and service-to-service auth.
- Deploy, monitor, and maintain ML models and AI agent endpoints on cloud platforms (Databricks, AWS SageMaker) including scaling and health management.
- Build data ETL pipelines for feature engineering, transaction processing, and knowledge base ingestion.
- Develop evaluation and monitoring frameworks for non-deterministic AI systems: agent correctness testing, retrieval quality, and alerting.
- Author technical design docs, architecture diagrams, and API contracts; mentor junior and mid-level engineers on AI development practices.
- Lead architecture reviews and produce design documents with implementation roadmaps; evaluate emerging AI technologies to inform team strategy.
- Collaborate cross-functionally with product, platform, security, and operations to define requirements, prioritize features, and ship AI integrations end-to-end.
What you’ll bring to the team:
- Extensive experience building and deploying AI agents and Generative AI applications in production.
- Deep knowledge of LLMs, agentic architectures, multi-agent systems, RAG, vector search, tool use/function calling, prompt engineering, and fine-tuning.
- Hands-on experience with AI/ML frameworks such as LangChain, LangGraph, LlamaIndex, or equivalent.
- Strong software engineering skills building production microservices and APIs in Python or JavaScript/TypeScript.
- Experience designing auth systems for AI applications: OAuth, token-based access control, and delegated authorization.
- Proficiency with a major cloud ML platform (Databricks, AWS SageMaker, or Google Vertex AI) for deployment and serving.
- Ability to produce clear technical design documentation and architecture specs for complex systems.
- Strong cross-functional communication and collaboration across product, engineering, security, and operations.
Preferred experience:
- Experience with CI/CD pipelines and infrastructure tooling (GitHub Actions, Jenkins, Kubernetes, Terraform).
- Experience with a JVM language (Java, Kotlin, or Scala) for backend service development.
- Background in data pipeline and streaming tools (Airflow, Spark).
Not sure this one’s for you? Don’t count yourself out. Show us what you’ve got and we’ll reach out if there’s a great fit.
Work perks at Greenlight:
- Medical, dental, vision, and HSA match
- Paid life insurance, AD&D, and disability benefits
- Traditional 401k with company match
- Unlimited PTO
- Paid company holidays and pop-up bonus holidays
- Professional development stipends
- Mental health resources
- 1:1 financial planners
- Fertility healthcare
- 100% paid parental and caregiving leave, plus cleaning service and meals during your leave
- Flexible WFH, both remote and in-office opportunities
- Fully stocked kitchen, catered lunches, and occasional in-office happy hours
- Employee resource groups