237 ai operations engineer jobs at 158 companies in Summit, NJ
2w
Save
Mark Applied
Hide
Senior AI Engineer
White Plains or United States
$85k-$105k/yr HybridFull Time
5+ YOE5+ years software engineering experience with ≥1 year building/operating AI/ML production systems; hands-on LLM, RAG, agent orchestration, Python, FastAPI, Databricks, AWS experience; governance and observability skills.
Claude Code, OpenAI Codex, GitHub Copilot, Claude, OpenAI Codex, Gemini, AWS ECS, AWS AgentCore Gateway, AWS AgentCore Harness, Databricks, LangChain, LangGraph, FastAPI, Docker, AWS SAM, Terraform, LangSmith, Weights & Biases, Dynatrace, OpenTelemetry, PyTorch, scikit-learn, GitHub Workflow
1mo
Save
Mark Applied
Hide
People AI Operations Lead
Paris or New York City
HybridFull Time
5+ YOE5+ years experience (including 2+ years shipping internal tools/agents), hands-on with Python or TypeScript, APIs, prompt engineering, familiarity with modern AI/automation tools, bilingual French/English, strong stakeholder and workflow judgment.
n8n, Claude Code, Notion AI, Dust, Make, Claude, OpenAI APIs, Anthropic APIs, MCP, Retool, Airtable scripts, Python, TypeScript, Jira
1mo
Save
Mark Applied
Hide
Senior AI Engineer
New York City, New York, United States
$182k-$220k/yr HybridFull Time
5+ YOE5+ years building production software (1–2 years with LLM-powered apps), strong Python and backend experience, integrating AI APIs/frameworks, measuring reliability/latency/cost, product instincts, and ability to work with clinical operators.
Python, LLM, RAG, LangChain, LangGraph, AgentCore, LangSmith, Braintrust, Arize Phoenix, EHR
1mo
Save
Mark Applied
Hide
Principal AI Platform Engineer
United States or Minneapolis or New York City
$118k-$207k/yr RemoteFull Time
Senior engineer to build and operate AI-driven cloud platforms using Kubernetes, Docker, Postgres, and infrastructure-as-code; must secure systems, review code, and participate in 24/7 on-call rotation.
Postgres, Kubernetes, Docker, Argo, GitHub, Entra, Intune, Azure, AWS, GCP, Prometheus, Grafana, Instana, Terraform, Bicep, Ansible, Sentinel, JIRA, Confluence, JAMF, Ubuntu, Linux, Windows, Mac, IaaS, PaaS
1mo
Save
Mark Applied
Hide
AI Operations Manager
Denver or New York City or Leeds or Dublin
$100k-$135k/yr HybridFull Time
3+ YOE3+ years in AI operations or related data-heavy technical role; hands-on understanding of LLMs, prompt engineering, RAG, SQL and analytics; experience operating AI in production; people management and strong stakeholder communication.
LLMs, Retrieval-Augmented Generation (RAG), SQL, Snowflake, BigQuery, Python, CRM
3w
Save
Mark Applied
Hide
AI Operations Specialist
New York City or Chicago
HybridFull Time
8+ YOE8+ years experience in process re-engineering, AI/ML, product or operations; deep expertise with LLMs, prompt engineering, RAG and MLOps; proven track record delivering AI in financial services; strong stakeholder and communication skills.
LLMs, prompt engineering, RAG, MLOps, RMS, AIR, CoreLogic
3w
Save
Mark Applied
Hide
AI Operations Specialist
New York City or Chicago
HybridFull Time
8+ YOE8+ years experience in process re-engineering, data science, AI/ML, product management or operations; deep expertise with LLMs, prompt engineering, RAG and MLOps; strong stakeholder management and delivery experience in (re)insurance.
LLMs, prompt engineering, RAG, MLOps, RMS, AIR, CoreLogic
2mo
Save
Mark Applied
Hide
Senior AI Engineer
New York or Carson City
$200k-$230k/yr HybridFull Time
8+ YOE8+ years software engineering; 2+ years AI/ML in production; strong Python; experience with LLMs and agentic frameworks; ability to operate in ambiguity; collaboration with non-technical stakeholders.
Python, LLM APIs, Agentic frameworks, Backend development, Data pipelines
1w
Save
Mark Applied
Hide
Senior AI Engineer - Live Operations
Basking Ridge or Alpharetta or Irving
$101k-$194k/yr HybridFull Time
4+ YOE4+ years relevant experience or Bachelor's degree; hands-on ML model deployment, monitoring, MLOps, cloud experience, and strong software engineering skills.
Airflow, Kubeflow, MLflow, Python, Java, C++, AWS, Google Cloud, Azure, Kafka, Spark
2d
Save
Mark Applied
Hide
Data & AI Platform Engineer
San Ramon or Salt Lake City or Philadelphia or Chicago or Pasadena or Bellevue or Irvine or Duluth or Los Angeles or Boca Raton or Brunswick or Atlanta or Boise or El Segundo or Denver or Dallas or New York City or Los Angeles or Garden City or Nashville or St. Louis or Woodland Hills or San Jose or San Francisco or Austin
$105k-$143k/yr OnsiteFull Time
2+ YOERequires 2+ years in data, platform, analytics engineering, or cloud operations; 1+ year accounting experience; cloud data, BI, CI/CD, scripting, SQL, governance, and AI/ML familiarity.
Microsoft Fabric, Snowflake, Databricks, Power BI, Tableau, Git, Python, PowerShell, SQL, Azure Key Vault, Azure OpenAI, AI Search
1mo
Save
Mark Applied
Hide
AI Engineer - Cloud Infrastructure
New York, New York, United States
$175k-$275k/yr OnsiteFull Time
7+ YOE7+ years experience operating cloud and Kubernetes-native infrastructure at scale; hands-on with AWS, EKS, Terraform, Helm; strong debugging, incident response, and capacity planning skills.
AWS, EKS, Terraform, Helm, Kubernetes, Python, Envoy, Istio, Cilium, eBPF, Rust, TypeScript, GCP, Azure, Oracle Cloud
1mo
Save
Mark Applied
Hide
Sr. BESS Operations Engineer
Teaneck, New Jersey, United States
OnsiteFull Time
5+ YOEBachelor's degree in engineering or related field,5+ years BESS/renewable/grid operations experience,knowledge of power systems,industrial communications,Linux,networking,AI automation,and strong cross-functional communication.
Modbus, CANbus, DNP3, TCP/IP, Linux, SSH, Ansible, Python, SCADA, EMS, PCS, BMS
1mo
Save
Mark Applied
Hide
AI Engineer - Software Engineer III
Jersey City or Wilmington
$133k-$185k/yr OnsiteFull Time
3+ YOE3+ years software engineering experience; hands-on building and operating production LLM/agent applications, AWS cloud-native services, retrieval-augmented generation, API integrations, evaluation/observability, and responsible AI practices.
AWS, Kubernetes
1w
Save
Mark Applied
Hide
Senior AI Engineer - Live Operations
Basking Ridge or Alpharetta or Irving
$101k-$194k/yr HybridFull Time
4+ YOE4+ years relevant experience; bachelor’s or equivalent; experience deploying/monitoring ML models, MLOps, cloud platforms; strong programming in Python/Java/C++; knowledge of safety guardrails and streaming systems.
Airflow, Kubeflow, MLflow, Python, Java, C++, AWS, Google Cloud, Azure, Kafka, Spark
5d
Save
Mark Applied
Hide
Fleet Operations Engineer
New York City, New York, United States
OnsiteFull Time
Strong systems fundamentals, Linux expertise, Python proficiency, debugging and performance skills, communication ability, independent problem solving, and interest in AI hardware.
Linux, KVM/QEMU, Kubernetes, Slurm, Python, Rust, Bloomberg Terminal, VPN
5h
Save
Mark Applied
Hide
Senior AI Engineer – AI Platform
Englewood Cliffs, New Jersey, United States
$140k-$175k/yr HybridFull Time
5+ YOEBachelor's degree in Computer Science or equivalent experience; 5+ years building production software systems; strong Python and backend expertise; experience with AWS, distributed systems, LLM/GenAI, agentic workflows, RAG, evaluation, and operations.
TypeScript, AWS, LangChain, Mastra, LangGraph, Python, RAG
2w
Save
Mark Applied
Hide
Senior Settlement & Trading Operations Engineer
United States or Chicago or New York
RemoteFull Time
5+ YOE5+ years in financial operations or settlement, strong Python and SQL, API experience, AI tooling familiarity, attention to detail, clear communicator, bachelor's degree or equivalent.
Python, SQL, Claude, ChatGPT, Copilot, Postman
2mo
Save
Mark Applied
Hide
Corporate Vice President - Senior AI Governance & Platform Operations Engineer, Microsoft 365
New York City, New York, United States
$148k-$211k/yr HybridFull Time
7+ YOE7+ years M365 engineering experience, 3+ years deploying Copilot at scale, Power Platform licensing/governance expertise, knowledge of Purview, Entra ID/Azure AD, Microsoft Graph, SharePoint, Power BI, and AI risk/compliance.
Microsoft Copilot, Microsoft 365, Power Platform, Power Apps, Power Automate, AI Builder, Microsoft Purview, Data Security Posture Management (DSPM), Microsoft Entra ID (Azure AD), Microsoft Graph, SharePoint Online, OneDrive, AvePoint, Power BI, Microsoft FastTrack, Microsoft Unified Support, Azure OpenAI, ChatGPT for Enterprise
1mo
Save
Mark Applied
Hide
Senior IT Engineer (AI)
Atlanta or Austin or Boston or Chicago or Denver or San Francisco or New York or London or Lisbon or United States or United Kingdom
RemoteFull Time
Experience building integrations and automations, API and cloud proficiency (GCP), AI implementation experience, strong technical communication, and operational infrastructure skills (Terraform, DNS, certificate management).
Salesforce, Snowflake, ADP, Gemini Enterprise, GCP, Terraform, Model Context Protocol (MCP)
1mo
Save
Mark Applied
Hide
Security Operations Engineer
Woodbridge, New Jersey, United States
$145k-$175k/yr HybridFull Time
6+ YOE6+ years in security engineering/operations, hands-on cloud and infrastructure security, AI/ML security familiarity, Active Directory/Windows/Linux experience, automation/scripting, EDR and security tooling experience.
Active Directory, Windows, Linux, EDR, NIST, OWASP, MITRE ATT&CK
Explore Jobs