220 ai operations engineer jobs at 145 companies in Paramus, NJ
2w
Save
Mark Applied
Hide
Senior AI Engineer
White Plains or United States
$85k-$105k/yr HybridFull Time
5+ YOE5+ years software engineering experience with ≥1 year building/operating AI/ML production systems; hands-on LLM, RAG, agent orchestration, Python, FastAPI, Databricks, AWS experience; governance and observability skills.
Claude Code, OpenAI Codex, GitHub Copilot, Claude, OpenAI Codex, Gemini, AWS ECS, AWS AgentCore Gateway, AWS AgentCore Harness, Databricks, LangChain, LangGraph, FastAPI, Docker, AWS SAM, Terraform, LangSmith, Weights & Biases, Dynatrace, OpenTelemetry, PyTorch, scikit-learn, GitHub Workflow
1mo
Save
Mark Applied
Hide
People AI Operations Lead
Paris or New York City
HybridFull Time
5+ YOE5+ years experience (including 2+ years shipping internal tools/agents), hands-on with Python or TypeScript, APIs, prompt engineering, familiarity with modern AI/automation tools, bilingual French/English, strong stakeholder and workflow judgment.
n8n, Claude Code, Notion AI, Dust, Make, Claude, OpenAI APIs, Anthropic APIs, MCP, Retool, Airtable scripts, Python, TypeScript, Jira
2mo
Save
Mark Applied
Hide
Corporate Vice President -AI/ML Security Operations Engineer
New York, New York, United States
$148k-$211k/yr HybridFull Time
5+ YOE5+ years in application/cloud/security engineering; Bachelor's in CS/Engineering or equivalent; hands-on securing ML platforms (Vertex AI preferred); CI/CD and IaC experience (Terraform, GitHub Actions, GitLab CI, Cloud Build); Python proficiency; ML lifecycle and ML security threat knowledge.
Google Cloud Vertex AI, Vertex AI Agent Builder, SageMaker, Azure ML, Terraform, GitHub Actions, GitLab CI, Cloud Build, Python, LangChain, LangGraph, ADK, CrewAI, MITRE ATLAS, OWASP LLM Top 10, OWASP ML Top 10, NIST AI RMF, Google Secure AI Framework (SAIF), Databricks AI Security Framework, OPA, Rego, Cloud Custodian, Conftest, Sentinel, Lakera, Protect AI, NeMo Guardrails, Llama Guard, SLSA, SBOMs
1mo
Save
Mark Applied
Hide
Senior AI Engineer
New York City, New York, United States
$182k-$220k/yr HybridFull Time
5+ YOE5+ years building production software (1–2 years with LLM-powered apps), strong Python and backend experience, integrating AI APIs/frameworks, measuring reliability/latency/cost, product instincts, and ability to work with clinical operators.
Python, LLM, RAG, LangChain, LangGraph, AgentCore, LangSmith, Braintrust, Arize Phoenix, EHR
1mo
Save
Mark Applied
Hide
Principal AI Platform Engineer
United States or Minneapolis or New York City
$118k-$207k/yr RemoteFull Time
Senior engineer to build and operate AI-driven cloud platforms using Kubernetes, Docker, Postgres, and infrastructure-as-code; must secure systems, review code, and participate in 24/7 on-call rotation.
Postgres, Kubernetes, Docker, Argo, GitHub, Entra, Intune, Azure, AWS, GCP, Prometheus, Grafana, Instana, Terraform, Bicep, Ansible, Sentinel, JIRA, Confluence, JAMF, Ubuntu, Linux, Windows, Mac, IaaS, PaaS
1mo
Save
Mark Applied
Hide
AI Operations Manager
Denver or New York City or Leeds or Dublin
$100k-$135k/yr HybridFull Time
3+ YOE3+ years in AI operations or related data-heavy technical role; hands-on understanding of LLMs, prompt engineering, RAG, SQL and analytics; experience operating AI in production; people management and strong stakeholder communication.
LLMs, Retrieval-Augmented Generation (RAG), SQL, Snowflake, BigQuery, Python, CRM
2w
Save
Mark Applied
Hide
AI Operations Specialist
New York City or Chicago
HybridFull Time
8+ YOE8+ years experience in process re-engineering, AI/ML, product or operations; deep expertise with LLMs, prompt engineering, RAG and MLOps; proven track record delivering AI in financial services; strong stakeholder and communication skills.
LLMs, prompt engineering, RAG, MLOps, RMS, AIR, CoreLogic
2w
Save
Mark Applied
Hide
AI Operations Specialist
New York City or Chicago
HybridFull Time
8+ YOE8+ years experience in process re-engineering, data science, AI/ML, product management or operations; deep expertise with LLMs, prompt engineering, RAG and MLOps; strong stakeholder management and delivery experience in (re)insurance.
LLMs, prompt engineering, RAG, MLOps, RMS, AIR, CoreLogic
2mo
Save
Mark Applied
Hide
Senior AI Engineer
New York or Carson City
$200k-$230k/yr HybridFull Time
8+ YOE8+ years software engineering; 2+ years AI/ML in production; strong Python; experience with LLMs and agentic frameworks; ability to operate in ambiguity; collaboration with non-technical stakeholders.
Python, LLM APIs, Agentic frameworks, Backend development, Data pipelines
1w
Save
Mark Applied
Hide
Senior AI Engineer - Live Operations
Basking Ridge or Alpharetta or Irving
$101k-$194k/yr HybridFull Time
4+ YOE4+ years relevant experience or Bachelor's degree; hands-on ML model deployment, monitoring, MLOps, cloud experience, and strong software engineering skills.
Airflow, Kubeflow, MLflow, Python, Java, C++, AWS, Google Cloud, Azure, Kafka, Spark
1mo
Save
Mark Applied
Hide
AI Engineer - Cloud Infrastructure
New York, New York, United States
$175k-$275k/yr OnsiteFull Time
7+ YOE7+ years experience operating cloud and Kubernetes-native infrastructure at scale; hands-on with AWS, EKS, Terraform, Helm; strong debugging, incident response, and capacity planning skills.
AWS, EKS, Terraform, Helm, Kubernetes, Python, Envoy, Istio, Cilium, eBPF, Rust, TypeScript, GCP, Azure, Oracle Cloud
1mo
Save
Mark Applied
Hide
Sr. BESS Operations Engineer
Teaneck, New Jersey, United States
OnsiteFull Time
5+ YOEBachelor's degree in engineering or related field,5+ years BESS/renewable/grid operations experience,knowledge of power systems,industrial communications,Linux,networking,AI automation,and strong cross-functional communication.
Modbus, CANbus, DNP3, TCP/IP, Linux, SSH, Ansible, Python, SCADA, EMS, PCS, BMS
1mo
Save
Mark Applied
Hide
AI Engineer - Software Engineer III
Jersey City or Wilmington
$133k-$185k/yr OnsiteFull Time
3+ YOE3+ years software engineering experience; hands-on building and operating production LLM/agent applications, AWS cloud-native services, retrieval-augmented generation, API integrations, evaluation/observability, and responsible AI practices.
AWS, Kubernetes
1w
Save
Mark Applied
Hide
Senior AI Engineer - Live Operations
Basking Ridge or Alpharetta or Irving
$101k-$194k/yr HybridFull Time
4+ YOE4+ years relevant experience; bachelor’s or equivalent; experience deploying/monitoring ML models, MLOps, cloud platforms; strong programming in Python/Java/C++; knowledge of safety guardrails and streaming systems.
Airflow, Kubeflow, MLflow, Python, Java, C++, AWS, Google Cloud, Azure, Kafka, Spark
1d
Save
Mark Applied
Hide
Fleet Operations Engineer
New York City, New York, United States
OnsiteFull Time
Strong systems fundamentals, Linux expertise, Python proficiency, debugging and performance skills, communication ability, independent problem solving, and interest in AI hardware.
Linux, KVM/QEMU, Kubernetes, Slurm, Python, Rust, Bloomberg Terminal, VPN
1w
Save
Mark Applied
Hide
Senior Settlement & Trading Operations Engineer
United States or Chicago or New York
RemoteFull Time
5+ YOE5+ years in financial operations or settlement, strong Python and SQL, API experience, AI tooling familiarity, attention to detail, clear communicator, bachelor's degree or equivalent.
Python, SQL, Claude, ChatGPT, Copilot, Postman
1mo
Save
Mark Applied
Hide
Senior IT Engineer (AI)
Atlanta or Austin or Boston or Chicago or Denver or San Francisco or New York or London or Lisbon or United States or United Kingdom
RemoteFull Time
Experience building integrations and automations, API and cloud proficiency (GCP), AI implementation experience, strong technical communication, and operational infrastructure skills (Terraform, DNS, certificate management).
Salesforce, Snowflake, ADP, Gemini Enterprise, GCP, Terraform, Model Context Protocol (MCP)
1mo
Save
Mark Applied
Hide
Security Operations Engineer
Woodbridge, New Jersey, United States
$145k-$175k/yr HybridFull Time
6+ YOE6+ years in security engineering/operations, hands-on cloud and infrastructure security, AI/ML security familiarity, Active Directory/Windows/Linux experience, automation/scripting, EDR and security tooling experience.
Active Directory, Windows, Linux, EDR, NIST, OWASP, MITRE ATT&CK
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
1mo
Save
Mark Applied
Hide
AI Adoption & Operations Analyst
Miami or New York City or London or Berlin or Shenzhen or VE
OnsiteFull Time
Bachelor's degree required; entry-level role supporting AI tool adoption, testing prototypes, coordinating with Tech/Engineering, Amazon FBA familiarity, CRM/automation familiarity, and availability during US business hours.
ChatGPT, Claude, Perplexity, Gemini, NetSuite ERP, Amazon FBA
Explore Jobs