25 llmops engineer jobs at 22 companies in Wayne, NJ

3mo
Save
Mark Applied
Hide
LLMOps Engineer
Brooklyn, New York, United States
$130k-$150k/yr OnsiteFull Time
BSE Global
BSE Global: Operates professional sports franchises and premium entertainment venues.
3+ YOE3–6 years in DevOps/MLOps or infrastructure roles; strong AWS; production AI/ML experience; familiarity with Amazon Bedrock or similar LLM platforms; CI/CD pipelines; observability and monitoring.
AWS, Amazon Bedrock, CI/CD, Observability
4d
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
2w
Save
Mark Applied
Hide
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
1mo
Save
Mark Applied
Hide
Senior AI Engineer
Morristown or Glendale or New York City
$140k-$190k/yr OnsiteFull Time
Coaction Specialty Insurance
Coaction Specialty Insurance: Provides specialty property and casualty insurance for commercial businesses.
5+ YOE5+ years building production systems; proficiency in Python/C#/Java; experience with LLMs, RAG, embeddings, vector DBs, ML/LLMOps; cloud experience (AWS/Azure); strong engineering hygiene and AI risk/security awareness.
Python, C#, Java, LLMs, ML APIs, RAG, embeddings, vector databases, REST, JSON, AWS, Azure, CI/CD, MLOps, LLMOps
1w
Save
Mark Applied
Hide
Senior Data Engineer, GTM
Mountain View or Chicago or Irvine or New York City
$156k-$227k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor's degree or equivalent and 5+ years coding in Python and SQL, 5+ years MLOps/LLMOps and data pipeline design for unstructured text and ML workflows.
Python, SQL, Google Colaboratory (Colab), TensorFlow, Tensor Processing Units (TPUs)
3w
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Python, Go, Golang, Scala, Java, C++, C#, LangGraph, AutoGen, Semantic Kernel (Microsoft), Semantic Kernel, LangChain, CrewAI, LlamaIndex, LLMOps, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, AWS, Google Cloud, Azure, K8s, Helm, CRDs, CLI, SDK, VectorDBs
3w
Save
Mark Applied
Hide
Staff AI Engineer
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
Python, Docker, Kubernetes, CI/CD, LLM APIs, LLMOps, RAG, vector databases, Open CLAW, Hermes, WhatsApp
1w
Save
Mark Applied
Hide
Director, AI / Machine Learning Data Engineer
New York or Lake Mary
$147k-$250k/yr OnsiteFull Time
BNY
BNYNYSE: BK: Global institution managing and servicing financial assets worldwide.
12+ YOEBachelor's degree or equivalent,12+ years software development experience,10+ years applied AI/ML and production deployments,strong MLOps/LLMOps and cloud/distributed systems expertise,excellent communication.
1mo
Save
Mark Applied
Hide
Information Technology - Principal Platform Engineer, Enterprise AI Enablement
Vancouver or Seattle or Toronto or New York City or Los Angeles
OnsiteFull Time
Aritzia
AritziaToronto Stock Exchange: ATZ: Designs and sells everyday luxury women's clothing and accessories.
Deep enterprise AI and platform architecture experience, LLMOps/MLOps, AI guardrails and observability, vector DBs and data orchestration, vendor evaluation, and cross-functional leadership for enterprise AI enablement.
Azure AI Studio, AWS Bedrock, Google Cloud Vertex AI, LLMOps, MLOps, RAG
2mo
Save
Mark Applied
Hide
Senior Integration Developer
Edison, New Jersey, United States
$109k-$207k/yr HybridFull Time
Greater New York Mutual Insurance
Greater New York Mutual Insurance: Provides commercial property and casualty insurance for businesses.
8+ YOEBachelor's or master's in CS/Information Systems; 8+ years .NET/C#/Python; 3+ years Azure; 2+ years LLMOps/AIOps; 1+ years LangChain/LangGraph; insurance industry experience preferred; Azure certifications a plus.
Azure Functions, Logic Apps, Service Bus, Azure API Management, Azure DevOps, GitHub, SQL Server, Cosmos DB, Azure Storage, Docker, Kubernetes, OpenTelemetry, LangChain, LangGraph, Microsoft AutoGen, Semantic Kernel, Weights & Biases, Arize Phoenix, OpenTelemetry
1mo
Save
Mark Applied
Hide
Senior Research Software Engineer
New York, New York, United States
$149k-$169k/yr HybridFull Time
New York University
New York University: A private research university providing undergraduate and graduate education.
5+ YOEMaster's degree or equivalent experience, 5+ years software engineering, proficiency in Python/Go/node.js, git/GitHub, Kubernetes, cloud and HPC environments, CI/CD, Linux, databases, web frontend/backend; strong communication.
Python, Go, node.js, PyPI, git, GitHub, Kubernetes, CI/CD, Linux, HPC, AWS, GCP, DevOps, MLOps, LLMOps
1mo
Save
Mark Applied
Hide
Senior AI Forward Deployed Engineer - VP
New York City or United States
$200k-$280k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
10+ YOE5+ Mgmt10+ years in AI/ML/Data Science with 5+ years leadership; deep expertise in LLMs, GenAI/Agentic frameworks, MLOps/LLMOps, cloud deployments, Python, and production ML systems.
Python, LangChain, LangGraph, Scikit-learn, NumPy, Pandas, RLlib, AWS SageMaker, AWS Bedrock, Hugging Face Transformers, spaCy, NLTK, Cursor, Windsurf, Replit, GitHub Copilot, GPT, Llama, Mistral, Claude, LlamaIndex, Langfuse, AutoGen, CrewAI, Pinecone, Weaviate, Chroma, FAISS, Scale.ai, Mercor, Docker, Kubernetes, Terraform, FastAPI, PostgreSQL, ReactJS, Redis, GCP, Jenkins, GitHub Actions
3d
Save
Mark Applied
Hide
Senior Lead Software Engineer- Python Distributed Development and AI Modernization
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience with Python, LLM-based applications, distributed systems, event-driven architectures, and cloud platforms; strong communicator with AI-assisted development tool experience.
Claude Code, Codex, GitHub Copilot, Cursor, Python, COBOL, JCL, DB2, Kotlin, AWS, EKS, ECS, Temporal, Airflow, Kafka, PostgreSQL, Kubernetes, RAG, LLMOps
1mo
Save
Mark Applied
Hide
Gen AI / Agentic AI Developer (Brooklyn, NY, US)
Brooklyn or New York City or Charlotte or Chicago or Atlanta
$80k-$106k/yr HybridFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Hands-on Python development and GenAI experience; familiarity with LLMs, RAG, agentic frameworks (e.g., LangChain, LangGraph, AutoGen), vector DBs, cloud deployment, Docker/Kubernetes, CI/CD, and LLMOps/tooling.
Python, LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, LlamaIndex, OpenAI, Azure OpenAI, AWS Bedrock, Anthropic Claude, Gemini, Llama, Mistral, OpenSearch, Pinecone, FAISS, Chroma, Weaviate, Milvus, Azure AI Search, pgvector, FastAPI, Flask, REST APIs, microservices, Docker, Kubernetes, CI/CD, LangSmith, MLflow, Phoenix, Ragas, TruLens, Arize, OpenTelemetry, AWS SageMaker, GCP Vertex AI
1mo
Save
Mark Applied
Hide
Forward Deployed AI Engineer - Associate Director (Hoboken, NJ, US, 07030)
Hoboken, New Jersey, United States
$188k-$342k/yr HybridFull Time
EY
EY: Global firm providing audit, tax, and professional consulting services.
6+ YOE6+ years in software/data/AI engineering with experience delivering scalable AI/ML solutions; proficiency in Python, LangChain/LlamaIndex/AutoGen, cloud platforms (Azure, AWS, GCP), container orchestration, Terraform/Ansible, and CI/CD; consulting experience and mentoring ability.
Python, LangChain, LlamaIndex, AutoGen, Retrieval-Augmented Generation (RAG), Kubernetes, Docker, Azure, AWS, GCP, Terraform, Ansible, CI/CD, MLOps, LLMOps
2mo
Save
Mark Applied
Hide
Check out this job at Deloitte, Senior OpenAI Forward Deployed Engineer - GPS
New York, New York, United States
$156k-$307k/yr OnsiteFull Time
Deloitte
Deloitte: Provides professional audit, consulting, advisory, and tax services.
7+ YOEBachelor's in CS/DS/Engineering; US Secret clearance; 7+ years software/data/analytics; 1+ year GenAI/LLM; OpenAI tech experience; 1+ year leading projects; travel ~50%; eligible to work in the U.S.
OpenAI, GPT-4o, Assistants API, Responses API, OpenAI Agents SDK, Spark, Airflow, dbt, LLMOps, MLOps, APIs, Microservices
1mo
Save
Mark Applied
Hide
Director, Data Engineering & AI
Chicago or Dallas or Los Angeles or Minneapolis or New York or San Francisco or Seattle or Washington, D.C.
$200k-$250k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
10+ YOE10+ years in client-facing consulting; deep data platform expertise (Databricks, GCP, Snowflake); AI data engineering and scalable data architectures; travel 30-50%; hybrid work arrangement.
Databricks, GCP, Snowflake, AWS, Azure, MLOps, LLMOps
2mo
Save
Mark Applied
Hide
Director, AI & Advanced Data Learning & Development
Purchase or New York City
$175k-$293k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Extensive experience in Learning & Development for advanced AI/data roles; leadership in matrix organizations; track record with AI/ML, data, and engineering.
ML frameworks, Data platforms, MLOps, LLMOps, AI systems
1mo
Save
Mark Applied
Hide
Member of Technical Staff — Audio and Voice AI
San Francisco or New York City
$220k-$320k/yr OnsiteFull Time
Stuut
Stuut: Automates business accounts receivable and collections through AI agents.
5+ YOE5+ years software engineering experience with 2+ years in applied AI/ML or speech/audio systems; production experience with speech-to-text, text-to-speech, LLM integration, real-time systems, deployment pipelines, monitoring, and A/B testing.
Python, PyTorch, TensorFlow, Transformers, LLMOps, MLOps
2w
Save
Mark Applied
Hide
Head of Data & Analytics Platforms
Nutley, New Jersey, United States
$131k-$267k/yr HybridFull Time
Ralph Lauren
Ralph LaurenNYSE: RL: Designs and sells premium lifestyle products including apparel and home goods.
12+ YOE12+ years in data platform management or cloud architecture; bachelor’s degree in CS/Data Engineering/IS (master’s preferred); expertise in cloud (AWS, Azure, GCP), lakehouse architectures, data governance, FinOps, and AI/ML enablement; proven leadership building global platforms.
AWS, Azure, GCP, FinOps, LLMOps, Data Lakehouse