25 llmops engineer jobs at 22 companies in Wayne, NJ
3mo
Save
Mark Applied
Hide
3mo
LLMOps Engineer
Brooklyn, New York, United States
$130k-$150k/yrOnsiteFull Time
BSE Global: Operates professional sports franchises and premium entertainment venues.
3+ YOE3–6 years in DevOps/MLOps or infrastructure roles; strong AWS; production AI/ML experience; familiarity with Amazon Bedrock or similar LLM platforms; CI/CD pipelines; observability and monitoring.
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yrOnsiteFull Time
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
Coaction Specialty Insurance: Provides specialty property and casualty insurance for commercial businesses.
5+ YOE5+ years building production systems; proficiency in Python/C#/Java; experience with LLMs, RAG, embeddings, vector DBs, ML/LLMOps; cloud experience (AWS/Azure); strong engineering hygiene and AI risk/security awareness.
5+ YOEBachelor's degree or equivalent and 5+ years coding in Python and SQL, 5+ years MLOps/LLMOps and data pipeline design for unstructured text and ML workflows.
Python, SQL, Google Colaboratory (Colab), TensorFlow, Tensor Processing Units (TPUs)
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
BNYNYSE: BK: Global institution managing and servicing financial assets worldwide.
12+ YOEBachelor's degree or equivalent,12+ years software development experience,10+ years applied AI/ML and production deployments,strong MLOps/LLMOps and cloud/distributed systems expertise,excellent communication.
Information Technology - Principal Platform Engineer, Enterprise AI Enablement
Vancouver or Seattle or Toronto or New York City or Los Angeles
OnsiteFull Time
AritziaToronto Stock Exchange: ATZ: Designs and sells everyday luxury women's clothing and accessories.
Deep enterprise AI and platform architecture experience, LLMOps/MLOps, AI guardrails and observability, vector DBs and data orchestration, vendor evaluation, and cross-functional leadership for enterprise AI enablement.
Azure AI Studio, AWS Bedrock, Google Cloud Vertex AI, LLMOps, MLOps, RAG
Greater New York Mutual Insurance: Provides commercial property and casualty insurance for businesses.
8+ YOEBachelor's or master's in CS/Information Systems; 8+ years .NET/C#/Python; 3+ years Azure; 2+ years LLMOps/AIOps; 1+ years LangChain/LangGraph; insurance industry experience preferred; Azure certifications a plus.
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
10+ YOE5+ Mgmt10+ years in AI/ML/Data Science with 5+ years leadership; deep expertise in LLMs, GenAI/Agentic frameworks, MLOps/LLMOps, cloud deployments, Python, and production ML systems.
Senior Lead Software Engineer- Python Distributed Development and AI Modernization
Jersey City, New Jersey, United States
$171k-$260k/yrOnsiteFull Time
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience with Python, LLM-based applications, distributed systems, event-driven architectures, and cloud platforms; strong communicator with AI-assisted development tool experience.
Check out this job at Deloitte, Senior OpenAI Forward Deployed Engineer - GPS
New York, New York, United States
$156k-$307k/yrOnsiteFull Time
Deloitte: Provides professional audit, consulting, advisory, and tax services.
7+ YOEBachelor's in CS/DS/Engineering; US Secret clearance; 7+ years software/data/analytics; 1+ year GenAI/LLM; OpenAI tech experience; 1+ year leading projects; travel ~50%; eligible to work in the U.S.
Chicago or Dallas or Los Angeles or Minneapolis or New York or San Francisco or Seattle or Washington, D.C.
$200k-$250k/yrHybridFull Time
West Monroe: Business and technology consultancy specializing in digital transformation.
10+ YOE10+ years in client-facing consulting; deep data platform expertise (Databricks, GCP, Snowflake); AI data engineering and scalable data architectures; travel 30-50%; hybrid work arrangement.
Director, AI & Advanced Data Learning & Development
Purchase or New York City
$175k-$293k/yrOnsiteFull Time
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Extensive experience in Learning & Development for advanced AI/data roles; leadership in matrix organizations; track record with AI/ML, data, and engineering.
ML frameworks, Data platforms, MLOps, LLMOps, AI systems
Stuut: Automates business accounts receivable and collections through AI agents.
5+ YOE5+ years software engineering experience with 2+ years in applied AI/ML or speech/audio systems; production experience with speech-to-text, text-to-speech, LLM integration, real-time systems, deployment pipelines, monitoring, and A/B testing.
Ralph LaurenNYSE: RL: Designs and sells premium lifestyle products including apparel and home goods.
12+ YOE12+ years in data platform management or cloud architecture; bachelor’s degree in CS/Data Engineering/IS (master’s preferred); expertise in cloud (AWS, Azure, GCP), lakehouse architectures, data governance, FinOps, and AI/ML enablement; proven leadership building global platforms.