31 llmops engineer jobs at 22 companies in Paramus, NJ
3mo
Save
Mark Applied
Hide
3mo
LLMOps Engineer
Brooklyn, New York, United States
$130k-$150k/yrOnsiteFull Time
BSE Global: Operates professional sports franchises and premium entertainment venues.
3+ YOE3–6 years in DevOps/MLOps or infrastructure roles; strong AWS; production AI/ML experience; familiarity with Amazon Bedrock or similar LLM platforms; CI/CD pipelines; observability and monitoring.
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Coaction Specialty Insurance: Provides specialty property and casualty insurance for commercial businesses.
5+ YOE5+ years building production systems; proficiency in Python/C#/Java; experience with LLMs, RAG, embeddings, vector DBs, ML/LLMOps; cloud experience (AWS/Azure); strong engineering hygiene and AI risk/security awareness.
5+ YOEBachelor's degree or equivalent and 5+ years coding in Python and SQL, 5+ years MLOps/LLMOps and data pipeline design for unstructured text and ML workflows.
Python, SQL, Google Colaboratory (Colab), TensorFlow, Tensor Processing Units (TPUs)
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Information Technology - Principal Platform Engineer, Enterprise AI Enablement
Vancouver or Seattle or Toronto or New York City or Los Angeles
OnsiteFull Time
AritziaToronto Stock Exchange: ATZ: Designs and sells everyday luxury women's clothing and accessories.
Deep enterprise AI and platform architecture experience, LLMOps/MLOps, AI guardrails and observability, vector DBs and data orchestration, vendor evaluation, and cross-functional leadership for enterprise AI enablement.
Azure AI Studio, AWS Bedrock, Google Cloud Vertex AI, LLMOps, MLOps, RAG
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Hands-on Python developer experienced building LLM-powered apps, RAG, agentic workflows, vector search, cloud deployment, and LLMOps for enterprise use cases.
Johnson & JohnsonNYSE: JNJ: Global healthcare providing pharmaceuticals and medical technologies.
15+ YOE15+ years enterprise data engineering and architecture experience with expertise in Azure, Microsoft Fabric, Databricks, Power BI, data mesh, governance, and generative AI; bachelor’s required, master’s preferred.
Azure, Microsoft Fabric, Databricks, Power BI, EMR, APIs, MDM, CDP, CRM, ERP, LLMs, RAG, vector databases, MLOps, LLMOps, Site Reliability Engineering (SRE)
Johnson & JohnsonNYSE: JNJ: Develops and manufactures pharmaceutical drugs and medical devices.
15+ YOE15+ years enterprise data engineering/architecture experience; bachelor required (master preferred); hands-on expertise with Azure, Microsoft Fabric, Databricks, Power BI, data mesh, governance, and generative AI; strong leadership and stakeholder skills.
Azure, Microsoft Fabric, Databricks, Power BI, APIs, ETL/ELT, Databricks, LLMs, vector databases, RAG, MLOps, LLMOps
Greater New York Mutual Insurance: Provides commercial property and casualty insurance for businesses.
8+ YOEBachelor's or master's in CS/Information Systems; 8+ years .NET/C#/Python; 3+ years Azure; 2+ years LLMOps/AIOps; 1+ years LangChain/LangGraph; insurance industry experience preferred; Azure certifications a plus.
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
10+ YOE5+ Mgmt10+ years in AI/ML/Data Science with 5+ years leadership; deep expertise in LLMs, GenAI/Agentic frameworks, MLOps/LLMOps, cloud deployments, Python, and production ML systems.
Senior Lead Software Engineer- Python Distributed Development and AI Modernization
Jersey City, New Jersey, United States
$171k-$260k/yrOnsiteFull Time
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience with Python, LLM-based applications, distributed systems, event-driven architectures, and cloud platforms; strong communicator with AI-assisted development tool experience.
Check out this job at Deloitte, Senior OpenAI Forward Deployed Engineer - GPS
New York, New York, United States
$156k-$307k/yrOnsiteFull Time
Deloitte: Provides professional audit, consulting, advisory, and tax services.
7+ YOEBachelor's in CS/DS/Engineering; US Secret clearance; 7+ years software/data/analytics; 1+ year GenAI/LLM; OpenAI tech experience; 1+ year leading projects; travel ~50%; eligible to work in the U.S.
Solstice Advanced MaterialsNASDAQ: SOLS: Provider of specialty materials for industrial and commercial applications.
10+ YOEMaster's or PhD in CS/Engineering/Applied Math,10+ years in AI & analytics,expert Python and SQL,experience with vector DBs and Azure AI Search,ability to lead enterprise AI programs and governance.
Chicago or Dallas or Los Angeles or Minneapolis or New York or San Francisco or Seattle or Washington, D.C.
$200k-$250k/yrHybridFull Time
West Monroe: Business and technology consultancy specializing in digital transformation.
10+ YOE10+ years in client-facing consulting; deep data platform expertise (Databricks, GCP, Snowflake); AI data engineering and scalable data architectures; travel 30-50%; hybrid work arrangement.
Director, AI & Advanced Data Learning & Development
Purchase or New York City
$175k-$293k/yrOnsiteFull Time
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Extensive experience in Learning & Development for advanced AI/data roles; leadership in matrix organizations; track record with AI/ML, data, and engineering.
ML frameworks, Data platforms, MLOps, LLMOps, AI systems
Stuut: Automates business accounts receivable and collections through AI agents.
5+ YOE5+ years software engineering experience with 2+ years in applied AI/ML or speech/audio systems; production experience with speech-to-text, text-to-speech, LLM integration, real-time systems, deployment pipelines, monitoring, and A/B testing.