2 inference optimization engineer jobs at 2 companies in New Jersey

4w
Save
Mark Applied
Hide
AI Foundational Model Engineer
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
7+ YOE7+ years in AI/ML or platform engineering; hands-on LLM, RAG, embeddings, PyTorch/TensorFlow, Python, Terraform, CI/CD, cloud-native deployment, model evaluation, inference optimization, and secure data handling.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex, Semantic Kernel, Terraform, CI/CD, AWS Bedrock, Amazon SageMaker, OpenSearch, Kendra, AWS Lambda, EKS, ECS, Azure OpenAI, Vertex AI, Databricks, vLLM, Triton, MLflow, Kubeflow, Kubernetes
1mo
Save
Mark Applied
Hide
AI Implementation Engineer - JobID-0245
Arlington or Mount Laurel
$114k-$231k/yr HybridFull Time
Innovative Defense Technologies
Innovative Defense Technologies: A defense technology that develops automated software and systems to rapidly deliver mission-critical capabilities to government customers.
5+ YOEDesign and deliver production-grade on‑prem AI/agent systems, integrate LLMs and tools, build RAG pipelines, optimize local inference, and obtain/maintain Secret clearance.
Python, NumPy, Pandas, vLLM, SGLang, Triton Inference Server, TensorRT-LLM, PyTorch, TensorFlow, LangChain, LangGraph, Semantic Kernel, AutoGen, Linux, Model Context Protocol (MCP), LLM, Retrieval-Augmented Generation (RAG)