100 llm engineer jobs at 60 companies in Cornwall, NY
7h
Save
Mark Applied
Hide
Principal Software Engineer - LLM Optimization
Jersey City or London
$204k-$285k/yr OnsiteFull Time
7+ YOEFormal software engineering training or certification and 7+ years of experience, with hands-on LLM inference, GPU infrastructure, quantization, benchmarking, cloud systems, and agentic AI development expertise.
vLLM, TensorRT-LLM, SGLang, LLM-D, FP8, INT8, INT4, GPTQ, AWQ, AWS, EKS, GuideLLM, DCGM, NVML, XID
1d
Save
Mark Applied
Hide
Senior AI Systems Engineer – LLM & Agentic Systems
Englewood Cliffs or Manhattan or Brooklyn or Hoboken or Jersey City
$140k-$175k/yr HybridFull Time
5+ YOEBachelor's degree or equivalent; 5+ years building production software systems; Python and backend expertise; LLM/GenAI, agentic workflows, distributed systems, cloud, data pipelines, observability, and technical leadership experience.
TypeScript, AWS, LangChain, Mastra, LangGraph, Python, RAG
2mo
Save
Mark Applied
Hide
Lead Software Engineer (Python, LLM) - AskGartner
Irving or Stamford
$116k-$170k/yr HybridFull Time
Expert-level Python; backend services; FastAPI; AWS/Azure; SageMaker Pipelines; Pytest; PostgreSQL; Pandas; Git.
Python, Python FastAPI, AWS, Azure, AWS SageMaker Pipelines, pytest, Git, PostgreSQL, Parquet, JSON, CSV, Pandas, LangGraph, LangChain, OpenAI, Anthropic, Google, Locust, JMeter, AWS Athena, AWS S3, IAM, Splunk, AWS Secrets Manager, PySpark, Docker, Kubernetes, Terraform, OpenSearch, RAG systems, Cache technologies
3mo
Save
Mark Applied
Hide
AI Engineer- Manager
Orlando or Montvale or Dallas
OnsiteFull Time
5+ YOEMinimum five years software engineering experience building and deploying AI/ML systems; Bachelor’s degree required (Master’s preferred); expertise with LLMs, RAG, data integration, CI/CD, and mentoring skills.
LLMs, Azure OpenAI, Google Cloud, LangChain, LangGraph, Semantic Kernel, Azure AI Search, Databricks, Microsoft Fabric, Azure DevOps, Git, CI/CD, RAG
2w
Save
Mark Applied
Hide
Senior AI Engineer
White Plains or United States
$85k-$105k/yr HybridFull Time
5+ YOE5+ years software engineering experience with ≥1 year building/operating AI/ML production systems; hands-on LLM, RAG, agent orchestration, Python, FastAPI, Databricks, AWS experience; governance and observability skills.
Claude Code, OpenAI Codex, GitHub Copilot, Claude, OpenAI Codex, Gemini, AWS ECS, AWS AgentCore Gateway, AWS AgentCore Harness, Databricks, LangChain, LangGraph, FastAPI, Docker, AWS SAM, Terraform, LangSmith, Weights & Biases, Dynatrace, OpenTelemetry, PyTorch, scikit-learn, GitHub Workflow
1mo
Save
Mark Applied
Hide
Staff Quality Assurance Engineer
Hoboken, New Jersey, United States
$130k-$150k/yr HybridFull Time
8+ YOE8+ years in quality engineering; hands-on testing of AI/LLM systems; automation with Playwright or similar; proficiency in JavaScript/TypeScript or Java; API testing, CI/CD integration; experience leading QE teams.
Playwright, JavaScript, TypeScript, Java, RAGAS, Cursor, Copilot, AWS, CI/CD
3w
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
1mo
Save
Mark Applied
Hide
Staff Quality Assurance Engineer
Hoboken, New Jersey, United States
$130k-$150k/yr HybridFull Time
8+ YOE8+ years in quality engineering, hands-on testing of AI/LLM systems, automation with Playwright or comparable frameworks, proficiency in JavaScript/TypeScript and/or Java, API/data validation, and QE leadership experience.
Playwright, JavaScript, TypeScript, Java, AWS, Cursor, Copilot, RAGAS
3w
Save
Mark Applied
Hide
Sr. BESS Operations Engineer
Teaneck or San Francisco or Irvine
OnsiteFull Time
5+ YOEBachelor's or Master's in engineering,5+ years BESS/renewable/grid operations experience,knowledge of power systems,industrial protocols,Linux/SSH,Ansible,ability to apply LLMs/ML for automation and monitoring.
Modbus, CANbus, DNP3, TCP/IP, Linux, SSH, Ansible, Python, SCADA, Confluence, LLMs
3w
Save
Mark Applied
Hide
Senior AI Security Automation Engineer
Quincy or Toronto or Princeton or Boston or Clifton or Austin
$120k-$203k/yr HybridFull Time
7+ YOE7+ years software engineering, 3+ years building AI/ML/LLM solutions; expertise in cloud-native architectures, RAG, AI evaluation/observability, CI/CD, security, and mentoring engineers.
AWS, Azure, GCP, Jenkins, Harness, Spinnaker, Argo CD, Python, JavaScript/TypeScript, Rust, Go (Golang), Bash, PowerShell, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, vector databases
1w
Save
Mark Applied
Hide
Senior ML Engineer
New York City, New York, United States
OnsiteFull Time
Senior ML engineer with strong Python and applied ML experience, able to build production systems, work with LLMs, and collaborate with stakeholders; must be NYC-based or willing to relocate.
Python, GitHub, LLM
1mo
Save
Mark Applied
Hide
Staff Machine Learning Engineer (24649)
Long Island City, New York, United States
$119k-$197k/yr OnsiteFull Time
5+ YOEBS/BA or equivalent experience, 5+ years across software engineering/ML/data science (3+ with grad degree). Strong Python, production-grade service design, LLM/agentic systems, Google Cloud, SQL/NoSQL, and mentorship experience.
Python, Google Cloud, Vertex AI, Cloud Run, BigQuery, Firestore, Pub/Sub, FastAPI, Model Context Protocol (MCP), SQL, NoSQL
2mo
Save
Mark Applied
Hide
Senior Lead Python Engineer - Applications Development Group Manager - C14 - RUTHERFORD
Rutherford, New Jersey, United States
$177k-$265k/yr HybridFull Time
12+ YOE8+ Mgmt12+ years in enterprise application, data engineering, or AI platform engineering; 8+ years leading multi-team Agile organizations; advanced expertise in Python, PySpark, Databricks, LLM/GenAI platforms; experience with Kubernetes/OpenShift, Kafka, cloud (AWS/Azure/GCP), and frontend frameworks.
Python, PySpark, Databricks, Devin.AI, GitHub Copilot, LLMs, Google ADK, Gemini, Flash, FastAPI, Spring Boot, Kubernetes, OpenShift, CI/CD, Kafka, React, Angular, AWS, Azure, GCP, Docker, MCP, Data Mesh
1mo
Save
Mark Applied
Hide
IT Solutions Developer
Riverdale, New Jersey, United States
HybridFull Time
2+ YOEBachelor's degree, 2+ years software development experience, strong Python, React, TypeScript skills, LLM/AI and Azure experience, prompt engineering, CI/CD and IaC exposure, strong communication.
Python, React, TypeScript, LangChain, LangGraph, Autogen, Azure, Azure AI Search, Microsoft Fabric, Dataverse, LLM, Microsoft Copilot Studio, vector databases, GitHub Actions, Azure DevOps, Terraform, Ansible
2mo
Save
Mark Applied
Hide
Lead AI Platform Engineer
New York or Fairfield or New Jersey or California
$175k-$200k/yr OnsiteFull Time
7+ YOE7+ years building production backend or full-stack systems, 2+ years building LLM-backed systems, deep AWS experience (Bedrock preferred), TypeScript/Node or Python proficiency, agent framework experience, API design and platform ownership, strong communication and mentorship skills.
Vercel AI SDK, AWS Bedrock, AgentCore, AWS Lambda, ECS, App Runner, RDS, Cognito, TypeScript, Node, Next.js, Python, PostgreSQL, MCP, Salesforce, Snowflake, Bitbucket, Kiro, Claude Code
2mo
Save
Mark Applied
Hide
Senior Operating Platform Engineer
New York City or Greenwich or Garden City or London or Dublin
$190k-$250k/yr OnsiteFull Time
7+ YOE7+ years professional software engineering with 4+ years full-stack experience; expertise with Angular, C#/.NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD; AI/LLM workflows and financial services experience; strong communication.
Angular, C#, .NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD, LLM
1mo
Save
Mark Applied
Hide
Lead Software Development Engineer
Newark, New Jersey, United States
$185k-$250k/yr OnsiteFull Time
5+ YOE5+ years professional software development and architecture experience, bachelor's or equivalent, experience leading design and full SDLC, mentorship experience; ML/LLM knowledge preferred.
Machine Learning, LLM, transformer architecture
1mo
Save
Mark Applied
Hide
AI Solutions Engineer
New York City, New York, United States
$120k-$140k/yr OnsiteFull Time
4+ YOEBachelor's degree or equivalent, 4+ years related experience; hands-on experience with programming, APIs, data engineering, LLMs, prompt engineering, and enterprise AI solutions; strong communication and documentation skills.
Python, JavaScript, TypeScript, PHP, APIs, CI/CD
3w
Save
Mark Applied
Hide
AI Engineer and Project Lead
White Plains, New York, United States
$200k-$250k/yr OnsiteFull Time
4+ YOE4+ years software engineering/AI systems experience, Bachelor's in Computer Science/Engineering, strong Python skills, model training/fine-tuning and production deployment experience, familiarity with LLM frameworks and agentic systems.
Python, LoRA, EHR, APIs
1w
Save
Mark Applied
Hide
Senior Principal Engineer
Long Island City or Orlando or Salt Lake City
$135k-$210k/yr HybridFull Time
6+ YOEBachelor's degree or high school diploma/GED with 4 years' relevant experience; 6+ years in software engineering and full-stack development; expertise in distributed systems, cloud platforms, CI/CD, and modern architecture.
Node.js, Java, Angular, Jenkins, SonarQube, GitOps, Azure, Google Cloud Platform, Amazon Web Services, Magnolia, Adobe, Fastly, Yarn, Gradle, Webpack, CSS, ChatGPT, LLM
Explore Jobs