35 llm engineer jobs at 22 companies in Fishkill, NY
16h
Save
Mark Applied
Hide
Senior AI Systems Engineer – LLM & Agentic Systems
Englewood Cliffs or Manhattan or Brooklyn or Hoboken or Jersey City
$140k-$175k/yr HybridFull Time
5+ YOEBachelor's degree or equivalent; 5+ years building production software systems; Python and backend expertise; LLM/GenAI, agentic workflows, distributed systems, cloud, data pipelines, observability, and technical leadership experience.
TypeScript, AWS, LangChain, Mastra, LangGraph, Python, RAG
2mo
Save
Mark Applied
Hide
Lead Software Engineer (Python, LLM) - AskGartner
Irving or Stamford
$116k-$170k/yr HybridFull Time
Expert-level Python; backend services; FastAPI; AWS/Azure; SageMaker Pipelines; Pytest; PostgreSQL; Pandas; Git.
Python, Python FastAPI, AWS, Azure, AWS SageMaker Pipelines, pytest, Git, PostgreSQL, Parquet, JSON, CSV, Pandas, LangGraph, LangChain, OpenAI, Anthropic, Google, Locust, JMeter, AWS Athena, AWS S3, IAM, Splunk, AWS Secrets Manager, PySpark, Docker, Kubernetes, Terraform, OpenSearch, RAG systems, Cache technologies
3mo
Save
Mark Applied
Hide
AI Engineer- Manager
Orlando or Montvale or Dallas
OnsiteFull Time
5+ YOEMinimum five years software engineering experience building and deploying AI/ML systems; Bachelor’s degree required (Master’s preferred); expertise with LLMs, RAG, data integration, CI/CD, and mentoring skills.
LLMs, Azure OpenAI, Google Cloud, LangChain, LangGraph, Semantic Kernel, Azure AI Search, Databricks, Microsoft Fabric, Azure DevOps, Git, CI/CD, RAG
2w
Save
Mark Applied
Hide
Senior AI Engineer
White Plains or United States
$85k-$105k/yr HybridFull Time
5+ YOE5+ years software engineering experience with ≥1 year building/operating AI/ML production systems; hands-on LLM, RAG, agent orchestration, Python, FastAPI, Databricks, AWS experience; governance and observability skills.
Claude Code, OpenAI Codex, GitHub Copilot, Claude, OpenAI Codex, Gemini, AWS ECS, AWS AgentCore Gateway, AWS AgentCore Harness, Databricks, LangChain, LangGraph, FastAPI, Docker, AWS SAM, Terraform, LangSmith, Weights & Biases, Dynatrace, OpenTelemetry, PyTorch, scikit-learn, GitHub Workflow
3w
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
3w
Save
Mark Applied
Hide
Sr. BESS Operations Engineer
Teaneck or San Francisco or Irvine
OnsiteFull Time
5+ YOEBachelor's or Master's in engineering,5+ years BESS/renewable/grid operations experience,knowledge of power systems,industrial protocols,Linux/SSH,Ansible,ability to apply LLMs/ML for automation and monitoring.
Modbus, CANbus, DNP3, TCP/IP, Linux, SSH, Ansible, Python, SCADA, Confluence, LLMs
3w
Save
Mark Applied
Hide
Senior AI Security Automation Engineer
Quincy or Toronto or Princeton or Boston or Clifton or Austin
$120k-$203k/yr HybridFull Time
7+ YOE7+ years software engineering, 3+ years building AI/ML/LLM solutions; expertise in cloud-native architectures, RAG, AI evaluation/observability, CI/CD, security, and mentoring engineers.
AWS, Azure, GCP, Jenkins, Harness, Spinnaker, Argo CD, Python, JavaScript/TypeScript, Rust, Go (Golang), Bash, PowerShell, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, vector databases
1mo
Save
Mark Applied
Hide
IT Solutions Developer
Riverdale, New Jersey, United States
HybridFull Time
2+ YOEBachelor's degree, 2+ years software development experience, strong Python, React, TypeScript skills, LLM/AI and Azure experience, prompt engineering, CI/CD and IaC exposure, strong communication.
Python, React, TypeScript, LangChain, LangGraph, Autogen, Azure, Azure AI Search, Microsoft Fabric, Dataverse, LLM, Microsoft Copilot Studio, vector databases, GitHub Actions, Azure DevOps, Terraform, Ansible
2mo
Save
Mark Applied
Hide
Senior Operating Platform Engineer
New York City or Greenwich or Garden City or London or Dublin
$190k-$250k/yr OnsiteFull Time
7+ YOE7+ years professional software engineering with 4+ years full-stack experience; expertise with Angular, C#/.NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD; AI/LLM workflows and financial services experience; strong communication.
Angular, C#, .NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD, LLM
3w
Save
Mark Applied
Hide
AI Engineer and Project Lead
White Plains, New York, United States
$200k-$250k/yr OnsiteFull Time
4+ YOE4+ years software engineering/AI systems experience, Bachelor's in Computer Science/Engineering, strong Python skills, model training/fine-tuning and production deployment experience, familiarity with LLM frameworks and agentic systems.
Python, LoRA, EHR, APIs
2w
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
Strong experience with generative AI, LLMs and prompt engineering; hands-on development using .NET, React, Python; designing RAG pipelines, model training/fine-tuning, and Azure deployments.
.NET, React, Python, Claude, LangChain, LlamaIndex, Azure
2mo
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
Generative AI, LLMs, prompt engineering; hands-on with .NET, React, Python; AI/ML architecture design (RAG); model training and optimization; Azure deployment
.NET, React, Python, LangChain, LlamaIndex, Claude, Azure
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
2mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr OnsiteFull Time
6+ YOEBachelor in CS/AI/ML or equivalent; 6-8 years software lifecycle; ML/LLM/agent systems; Python/Java; production-grade AI delivery; strong evaluation and automation.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana
2mo
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
5+ YOEStrong experience in Generative AI, LLMs, prompt engineering; hands-on with .NET, React, Python; experience with RAG architectures, API integrations; Azure cloud; ability to deploy AI-enabled applications.
.NET, React, Python, LangChain, LlamaIndex, Claude, Azure, RAG
1mo
Save
Mark Applied
Hide
AI/ML Lead Engineer
Stamford or San Ramon or San Mateo
$180k-$212k/yr HybridFull Time
5+ YOE5+ years software engineering experience including 2+ years deploying LLM/GenAI or agent-based systems; expert Python; experience with LangChain/OpenAI tool calling, vector DBs (Pinecone, FAISS), RAG, observability, and distributed services.
LangChain, OpenAI, Python, Pinecone, FAISS, Docker, Kubernetes, AWS, Azure, GCP
2mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr HybridFull Time
6+ YOEBachelor’s in CS/AI/ML or equivalent experience; Master’s preferred. 6-8 years in software life cycle; strong ML/LLM/agent experience; Python/Java; distributed systems; ML tooling; productionization.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, GPU utilization, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana, Microservice architectures, Memory architectures, Vector DBs
6d
Save
Mark Applied
Hide
Senior AI Engineer
Greenwich, Connecticut, United States
OnsiteFull Time
Bachelor's degree or equivalent experience; enterprise technology integration, LLMs, generative AI, Python, GCP, APIs, SDLC, Agile, and secure production AI application experience required.
Large Language Models (LLMs), ADK, LangChain, Google Cloud Platform (GCP), Python, Vertex AI, Cloud Run, BigQuery, Retrieval-Augmented Generation (RAG), HRIS, CRM, ERP, APIs, SDLC, Agile
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Orange Apron Media (Remote)
Georgia or California or Colorado or Connecticut or Rhode Island or Nevada or New York City or Ithaca or Westchester County or Washington or United States
$80k-$180k/yr RemoteFull Time
3+ YOE3+ years software engineering experience building distributed AI/ML systems; strong skills in Python, Java, or Go; experience with multi-agent frameworks, LLMs, vector databases, cloud (AWS/GCP/Azure), and Git.
Python, Java, Go, LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, Pinecone, Milvus, Chroma, LangSmith, TruLens, Phoenix, AWS, GCP, Azure, Git
4d
Save
Mark Applied
Hide
IAM Engineer
Shelton, Connecticut, United States
$103k-$128k/yr OnsiteFull Time
3+ YOEBachelor's degree or equivalent experience; 3–5 years in IAM or related infrastructure/security work; Okta, SSO, SCIM, Active Directory, scripting, REST APIs, ITSM, Git, and CI/CD experience.
Okta, Active Directory, Microsoft Entra ID, Microsoft 365, ServiceNow, AWS IAM Identity Center, SCIM 2.0, SAML 2.0, OIDC, OAuth 2.0, PowerShell, Python, bash, REST APIs, Git, CI/CD, Ceridian Dayforce, Jamf, CrowdStrike Falcon Identity Protection, SIEM, OWASP API Security Top 10, Intune, Workday, UKG, SC-300, Model Context Protocol (MCP), LLM
Explore Jobs