17 llm engineer jobs at 12 companies in Wallkill, NY
3mo
Save
Mark Applied
Hide
AI Engineer- Manager
Orlando or Montvale or Dallas
OnsiteFull Time
5+ YOEMinimum five years software engineering experience building and deploying AI/ML systems; Bachelor’s degree required (Master’s preferred); expertise with LLMs, RAG, data integration, CI/CD, and mentoring skills.
LLMs, Azure OpenAI, Google Cloud, LangChain, LangGraph, Semantic Kernel, Azure AI Search, Databricks, Microsoft Fabric, Azure DevOps, Git, CI/CD, RAG
2w
Save
Mark Applied
Hide
Senior AI Engineer
White Plains or United States
$85k-$105k/yr HybridFull Time
5+ YOE5+ years software engineering experience with ≥1 year building/operating AI/ML production systems; hands-on LLM, RAG, agent orchestration, Python, FastAPI, Databricks, AWS experience; governance and observability skills.
Claude Code, OpenAI Codex, GitHub Copilot, Claude, OpenAI Codex, Gemini, AWS ECS, AWS AgentCore Gateway, AWS AgentCore Harness, Databricks, LangChain, LangGraph, FastAPI, Docker, AWS SAM, Terraform, LangSmith, Weights & Biases, Dynatrace, OpenTelemetry, PyTorch, scikit-learn, GitHub Workflow
1mo
Save
Mark Applied
Hide
IT Solutions Developer
Riverdale, New Jersey, United States
HybridFull Time
2+ YOEBachelor's degree, 2+ years software development experience, strong Python, React, TypeScript skills, LLM/AI and Azure experience, prompt engineering, CI/CD and IaC exposure, strong communication.
Python, React, TypeScript, LangChain, LangGraph, Autogen, Azure, Azure AI Search, Microsoft Fabric, Dataverse, LLM, Microsoft Copilot Studio, vector databases, GitHub Actions, Azure DevOps, Terraform, Ansible
2mo
Save
Mark Applied
Hide
Senior Operating Platform Engineer
New York City or Greenwich or Garden City or London or Dublin
$190k-$250k/yr OnsiteFull Time
7+ YOE7+ years professional software engineering with 4+ years full-stack experience; expertise with Angular, C#/.NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD; AI/LLM workflows and financial services experience; strong communication.
Angular, C#, .NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD, LLM
3w
Save
Mark Applied
Hide
AI Engineer and Project Lead
White Plains, New York, United States
$200k-$250k/yr OnsiteFull Time
4+ YOE4+ years software engineering/AI systems experience, Bachelor's in Computer Science/Engineering, strong Python skills, model training/fine-tuning and production deployment experience, familiarity with LLM frameworks and agentic systems.
Python, LoRA, EHR, APIs
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
2mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr OnsiteFull Time
6+ YOEBachelor in CS/AI/ML or equivalent; 6-8 years software lifecycle; ML/LLM/agent systems; Python/Java; production-grade AI delivery; strong evaluation and automation.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana
2mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr HybridFull Time
6+ YOEBachelor’s in CS/AI/ML or equivalent experience; Master’s preferred. 6-8 years in software life cycle; strong ML/LLM/agent experience; Python/Java; distributed systems; ML tooling; productionization.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, GPU utilization, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana, Microservice architectures, Memory architectures, Vector DBs
6d
Save
Mark Applied
Hide
Senior AI Engineer
Greenwich, Connecticut, United States
OnsiteFull Time
Bachelor's degree or equivalent experience; enterprise technology integration, LLMs, generative AI, Python, GCP, APIs, SDLC, Agile, and secure production AI application experience required.
Large Language Models (LLMs), ADK, LangChain, Google Cloud Platform (GCP), Python, Vertex AI, Cloud Run, BigQuery, Retrieval-Augmented Generation (RAG), HRIS, CRM, ERP, APIs, SDLC, Agile
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Orange Apron Media (Remote)
Georgia or California or Colorado or Connecticut or Rhode Island or Nevada or New York City or Ithaca or Westchester County or Washington or United States
$80k-$180k/yr RemoteFull Time
3+ YOE3+ years software engineering experience building distributed AI/ML systems; strong skills in Python, Java, or Go; experience with multi-agent frameworks, LLMs, vector databases, cloud (AWS/GCP/Azure), and Git.
Python, Java, Go, LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, Pinecone, Milvus, Chroma, LangSmith, TruLens, Phoenix, AWS, GCP, Azure, Git
3w
Save
Mark Applied
Hide
Senior Software Engineer - Confluent Applied AI for DevProd
Poughkeepsie or Lowell or Rochester or Tucson or Research Triangle Park or Armonk or Boston or Bellevue or Atlanta or San Jose or Dallas or Austin or San Francisco or Seattle
$111k-$207k/yr HybridFull Time
Experience building backend production systems, proficiency in Java/Go/Python, cloud-native and Kubernetes experience, LLM application to engineering workflows, EMR not mentioned, strong testing and product mindset, collaborative skills.
Java, Go, Python, Kubernetes, GitHub, Jira, Slack, CI, LLMs
2mo
Save
Mark Applied
Hide
Software Engineer AI
Ridgefield, Connecticut, United States
$75k-$181k/yr OnsiteFull Time
Proficiency in Python, LangChain/LangGraph, RAG pipelines, vector DBs, familiarity with major LLM providers, AI evaluation/testing, Git, CI/CD, Docker, and strong communication skills. US work authorization required.
Python, LangChain, LangGraph, OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, LangSmith, Weights & Biases, FAISS, Chroma, Pinecone, Weaviate, Git, Docker, GitHub Copilot, Cursor
3mo
Save
Mark Applied
Hide
AI Tech Lead- Manager
Orlando or Montvale or Dallas
OnsiteFull Time
5+ YOE5+ years full-stack development experience, proven technical leadership, expertise with Azure cloud, AKS, KEDA, LangChain/LangGraph or Semantic Kernel, LLMs (Azure OpenAI or Google Cloud), Azure DevOps, Git and CI/CD; strong communication and problem-solving skills.
Azure, Azure Kubernetes Service (AKS), KEDA, LangChain, LangGraph, Semantic Kernel, Azure OpenAI, Google Cloud, Azure DevOps, Git, CI/CD
3w
Save
Mark Applied
Hide
Associate Director, AI Security Frontier Engineering
Montvale, New Jersey, United States
$153k-$297k/yr OnsiteFull Time
8+ YOE8+ years security or cloud security experience securing frontier-AI platforms; hands-on AI/ML/LLM security, adversarial testing, cloud controls across AWS/Azure/GCP; strong detection engineering and communication skills.
Anthropic, OpenAI, Microsoft M365 Copilot, Google Vertex AI, SIEM, AWS, Azure, GCP
2mo
Save
Mark Applied
Hide
AI Architect- Associate Director
Washington or Orlando or Montvale or New York City or Dallas
OnsiteFull Time
8+ YOE8+ years in software development and architecture, cloud-native AI experience, bachelor's degree required (master's preferred), proficiency with LLM frameworks and Azure services, Agile and CI/CD experience.
LangSmith, LangChain, LangGraph, AKS, Azure AI Search, Service Bus, Databricks, Microsoft Fabric, Azure DevOps, Git
3mo
Save
Mark Applied
Hide
Data Scientist- Senior Associate
Orlando or Montvale or Dallas
OnsiteFull Time
3+ YOE3+ years data science or ML engineering experience, bachelor’s degree required (master’s preferred), experience with LLMs and generative AI, Python, Azure/Databricks/Microsoft Fabric, Git and Azure DevOps, strong problem-solving and communication skills.
LangChain, LangGraph, Semantic Kernel, LangSmith, Python, Azure, Databricks, Microsoft Fabric, Git, Azure DevOps
3mo
Save
Mark Applied
Hide
AI Scientist, Agentic AI Discovery
Paramus, New Jersey, United States
$135k-$160k/yr OnsiteFull Time
3+ YOEMaster's degree in AI-related field, 3+ years AI/ML experience, authorized to work in the U.S. without sponsorship, strong Python and AI engineering skills, experience with PyTorch, Hugging Face, LangChain, LangGraph, LlamaIndex, and working knowledge of LLMs and biomedical data.
Python, PyTorch, Hugging Face, LangChain, LangGraph, LlamaIndex
Explore Jobs