48 llm engineer jobs at 33 companies in Beacon, NY
2mo
Save
Mark Applied
Hide
Lead Software Engineer (Python, LLM) - AskGartner
Irving or Stamford
$116k-$170k/yr HybridFull Time
Expert-level Python; backend services; FastAPI; AWS/Azure; SageMaker Pipelines; Pytest; PostgreSQL; Pandas; Git.
Python, Python FastAPI, AWS, Azure, AWS SageMaker Pipelines, pytest, Git, PostgreSQL, Parquet, JSON, CSV, Pandas, LangGraph, LangChain, OpenAI, Anthropic, Google, Locust, JMeter, AWS Athena, AWS S3, IAM, Splunk, AWS Secrets Manager, PySpark, Docker, Kubernetes, Terraform, OpenSearch, RAG systems, Cache technologies
3mo
Save
Mark Applied
Hide
AI Engineer- Manager
Orlando or Montvale or Dallas
OnsiteFull Time
5+ YOEMinimum five years software engineering experience building and deploying AI/ML systems; Bachelor’s degree required (Master’s preferred); expertise with LLMs, RAG, data integration, CI/CD, and mentoring skills.
LLMs, Azure OpenAI, Google Cloud, LangChain, LangGraph, Semantic Kernel, Azure AI Search, Databricks, Microsoft Fabric, Azure DevOps, Git, CI/CD, RAG
2w
Save
Mark Applied
Hide
Senior AI Engineer
White Plains or United States
$85k-$105k/yr HybridFull Time
5+ YOE5+ years software engineering experience with ≥1 year building/operating AI/ML production systems; hands-on LLM, RAG, agent orchestration, Python, FastAPI, Databricks, AWS experience; governance and observability skills.
Claude Code, OpenAI Codex, GitHub Copilot, Claude, OpenAI Codex, Gemini, AWS ECS, AWS AgentCore Gateway, AWS AgentCore Harness, Databricks, LangChain, LangGraph, FastAPI, Docker, AWS SAM, Terraform, LangSmith, Weights & Biases, Dynatrace, OpenTelemetry, PyTorch, scikit-learn, GitHub Workflow
3w
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
3w
Save
Mark Applied
Hide
Sr. BESS Operations Engineer
Teaneck or San Francisco or Irvine
OnsiteFull Time
5+ YOEBachelor's or Master's in engineering,5+ years BESS/renewable/grid operations experience,knowledge of power systems,industrial protocols,Linux/SSH,Ansible,ability to apply LLMs/ML for automation and monitoring.
Modbus, CANbus, DNP3, TCP/IP, Linux, SSH, Ansible, Python, SCADA, Confluence, LLMs
2w
Save
Mark Applied
Hide
Senior AI Security Automation Engineer
Quincy or Toronto or Princeton or Boston or Clifton or Austin
$120k-$203k/yr HybridFull Time
7+ YOE7+ years software engineering, 3+ years building AI/ML/LLM solutions; expertise in cloud-native architectures, RAG, AI evaluation/observability, CI/CD, security, and mentoring engineers.
AWS, Azure, GCP, Jenkins, Harness, Spinnaker, Argo CD, Python, JavaScript/TypeScript, Rust, Go (Golang), Bash, PowerShell, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, vector databases
1mo
Save
Mark Applied
Hide
Senior Lead Python Engineer - Applications Development Group Manager - C14 - RUTHERFORD
Rutherford, New Jersey, United States
$177k-$265k/yr HybridFull Time
12+ YOE8+ Mgmt12+ years in enterprise application, data engineering, or AI platform engineering; 8+ years leading multi-team Agile organizations; advanced expertise in Python, PySpark, Databricks, LLM/GenAI platforms; experience with Kubernetes/OpenShift, Kafka, cloud (AWS/Azure/GCP), and frontend frameworks.
Python, PySpark, Databricks, Devin.AI, GitHub Copilot, LLMs, Google ADK, Gemini, Flash, FastAPI, Spring Boot, Kubernetes, OpenShift, CI/CD, Kafka, React, Angular, AWS, Azure, GCP, Docker, MCP, Data Mesh
1mo
Save
Mark Applied
Hide
IT Solutions Developer
Riverdale, New Jersey, United States
HybridFull Time
2+ YOEBachelor's degree, 2+ years software development experience, strong Python, React, TypeScript skills, LLM/AI and Azure experience, prompt engineering, CI/CD and IaC exposure, strong communication.
Python, React, TypeScript, LangChain, LangGraph, Autogen, Azure, Azure AI Search, Microsoft Fabric, Dataverse, LLM, Microsoft Copilot Studio, vector databases, GitHub Actions, Azure DevOps, Terraform, Ansible
1mo
Save
Mark Applied
Hide
AI Agent Engineer
Stamford, Connecticut, United States
$140k-$180k/yr HybridFull Time
3+ YOE3+ years software development experience with Python, hands-on LLM API experience (Anthropic/OpenAI), prompt/context engineering, multi-agent orchestration, security-first mindset, prototyping and production experience, and a bachelor's in a related field.
Python, Anthropic, OpenAI, C#, Angular, SQL Server, Markdown, MCP servers, LLM
2mo
Save
Mark Applied
Hide
Lead AI Platform Engineer
New York or Fairfield or New Jersey or California
$175k-$200k/yr OnsiteFull Time
7+ YOE7+ years building production backend or full-stack systems, 2+ years building LLM-backed systems, deep AWS experience (Bedrock preferred), TypeScript/Node or Python proficiency, agent framework experience, API design and platform ownership, strong communication and mentorship skills.
Vercel AI SDK, AWS Bedrock, AgentCore, AWS Lambda, ECS, App Runner, RDS, Cognito, TypeScript, Node, Next.js, Python, PostgreSQL, MCP, Salesforce, Snowflake, Bitbucket, Kiro, Claude Code
2mo
Save
Mark Applied
Hide
Senior Operating Platform Engineer
New York City or Greenwich or Garden City or London or Dublin
$190k-$250k/yr OnsiteFull Time
7+ YOE7+ years professional software engineering with 4+ years full-stack experience; expertise with Angular, C#/.NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD; AI/LLM workflows and financial services experience; strong communication.
Angular, C#, .NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD, LLM
3d
Save
Mark Applied
Hide
AI Engineer
Norwalk, Connecticut, United States
$135k-$168k/yr RemoteFull Time
5+ YOE5+ years software/application/data engineering experience, 2+ years hands-on AI/ML/generative AI experience, proficiency with Python/JavaScript/TypeScript/PowerShell/SQL, knowledge of LLMs, RAG, prompt engineering, APIs, and secure development.
Python, JavaScript, TypeScript, PowerShell, SQL, Microsoft 365, Azure, Power Platform, Copilot Studio, GitHub, M365 Copilot
4w
Save
Mark Applied
Hide
AI Solutions Engineer
New York City, New York, United States
$120k-$140k/yr OnsiteFull Time
4+ YOEBachelor's degree or equivalent, 4+ years related experience; hands-on experience with programming, APIs, data engineering, LLMs, prompt engineering, and enterprise AI solutions; strong communication and documentation skills.
Python, JavaScript, TypeScript, PHP, APIs, CI/CD
2w
Save
Mark Applied
Hide
AI Engineer and Project Lead
White Plains, New York, United States
$200k-$250k/yr OnsiteFull Time
4+ YOE4+ years software engineering/AI systems experience, Bachelor's in Computer Science/Engineering, strong Python skills, model training/fine-tuning and production deployment experience, familiarity with LLM frameworks and agentic systems.
Python, LoRA, EHR, APIs
1w
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
Strong experience with generative AI, LLMs and prompt engineering; hands-on development using .NET, React, Python; designing RAG pipelines, model training/fine-tuning, and Azure deployments.
.NET, React, Python, Claude, LangChain, LlamaIndex, Azure
2mo
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
Generative AI, LLMs, prompt engineering; hands-on with .NET, React, Python; AI/ML architecture design (RAG); model training and optimization; Azure deployment
.NET, React, Python, LangChain, LlamaIndex, Claude, Azure
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
3w
Save
Mark Applied
Hide
Staff ML Engineer, StockStory
Englewood Cliffs, New Jersey, United States
$140k-$165k/yr HybridFull Time
5+ YOEBachelor's in CS or equivalent, 5+ years software engineering with ML/AI systems, production ML experience, proficiency in Python/TypeScript/Java, experience with LLMs and TensorFlow or PyTorch, leadership in AI initiatives.
Python, TypeScript, Java, TensorFlow, PyTorch
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Air AI
Mountain View or Los Angeles or San Francisco or New York City
$170k-$230k/yr HybridFull Time
4+ YOE4+ years software engineering; strong fullstack Python backend and TypeScript/React frontend; Docker and Kubernetes; experience with LLM APIs; production AI features; able to ship quickly.
Python, TypeScript, React, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
5+ YOEStrong experience in Generative AI, LLMs, prompt engineering; hands-on with .NET, React, Python; experience with RAG architectures, API integrations; Azure cloud; ability to deploy AI-enabled applications.
.NET, React, Python, LangChain, LlamaIndex, Claude, Azure, RAG
Explore Jobs