56 llm engineer jobs at 29 companies in Derby, CT
3w
Save
Mark Applied
Hide
AI/LLM Engineer
Hartford, Connecticut, United States
$102k-$204k/yr HybridFull Time
5+ YOE5+ years experience building production AI/ML systems, strong Python and software engineering skills, hands-on LLM, RAG, embeddings and vector search experience, and degree in CS/Engineering/Data Science or equivalent experience.
Python, SQL, OpenAI, Anthropic, Google Vertex AI, LangChain, LlamaIndex, Semantic Kernel, Pinecone, Weaviate, FAISS, MongoDB Atlas Vector Search, Spark, Pandas, FastAPI, Flask, REST/gRPC, AWS, Azure, Google Cloud Platform (GCP), Docker, Kubernetes, CI/CD
2mo
Save
Mark Applied
Hide
Lead Software Engineer (Python, LLM) - AskGartner
Irving or Stamford
$116k-$170k/yr HybridFull Time
Expert-level Python; backend services; FastAPI; AWS/Azure; SageMaker Pipelines; Pytest; PostgreSQL; Pandas; Git.
Python, Python FastAPI, AWS, Azure, AWS SageMaker Pipelines, pytest, Git, PostgreSQL, Parquet, JSON, CSV, Pandas, LangGraph, LangChain, OpenAI, Anthropic, Google, Locust, JMeter, AWS Athena, AWS S3, IAM, Splunk, AWS Secrets Manager, PySpark, Docker, Kubernetes, Terraform, OpenSearch, RAG systems, Cache technologies
2w
Save
Mark Applied
Hide
Senior AI Engineer
White Plains or United States
$85k-$105k/yr HybridFull Time
5+ YOE5+ years software engineering experience with ≥1 year building/operating AI/ML production systems; hands-on LLM, RAG, agent orchestration, Python, FastAPI, Databricks, AWS experience; governance and observability skills.
Claude Code, OpenAI Codex, GitHub Copilot, Claude, OpenAI Codex, Gemini, AWS ECS, AWS AgentCore Gateway, AWS AgentCore Harness, Databricks, LangChain, LangGraph, FastAPI, Docker, AWS SAM, Terraform, LangSmith, Weights & Biases, Dynatrace, OpenTelemetry, PyTorch, scikit-learn, GitHub Workflow
2mo
Save
Mark Applied
Hide
Senior Software Engineer
South Windsor or Charlotte
HybridFull Time
7+ YOE7+ years software development experience with 3+ years in a senior/lead capacity. Strong experience with Microsoft .NET 10, C#, React, TypeScript, Azure, PostgreSQL, cloud-native architectures, CI/CD, and AI/LLM integrations. Bachelor's required.
Microsoft .NET 10, C#, React, TypeScript, Entity Framework Core, PostgreSQL, CosmosDB, Microsoft Azure OpenAI Services, Microsoft Azure Functions, Microsoft Azure App Services, Microsoft Azure Service Bus, Microsoft Azure Key Vault, Microsoft Azure AI Search, Microsoft Azure DevOps, GitHub Actions, LangChain, Semantic Kernel, Docker, Kubernetes, Tailwind CSS, Redux, Zustand
1mo
Save
Mark Applied
Hide
AI Principal Engineer
Boston or Hartford or Missouri
$192k-$240k/yr OnsiteFull Time
Bachelor's in CS/Engineering/Math required (advanced degree preferred). Significant experience delivering production AI/ML systems, proficiency with Python/TypeScript/Rust, LLM and MLOps knowledge, model lifecycle and MLOps practices, and leadership of technical initiatives.
Python, TypeScript, Rust, LLM, MLOps
1w
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
$140k-$166k/yr HybridFull Time
15+ YOE5+ Mgmt15+ years in software architecture with 5+ years leading mainframe modernization; deep legacy/mainframe and cloud architecture experience; GenAI and leadership skills; Java, API, Angular, AWS expertise.
COBOL, JCL, CICS, VSAM, DB2, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation, Claude, LLM, CI/CD
1w
Save
Mark Applied
Hide
Software Engineer II - Enterprise AI Products
Hartford or Saint Paul
$120k-$199k/yr OnsiteFull Time
4+ YOEBachelor's in CS or related STEM and 4+ years software engineering; proficiency in Python, cloud (AWS/Azure), Kubernetes, CI/CD, REST APIs, LLM/AI integrations; strong communication and problem solving.
Python, JavaScript, TypeScript, Java, AWS, Azure, Kubernetes, RESTful APIs, Jenkins, GitHub Actions, Terraform, MongoDB, Temporal, MCP, LLM, Git, RAG
2w
Save
Mark Applied
Hide
Cloud AI Engineer, Lead
Lincolnshire or Holtsville
$97k-$145k/yr HybridFull Time
5+ YOEBachelor's degree,5+ years operations-style experience,expertise with Google Gemini Enterprise and ADK,multi-cloud GenAI platform experience (GCP,Azure,OpenAI,Anthropic),LLM/RAG knowledge,Kubernetes/Docker/CI/CD experience,Python scripting,cloud security and RBAC integration.
Google Gemini Enterprise, Agent Development Kit (ADK), Google Cloud Platform (GCP), Azure, OpenAI, Anthropic, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), Kubernetes (GKE/AKS), Docker, CI/CD, Python, PII masking, Role-Based Access Control (RBAC)
2mo
Save
Mark Applied
Hide
Senior Operating Platform Engineer
New York City or Greenwich or Garden City or London or Dublin
$190k-$250k/yr OnsiteFull Time
7+ YOE7+ years professional software engineering with 4+ years full-stack experience; expertise with Angular, C#/.NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD; AI/LLM workflows and financial services experience; strong communication.
Angular, C#, .NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD, LLM
3w
Save
Mark Applied
Hide
AI Engineer and Project Lead
White Plains, New York, United States
$200k-$250k/yr OnsiteFull Time
4+ YOE4+ years software engineering/AI systems experience, Bachelor's in Computer Science/Engineering, strong Python skills, model training/fine-tuning and production deployment experience, familiarity with LLM frameworks and agentic systems.
Python, LoRA, EHR, APIs
1w
Save
Mark Applied
Hide
Reliability Engineer
Charlotte or Chicago or Columbus or Hartford
$91k-$137k/yr HybridFull Time
3+ YOEBachelor’s or Master’s degree in computer science, engineering, or related field; 3+ years in infrastructure, SRE, or DevOps; experience with cloud, Kubernetes, observability, IaC, CI/CD, automation, databases, and Agile.
Splunk, Dynatrace, CloudWatch, Terraform, CloudFormation, AWS, Kubernetes, Python, Java, Oracle, SQL Server, AI/ML, LLM
1mo
Save
Mark Applied
Hide
Agentic AI Developer
Bloomfield or Raleigh or Lafayette
$81k-$194k/yr HybridFull Time
5+ YOE5+ years software engineering experience; deep hands-on expertise in Python, LLMs, prompt engineering, LangChain/LangGraph/LangSmith, RAG, embeddings, vector retrieval, agentic architectures; bachelor's degree in CS or related.
Python, LangChain, LangGraph, LangSmith, OpenAI, Azure OpenAI, SQL, Databricks, Anaconda
2mo
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
Generative AI, LLMs, prompt engineering; hands-on with .NET, React, Python; AI/ML architecture design (RAG); model training and optimization; Azure deployment
.NET, React, Python, LangChain, LlamaIndex, Claude, Azure
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
2w
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
HybridFull Time
15+ YOE15+ years software architecture experience with 5+ years leading mainframe modernization; deep mainframe and Java/AWS/GenAI expertise; strong leadership, reverse-engineering, and stakeholder management skills.
COBOL, JCL, CICS, VSAM, DB2, copybooks, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Claude, LLM, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation
2mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr OnsiteFull Time
6+ YOEBachelor in CS/AI/ML or equivalent; 6-8 years software lifecycle; ML/LLM/agent systems; Python/Java; production-grade AI delivery; strong evaluation and automation.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana
1w
Save
Mark Applied
Hide
Founding Software Engineer - AI & Operations (Full-Stack)
Wallingford, Connecticut, United States
OnsiteFull Time
3+ YOE3+ years engineering experience with ownership of a production system; strong full‑stack fundamentals, SQL, LLM API production integrations, OCR/document extraction, and self-directed problem solving.
OpenAI, Anthropic, OCR, MaintainX, Claude Code, Copilot, SQL
2mo
Save
Mark Applied
Hide
Staff Software Engineer - Hybrid
Charlotte or Hartford or Columbus
$116k-$174k/yr HybridFull Time
6+ YOE6+ years software engineering experience, Bachelor's in CS or related (or equivalent), authorized to work in US without sponsorship, hands-on Generative/Agentic AI and LLM experience, Python and/or Java, AWS services, Angular, Terraform, CI/CD (Jenkins/GitHub Actions), strong design and leadership skills.
Large language models (LLMs), Retrieval-augmented generation (RAG), LangChain, LangGraph, CrewAI, AutoGen, Python, Java, AWS, Lambda, DynamoDB, S3, SQS, SNS, API Gateway, ALB, Step Functions, IAM, Angular, Terraform, Jenkins, GitHub Actions, Guidewire ClaimCenter, FastAPI, Flask, Spring Boot, Docker, ECS, EKS, CloudWatch, Datadog, Splunk, pytest, JUnit, Karate
1mo
Save
Mark Applied
Hide
AI/ML Lead Engineer
Stamford or San Ramon or San Mateo
$180k-$212k/yr HybridFull Time
5+ YOE5+ years software engineering experience including 2+ years deploying LLM/GenAI or agent-based systems; expert Python; experience with LangChain/OpenAI tool calling, vector DBs (Pinecone, FAISS), RAG, observability, and distributed services.
LangChain, OpenAI, Python, Pinecone, FAISS, Docker, Kubernetes, AWS, Azure, GCP
4w
Save
Mark Applied
Hide
Principal Engineer, Optimization
East Hartford, Connecticut, United States
$108k-$205k/yr HybridFull Time
5+ YOEPhD in Operations Research/Computer Science/Applied Math, 5+ years industrial experience, expertise in discrete optimization, mixed-integer programming, deep learning for vision, and LLM/VLM integration; proficiency with Python, MATLAB, C++, and Git.
Python, MATLAB, C++, Git, Large language models (LLMs)
Explore Jobs