51 llm engineer jobs at 28 companies in Cheshire, CT
2mo
Save
Mark Applied
Hide
Lead Software Engineer (Python, LLM) - AskGartner
Irving or Stamford
$116k-$170k/yr HybridFull Time
Expert-level Python; backend services; FastAPI; AWS/Azure; SageMaker Pipelines; Pytest; PostgreSQL; Pandas; Git.
Python, Python FastAPI, AWS, Azure, AWS SageMaker Pipelines, pytest, Git, PostgreSQL, Parquet, JSON, CSV, Pandas, LangGraph, LangChain, OpenAI, Anthropic, Google, Locust, JMeter, AWS Athena, AWS S3, IAM, Splunk, AWS Secrets Manager, PySpark, Docker, Kubernetes, Terraform, OpenSearch, RAG systems, Cache technologies
2mo
Save
Mark Applied
Hide
Senior Software Engineer
South Windsor or Charlotte
HybridFull Time
7+ YOE7+ years software development experience with 3+ years in a senior/lead capacity. Strong experience with Microsoft .NET 10, C#, React, TypeScript, Azure, PostgreSQL, cloud-native architectures, CI/CD, and AI/LLM integrations. Bachelor's required.
Microsoft .NET 10, C#, React, TypeScript, Entity Framework Core, PostgreSQL, CosmosDB, Microsoft Azure OpenAI Services, Microsoft Azure Functions, Microsoft Azure App Services, Microsoft Azure Service Bus, Microsoft Azure Key Vault, Microsoft Azure AI Search, Microsoft Azure DevOps, GitHub Actions, LangChain, Semantic Kernel, Docker, Kubernetes, Tailwind CSS, Redux, Zustand
1d
Save
Mark Applied
Hide
Quantitative Developer
New York City or Old Greenwich
$125k-$175k/yr OnsiteFull Time
Bachelor's or master's degree in computer science, engineering, or related field; practical Python or C++ experience; Bash, Linux, Git, LLM ecosystem knowledge, and strong analytical communication skills.
Python, C++, Bash, Linux, Git, Claude, LLM
1mo
Save
Mark Applied
Hide
AI Principal Engineer
Boston or Hartford or Missouri
$192k-$240k/yr OnsiteFull Time
Bachelor's in CS/Engineering/Math required (advanced degree preferred). Significant experience delivering production AI/ML systems, proficiency with Python/TypeScript/Rust, LLM and MLOps knowledge, model lifecycle and MLOps practices, and leadership of technical initiatives.
Python, TypeScript, Rust, LLM, MLOps
1w
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
$140k-$166k/yr HybridFull Time
15+ YOE5+ Mgmt15+ years in software architecture with 5+ years leading mainframe modernization; deep legacy/mainframe and cloud architecture experience; GenAI and leadership skills; Java, API, Angular, AWS expertise.
COBOL, JCL, CICS, VSAM, DB2, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation, Claude, LLM, CI/CD
2w
Save
Mark Applied
Hide
Cloud AI Engineer, Lead
Lincolnshire or Holtsville
$97k-$145k/yr HybridFull Time
5+ YOEBachelor's degree,5+ years operations-style experience,expertise with Google Gemini Enterprise and ADK,multi-cloud GenAI platform experience (GCP,Azure,OpenAI,Anthropic),LLM/RAG knowledge,Kubernetes/Docker/CI/CD experience,Python scripting,cloud security and RBAC integration.
Google Gemini Enterprise, Agent Development Kit (ADK), Google Cloud Platform (GCP), Azure, OpenAI, Anthropic, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), Kubernetes (GKE/AKS), Docker, CI/CD, Python, PII masking, Role-Based Access Control (RBAC)
1mo
Save
Mark Applied
Hide
Senior Applied AI Engineer
Holyoke, Massachusetts, United States
$141k-$171k/yr HybridFull Time
3+ YOEMaster's in EE/CS (PhD preferred); 3+ years power systems experience; 3+ years deploying AI/ML in production; cloud (AWS, Azure, GCP) experience; Python and software engineering skills; MLOps and agent/LLM familiarity.
Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Python, PSS®E, PSCAD, PowerWorld, DSATools, MLOps, CI/CD, RAG, LLM
2mo
Save
Mark Applied
Hide
Senior Operating Platform Engineer
New York City or Greenwich or Garden City or London or Dublin
$190k-$250k/yr OnsiteFull Time
7+ YOE7+ years professional software engineering with 4+ years full-stack experience; expertise with Angular, C#/.NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD; AI/LLM workflows and financial services experience; strong communication.
Angular, C#, .NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD, LLM
1mo
Save
Mark Applied
Hide
AI Engineer
Springfield or New York City or Boston
$141k-$185k/yr HybridFull Time
4+ YOE4+ years in data science/AI engineering with production ML/LLM experience, Python and SQL proficiency, ability to build and evaluate AI solutions, and a Bachelor’s in a quantitative field (Master’s preferred).
LLMs, Bedrock AgentCore, AWS Strands, Azure, MCP/A2A protocols, Python, SQL, vector databases, Degreed
1d
Save
Mark Applied
Hide
Forward Deployed Engineer
Greenwich, Connecticut, United States
OnsiteFull Time
Hands-on software engineering across the stack, experience deploying AI/LLM features, ability to own systems end-to-end, communicate with stakeholders, and ship reliable production software.
LLMs
2w
Save
Mark Applied
Hide
Reliability Engineer
Charlotte or Chicago or Columbus or Hartford
$91k-$137k/yr HybridFull Time
3+ YOEBachelor’s or Master’s degree in computer science, engineering, or related field; 3+ years in infrastructure, SRE, or DevOps; experience with cloud, Kubernetes, observability, IaC, CI/CD, automation, databases, and Agile.
Splunk, Dynatrace, CloudWatch, Terraform, CloudFormation, AWS, Kubernetes, Python, Java, Oracle, SQL Server, AI/ML, LLM
2mo
Save
Mark Applied
Hide
Agentic AI Developer
Bloomfield or Raleigh or Lafayette
$81k-$194k/yr HybridFull Time
5+ YOE5+ years software engineering experience; deep hands-on expertise in Python, LLMs, prompt engineering, LangChain/LangGraph/LangSmith, RAG, embeddings, vector retrieval, agentic architectures; bachelor's degree in CS or related.
Python, LangChain, LangGraph, LangSmith, OpenAI, Azure OpenAI, SQL, Databricks, Anaconda
2mo
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
Generative AI, LLMs, prompt engineering; hands-on with .NET, React, Python; AI/ML architecture design (RAG); model training and optimization; Azure deployment
.NET, React, Python, LangChain, LlamaIndex, Claude, Azure
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
2w
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
HybridFull Time
15+ YOE15+ years software architecture experience with 5+ years leading mainframe modernization; deep mainframe and Java/AWS/GenAI expertise; strong leadership, reverse-engineering, and stakeholder management skills.
COBOL, JCL, CICS, VSAM, DB2, copybooks, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Claude, LLM, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation
2w
Save
Mark Applied
Hide
Founding Software Engineer - AI & Operations (Full-Stack)
Wallingford, Connecticut, United States
OnsiteFull Time
3+ YOE3+ years engineering experience with ownership of a production system; strong full‑stack fundamentals, SQL, LLM API production integrations, OCR/document extraction, and self-directed problem solving.
OpenAI, Anthropic, OCR, MaintainX, Claude Code, Copilot, SQL
2mo
Save
Mark Applied
Hide
Staff Software Engineer - Hybrid
Charlotte or Hartford or Columbus
$116k-$174k/yr HybridFull Time
6+ YOE6+ years software engineering experience, Bachelor's in CS or related (or equivalent), authorized to work in US without sponsorship, hands-on Generative/Agentic AI and LLM experience, Python and/or Java, AWS services, Angular, Terraform, CI/CD (Jenkins/GitHub Actions), strong design and leadership skills.
Large language models (LLMs), Retrieval-augmented generation (RAG), LangChain, LangGraph, CrewAI, AutoGen, Python, Java, AWS, Lambda, DynamoDB, S3, SQS, SNS, API Gateway, ALB, Step Functions, IAM, Angular, Terraform, Jenkins, GitHub Actions, Guidewire ClaimCenter, FastAPI, Flask, Spring Boot, Docker, ECS, EKS, CloudWatch, Datadog, Splunk, pytest, JUnit, Karate
1mo
Save
Mark Applied
Hide
Principal Engineer, Optimization
East Hartford, Connecticut, United States
$108k-$205k/yr HybridFull Time
5+ YOEPhD in Operations Research/Computer Science/Applied Math, 5+ years industrial experience, expertise in discrete optimization, mixed-integer programming, deep learning for vision, and LLM/VLM integration; proficiency with Python, MATLAB, C++, and Git.
Python, MATLAB, C++, Git, Large language models (LLMs)
2mo
Save
Mark Applied
Hide
AI/ML Lead Engineer
Stamford or San Ramon or San Mateo
$180k-$212k/yr HybridFull Time
5+ YOE5+ years software engineering experience including 2+ years deploying LLM/GenAI or agent-based systems; expert Python; experience with LangChain/OpenAI tool calling, vector DBs (Pinecone, FAISS), RAG, observability, and distributed services.
LangChain, OpenAI, Python, Pinecone, FAISS, Docker, Kubernetes, AWS, Azure, GCP
3w
Save
Mark Applied
Hide
Senior Software Development Engineer - Microservices
Hartford, Connecticut, United States
$102k-$204k/yr HybridFull Time
5+ YOE2+ Mgmt5+ years software engineering, 2+ years technical lead experience; strong Python and API framework skills; experience with microservices, GCP, Kubernetes/GKE, Docker, CI/CD, Kafka, BigQuery/BigTable/SQL; hands-on GenAI/LLM/RAG/Agentic AI and prompt engineering.
Python, FastAPI, Flask, Google Cloud Platform (GCP), Kubernetes (GKE), Docker, CI/CD, GitHub, Kafka, BigQuery, BigTable, SQL, Gemini, Vertex AI, OpenAI, Claude
Explore Jobs