60 llm engineer jobs at 33 companies in Shelton, CT
2mo
Save
Mark Applied
Hide
Lead Software Engineer (Python, LLM) - AskGartner
Irving or Stamford
$116k-$170k/yr HybridFull Time
Expert-level Python; backend services; FastAPI; AWS/Azure; SageMaker Pipelines; Pytest; PostgreSQL; Pandas; Git.
Python, Python FastAPI, AWS, Azure, AWS SageMaker Pipelines, pytest, Git, PostgreSQL, Parquet, JSON, CSV, Pandas, LangGraph, LangChain, OpenAI, Anthropic, Google, Locust, JMeter, AWS Athena, AWS S3, IAM, Splunk, AWS Secrets Manager, PySpark, Docker, Kubernetes, Terraform, OpenSearch, RAG systems, Cache technologies
3w
Save
Mark Applied
Hide
Senior AI Engineer
White Plains or United States
$85k-$105k/yr HybridFull Time
5+ YOE5+ years software engineering experience with ≥1 year building/operating AI/ML production systems; hands-on LLM, RAG, agent orchestration, Python, FastAPI, Databricks, AWS experience; governance and observability skills.
Claude Code, OpenAI Codex, GitHub Copilot, Claude, OpenAI Codex, Gemini, AWS ECS, AWS AgentCore Gateway, AWS AgentCore Harness, Databricks, LangChain, LangGraph, FastAPI, Docker, AWS SAM, Terraform, LangSmith, Weights & Biases, Dynatrace, OpenTelemetry, PyTorch, scikit-learn, GitHub Workflow
2mo
Save
Mark Applied
Hide
Senior Software Engineer
South Windsor or Charlotte
HybridFull Time
7+ YOE7+ years software development experience with 3+ years in a senior/lead capacity. Strong experience with Microsoft .NET 10, C#, React, TypeScript, Azure, PostgreSQL, cloud-native architectures, CI/CD, and AI/LLM integrations. Bachelor's required.
Microsoft .NET 10, C#, React, TypeScript, Entity Framework Core, PostgreSQL, CosmosDB, Microsoft Azure OpenAI Services, Microsoft Azure Functions, Microsoft Azure App Services, Microsoft Azure Service Bus, Microsoft Azure Key Vault, Microsoft Azure AI Search, Microsoft Azure DevOps, GitHub Actions, LangChain, Semantic Kernel, Docker, Kubernetes, Tailwind CSS, Redux, Zustand
2d
Save
Mark Applied
Hide
Quantitative Developer
New York City or Old Greenwich
$125k-$175k/yr OnsiteFull Time
Bachelor's or master's degree in computer science, engineering, or related field; practical Python or C++ experience; Bash, Linux, Git, LLM ecosystem knowledge, and strong analytical communication skills.
Python, C++, Bash, Linux, Git, Claude, LLM
1mo
Save
Mark Applied
Hide
AI Principal Engineer
Boston or Hartford or Missouri
$192k-$240k/yr OnsiteFull Time
Bachelor's in CS/Engineering/Math required (advanced degree preferred). Significant experience delivering production AI/ML systems, proficiency with Python/TypeScript/Rust, LLM and MLOps knowledge, model lifecycle and MLOps practices, and leadership of technical initiatives.
Python, TypeScript, Rust, LLM, MLOps
1w
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
$140k-$166k/yr HybridFull Time
15+ YOE5+ Mgmt15+ years in software architecture with 5+ years leading mainframe modernization; deep legacy/mainframe and cloud architecture experience; GenAI and leadership skills; Java, API, Angular, AWS expertise.
COBOL, JCL, CICS, VSAM, DB2, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation, Claude, LLM, CI/CD
2w
Save
Mark Applied
Hide
Cloud AI Engineer, Lead
Lincolnshire or Holtsville
$97k-$145k/yr HybridFull Time
5+ YOEBachelor's degree,5+ years operations-style experience,expertise with Google Gemini Enterprise and ADK,multi-cloud GenAI platform experience (GCP,Azure,OpenAI,Anthropic),LLM/RAG knowledge,Kubernetes/Docker/CI/CD experience,Python scripting,cloud security and RBAC integration.
Google Gemini Enterprise, Agent Development Kit (ADK), Google Cloud Platform (GCP), Azure, OpenAI, Anthropic, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), Kubernetes (GKE/AKS), Docker, CI/CD, Python, PII masking, Role-Based Access Control (RBAC)
1w
Save
Mark Applied
Hide
Software Engineer II - Enterprise AI Products
Hartford or Saint Paul
$120k-$199k/yr OnsiteFull Time
4+ YOEBachelor's in CS or related STEM and 4+ years software engineering; proficiency in Python, cloud (AWS/Azure), Kubernetes, CI/CD, REST APIs, LLM/AI integrations; strong communication and problem solving.
Python, JavaScript, TypeScript, Java, AWS, Azure, Kubernetes, RESTful APIs, Jenkins, GitHub Actions, Terraform, MongoDB, Temporal, MCP, LLM, Git, RAG
2mo
Save
Mark Applied
Hide
Senior Operating Platform Engineer
New York City or Greenwich or Garden City or London or Dublin
$190k-$250k/yr OnsiteFull Time
7+ YOE7+ years professional software engineering with 4+ years full-stack experience; expertise with Angular, C#/.NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD; AI/LLM workflows and financial services experience; strong communication.
Angular, C#, .NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD, LLM
1d
Save
Mark Applied
Hide
Forward Deployed Engineer
Greenwich, Connecticut, United States
OnsiteFull Time
Hands-on software engineering across the stack, experience deploying AI/LLM features, ability to own systems end-to-end, communicate with stakeholders, and ship reliable production software.
LLMs
4w
Save
Mark Applied
Hide
AI Engineer and Project Lead
White Plains, New York, United States
$200k-$250k/yr OnsiteFull Time
4+ YOE4+ years software engineering/AI systems experience, Bachelor's in Computer Science/Engineering, strong Python skills, model training/fine-tuning and production deployment experience, familiarity with LLM frameworks and agentic systems.
Python, LoRA, EHR, APIs
2w
Save
Mark Applied
Hide
Reliability Engineer
Charlotte or Chicago or Columbus or Hartford
$91k-$137k/yr HybridFull Time
3+ YOEBachelor’s or Master’s degree in computer science, engineering, or related field; 3+ years in infrastructure, SRE, or DevOps; experience with cloud, Kubernetes, observability, IaC, CI/CD, automation, databases, and Agile.
Splunk, Dynatrace, CloudWatch, Terraform, CloudFormation, AWS, Kubernetes, Python, Java, Oracle, SQL Server, AI/ML, LLM
2mo
Save
Mark Applied
Hide
Agentic AI Developer
Bloomfield or Raleigh or Lafayette
$81k-$194k/yr HybridFull Time
5+ YOE5+ years software engineering experience; deep hands-on expertise in Python, LLMs, prompt engineering, LangChain/LangGraph/LangSmith, RAG, embeddings, vector retrieval, agentic architectures; bachelor's degree in CS or related.
Python, LangChain, LangGraph, LangSmith, OpenAI, Azure OpenAI, SQL, Databricks, Anaconda
2mo
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
Generative AI, LLMs, prompt engineering; hands-on with .NET, React, Python; AI/ML architecture design (RAG); model training and optimization; Azure deployment
.NET, React, Python, LangChain, LlamaIndex, Claude, Azure
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
2w
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
HybridFull Time
15+ YOE15+ years software architecture experience with 5+ years leading mainframe modernization; deep mainframe and Java/AWS/GenAI expertise; strong leadership, reverse-engineering, and stakeholder management skills.
COBOL, JCL, CICS, VSAM, DB2, copybooks, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Claude, LLM, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation
2mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr OnsiteFull Time
6+ YOEBachelor in CS/AI/ML or equivalent; 6-8 years software lifecycle; ML/LLM/agent systems; Python/Java; production-grade AI delivery; strong evaluation and automation.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana
2w
Save
Mark Applied
Hide
Founding Software Engineer - AI & Operations (Full-Stack)
Wallingford, Connecticut, United States
OnsiteFull Time
3+ YOE3+ years engineering experience with ownership of a production system; strong full‑stack fundamentals, SQL, LLM API production integrations, OCR/document extraction, and self-directed problem solving.
OpenAI, Anthropic, OCR, MaintainX, Claude Code, Copilot, SQL
2mo
Save
Mark Applied
Hide
Staff Software Engineer - Hybrid
Charlotte or Hartford or Columbus
$116k-$174k/yr HybridFull Time
6+ YOE6+ years software engineering experience, Bachelor's in CS or related (or equivalent), authorized to work in US without sponsorship, hands-on Generative/Agentic AI and LLM experience, Python and/or Java, AWS services, Angular, Terraform, CI/CD (Jenkins/GitHub Actions), strong design and leadership skills.
Large language models (LLMs), Retrieval-augmented generation (RAG), LangChain, LangGraph, CrewAI, AutoGen, Python, Java, AWS, Lambda, DynamoDB, S3, SQS, SNS, API Gateway, ALB, Step Functions, IAM, Angular, Terraform, Jenkins, GitHub Actions, Guidewire ClaimCenter, FastAPI, Flask, Spring Boot, Docker, ECS, EKS, CloudWatch, Datadog, Splunk, pytest, JUnit, Karate
1mo
Save
Mark Applied
Hide
Principal Engineer, Optimization
East Hartford, Connecticut, United States
$108k-$205k/yr HybridFull Time
5+ YOEPhD in Operations Research/Computer Science/Applied Math, 5+ years industrial experience, expertise in discrete optimization, mixed-integer programming, deep learning for vision, and LLM/VLM integration; proficiency with Python, MATLAB, C++, and Git.
Python, MATLAB, C++, Git, Large language models (LLMs)
Explore Jobs