38 llm engineer jobs at 17 companies in Madison, CT
3w
Save
Mark Applied
Hide
AI/LLM Engineer
Hartford, Connecticut, United States
$102k-$204k/yr HybridFull Time
5+ YOE5+ years experience building production AI/ML systems, strong Python and software engineering skills, hands-on LLM, RAG, embeddings and vector search experience, and degree in CS/Engineering/Data Science or equivalent experience.
Python, SQL, OpenAI, Anthropic, Google Vertex AI, LangChain, LlamaIndex, Semantic Kernel, Pinecone, Weaviate, FAISS, MongoDB Atlas Vector Search, Spark, Pandas, FastAPI, Flask, REST/gRPC, AWS, Azure, Google Cloud Platform (GCP), Docker, Kubernetes, CI/CD
2mo
Save
Mark Applied
Hide
Senior Software Engineer
South Windsor or Charlotte
HybridFull Time
7+ YOE7+ years software development experience with 3+ years in a senior/lead capacity. Strong experience with Microsoft .NET 10, C#, React, TypeScript, Azure, PostgreSQL, cloud-native architectures, CI/CD, and AI/LLM integrations. Bachelor's required.
Microsoft .NET 10, C#, React, TypeScript, Entity Framework Core, PostgreSQL, CosmosDB, Microsoft Azure OpenAI Services, Microsoft Azure Functions, Microsoft Azure App Services, Microsoft Azure Service Bus, Microsoft Azure Key Vault, Microsoft Azure AI Search, Microsoft Azure DevOps, GitHub Actions, LangChain, Semantic Kernel, Docker, Kubernetes, Tailwind CSS, Redux, Zustand
1mo
Save
Mark Applied
Hide
AI Principal Engineer
Boston or Hartford or Missouri
$192k-$240k/yr OnsiteFull Time
Bachelor's in CS/Engineering/Math required (advanced degree preferred). Significant experience delivering production AI/ML systems, proficiency with Python/TypeScript/Rust, LLM and MLOps knowledge, model lifecycle and MLOps practices, and leadership of technical initiatives.
Python, TypeScript, Rust, LLM, MLOps
1w
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
$140k-$166k/yr HybridFull Time
15+ YOE5+ Mgmt15+ years in software architecture with 5+ years leading mainframe modernization; deep legacy/mainframe and cloud architecture experience; GenAI and leadership skills; Java, API, Angular, AWS expertise.
COBOL, JCL, CICS, VSAM, DB2, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation, Claude, LLM, CI/CD
1w
Save
Mark Applied
Hide
Software Engineer II - Enterprise AI Products
Hartford or Saint Paul
$120k-$199k/yr OnsiteFull Time
4+ YOEBachelor's in CS or related STEM and 4+ years software engineering; proficiency in Python, cloud (AWS/Azure), Kubernetes, CI/CD, REST APIs, LLM/AI integrations; strong communication and problem solving.
Python, JavaScript, TypeScript, Java, AWS, Azure, Kubernetes, RESTful APIs, Jenkins, GitHub Actions, Terraform, MongoDB, Temporal, MCP, LLM, Git, RAG
2w
Save
Mark Applied
Hide
Cloud AI Engineer, Lead
Lincolnshire or Holtsville
$97k-$145k/yr HybridFull Time
5+ YOEBachelor's degree,5+ years operations-style experience,expertise with Google Gemini Enterprise and ADK,multi-cloud GenAI platform experience (GCP,Azure,OpenAI,Anthropic),LLM/RAG knowledge,Kubernetes/Docker/CI/CD experience,Python scripting,cloud security and RBAC integration.
Google Gemini Enterprise, Agent Development Kit (ADK), Google Cloud Platform (GCP), Azure, OpenAI, Anthropic, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), Kubernetes (GKE/AKS), Docker, CI/CD, Python, PII masking, Role-Based Access Control (RBAC)
1w
Save
Mark Applied
Hide
Reliability Engineer
Charlotte or Chicago or Columbus or Hartford
$91k-$137k/yr HybridFull Time
3+ YOEBachelor’s or Master’s degree in computer science, engineering, or related field; 3+ years in infrastructure, SRE, or DevOps; experience with cloud, Kubernetes, observability, IaC, CI/CD, automation, databases, and Agile.
Splunk, Dynatrace, CloudWatch, Terraform, CloudFormation, AWS, Kubernetes, Python, Java, Oracle, SQL Server, AI/ML, LLM
1mo
Save
Mark Applied
Hide
Agentic AI Developer
Bloomfield or Raleigh or Lafayette
$81k-$194k/yr HybridFull Time
5+ YOE5+ years software engineering experience; deep hands-on expertise in Python, LLMs, prompt engineering, LangChain/LangGraph/LangSmith, RAG, embeddings, vector retrieval, agentic architectures; bachelor's degree in CS or related.
Python, LangChain, LangGraph, LangSmith, OpenAI, Azure OpenAI, SQL, Databricks, Anaconda
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
2w
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
HybridFull Time
15+ YOE15+ years software architecture experience with 5+ years leading mainframe modernization; deep mainframe and Java/AWS/GenAI expertise; strong leadership, reverse-engineering, and stakeholder management skills.
COBOL, JCL, CICS, VSAM, DB2, copybooks, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Claude, LLM, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation
1w
Save
Mark Applied
Hide
Founding Software Engineer - AI & Operations (Full-Stack)
Wallingford, Connecticut, United States
OnsiteFull Time
3+ YOE3+ years engineering experience with ownership of a production system; strong full‑stack fundamentals, SQL, LLM API production integrations, OCR/document extraction, and self-directed problem solving.
OpenAI, Anthropic, OCR, MaintainX, Claude Code, Copilot, SQL
2mo
Save
Mark Applied
Hide
Staff Software Engineer - Hybrid
Charlotte or Hartford or Columbus
$116k-$174k/yr HybridFull Time
6+ YOE6+ years software engineering experience, Bachelor's in CS or related (or equivalent), authorized to work in US without sponsorship, hands-on Generative/Agentic AI and LLM experience, Python and/or Java, AWS services, Angular, Terraform, CI/CD (Jenkins/GitHub Actions), strong design and leadership skills.
Large language models (LLMs), Retrieval-augmented generation (RAG), LangChain, LangGraph, CrewAI, AutoGen, Python, Java, AWS, Lambda, DynamoDB, S3, SQS, SNS, API Gateway, ALB, Step Functions, IAM, Angular, Terraform, Jenkins, GitHub Actions, Guidewire ClaimCenter, FastAPI, Flask, Spring Boot, Docker, ECS, EKS, CloudWatch, Datadog, Splunk, pytest, JUnit, Karate
4w
Save
Mark Applied
Hide
Principal Engineer, Optimization
East Hartford, Connecticut, United States
$108k-$205k/yr HybridFull Time
5+ YOEPhD in Operations Research/Computer Science/Applied Math, 5+ years industrial experience, expertise in discrete optimization, mixed-integer programming, deep learning for vision, and LLM/VLM integration; proficiency with Python, MATLAB, C++, and Git.
Python, MATLAB, C++, Git, Large language models (LLMs)
1d
Save
Mark Applied
Hide
SDET Automation Engineer (Hammer & Cyara)
Hartford or Wellesley
$55k-$96k/yr OnsiteFull Time
5+ YOERequires 5+ years of software engineering experience, including 3+ years in SDET or test automation; Java or Node.js, API testing, automation frameworks, CI/CD, conversational AI, and LLM evaluation experience.
Java, Node.js, JUnit, Jest, SoapUI, Postman, Bruno, Playwright, Selenium, Cucumber, Hammer, Cyara, GitHub Actions
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Enterprise AI Products
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
6+ YOEBachelor's in CS or STEM required, 6+ years software engineering, production ML/AI and LLM experience, Python proficiency, cloud (AWS/Azure), Kubernetes, REST APIs, CI/CD, Terraform, MongoDB, Temporal, strong leadership and stakeholder skills.
Python, JavaScript, TypeScript, Java, AWS, Azure, Kubernetes, RESTful APIs, Jenkins, GitHub Actions, Terraform, MongoDB, Temporal, MCP server
3mo
Save
Mark Applied
Hide
GenAI Python Systems Engineer-Manager
Chicago or Raleigh or Charlotte or Cincinnati or Cleveland or Columbia or Columbus or Dallas or Baltimore or Rochester or Rosemont or Sacramento or Boston or St. Louis or Salt Lake City or San Antonio or San Diego or San Francisco or Silicon Valley or Seattle or Albany or Stamford or Tampa or Atlanta or Toledo or Houston or Irvine or Jacksonville or Kansas City or Los Angeles or Louisville or Fayetteville or Melville or Miami or Milwaukee or Minneapolis or Nashville or New Orleans or Los Angeles or New York or Portland or Philadelphia or San Antonio or Denver or Des Moines or Indianapolis or Irvine or Fresno or Hartford or Tampa or Miami or San Francisco or Washington or New York or Portland or Philadelphia or Phoenix or Pittsburgh or Seattle or Denver or Portland or New York
$99k-$232k/yr OnsiteFull Time
5+ YOE5 years of experience in data, analytics, and AI; proficient in Python and SQL; Docker experience; cloud (AWS/Azure/GCP); AI/LLM techniques; prompt engineering; DevOps with cloud services; travel up to 80%
Python, SQL, Docker, AWS, Azure, GCP, Terraform, CloudFormation
5d
Save
Mark Applied
Hide
IAM Engineer
Shelton, Connecticut, United States
$103k-$128k/yr OnsiteFull Time
3+ YOEBachelor's degree or equivalent experience; 3–5 years in IAM or related infrastructure/security work; Okta, SSO, SCIM, Active Directory, scripting, REST APIs, ITSM, Git, and CI/CD experience.
Okta, Active Directory, Microsoft Entra ID, Microsoft 365, ServiceNow, AWS IAM Identity Center, SCIM 2.0, SAML 2.0, OIDC, OAuth 2.0, PowerShell, Python, bash, REST APIs, Git, CI/CD, Ceridian Dayforce, Jamf, CrowdStrike Falcon Identity Protection, SIEM, OWASP API Security Top 10, Intune, Workday, UKG, SC-300, Model Context Protocol (MCP), LLM
2mo
Save
Mark Applied
Hide
Software Engineer AI
Ridgefield, Connecticut, United States
$75k-$181k/yr OnsiteFull Time
Proficiency in Python, LangChain/LangGraph, RAG pipelines, vector DBs, familiarity with major LLM providers, AI evaluation/testing, Git, CI/CD, Docker, and strong communication skills. US work authorization required.
Python, LangChain, LangGraph, OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, LangSmith, Weights & Biases, FAISS, Chroma, Pinecone, Weaviate, Git, Docker, GitHub Copilot, Cursor
2mo
Save
Mark Applied
Hide
Knowledge Engineer Specialist
Houston or Milwaukee or Dallas or Columbus or Cincinnati or New York or Cleveland or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or Morristown or San Francisco or Boston or Denver or Philadelphia or Overland Park or Los Angeles or Charlotte or Seattle or Carmel or Arlington or Atlanta or Beaverton or Nashville or Detroit or San Diego
$54k-$206k/yr HybridFull Time
2+ YOEBachelor's degree or equivalent experience; minimum 2 years experience in knowledge graph technologies, schema/ontology design, or graph-based solutions; experience with data pipelines and databases; ability to lead teams and work with clients.
RDF, SPARQL, LPG, SHACL, Stardog, Neo4J, Amazon Neptune, AWS, Azure, GCP, Python, Tensorflow, PyTorch, Apache NiFi, Airflow, LLM
5d
Save
Mark Applied
Hide
Cloud Solutions Architect / Database Engineer / AI Platform Architect (CT , Hartford )
Hartford, Connecticut, United States
$150k-$180k/yr OnsiteFull Time
Highly experienced architect with expertise in cloud architecture, C#/.NET, SQL Server, REST APIs, application security, Azure or AWS, enterprise integrations, and production AI/LLM applications.
C#, .NET, SQL Server, REST, ASP.NET Core, OAuth 2.0, OpenID Connect, JWT, SSO, RBAC, SSL/TLS, CI/CD, Retrieval-Augmented Generation (RAG), OpenAI, Azure OpenAI, Anthropic, Google AI, Large Language Model (LLM)
Explore Jobs