66 llm engineer jobs at 36 companies in Trumbull, CT
2mo
Save
Mark Applied
Hide
Lead Software Engineer (Python, LLM) - AskGartner
Irving or Stamford
$116k-$170k/yr HybridFull Time
Expert-level Python; backend services; FastAPI; AWS/Azure; SageMaker Pipelines; Pytest; PostgreSQL; Pandas; Git.
Python, Python FastAPI, AWS, Azure, AWS SageMaker Pipelines, pytest, Git, PostgreSQL, Parquet, JSON, CSV, Pandas, LangGraph, LangChain, OpenAI, Anthropic, Google, Locust, JMeter, AWS Athena, AWS S3, IAM, Splunk, AWS Secrets Manager, PySpark, Docker, Kubernetes, Terraform, OpenSearch, RAG systems, Cache technologies
3mo
Save
Mark Applied
Hide
AI Engineer- Manager
Orlando or Montvale or Dallas
OnsiteFull Time
5+ YOEMinimum five years software engineering experience building and deploying AI/ML systems; Bachelor’s degree required (Master’s preferred); expertise with LLMs, RAG, data integration, CI/CD, and mentoring skills.
LLMs, Azure OpenAI, Google Cloud, LangChain, LangGraph, Semantic Kernel, Azure AI Search, Databricks, Microsoft Fabric, Azure DevOps, Git, CI/CD, RAG
2w
Save
Mark Applied
Hide
Senior AI Engineer
White Plains or United States
$85k-$105k/yr HybridFull Time
5+ YOE5+ years software engineering experience with ≥1 year building/operating AI/ML production systems; hands-on LLM, RAG, agent orchestration, Python, FastAPI, Databricks, AWS experience; governance and observability skills.
Claude Code, OpenAI Codex, GitHub Copilot, Claude, OpenAI Codex, Gemini, AWS ECS, AWS AgentCore Gateway, AWS AgentCore Harness, Databricks, LangChain, LangGraph, FastAPI, Docker, AWS SAM, Terraform, LangSmith, Weights & Biases, Dynatrace, OpenTelemetry, PyTorch, scikit-learn, GitHub Workflow
3w
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
3w
Save
Mark Applied
Hide
Sr. BESS Operations Engineer
Teaneck or San Francisco or Irvine
OnsiteFull Time
5+ YOEBachelor's or Master's in engineering,5+ years BESS/renewable/grid operations experience,knowledge of power systems,industrial protocols,Linux/SSH,Ansible,ability to apply LLMs/ML for automation and monitoring.
Modbus, CANbus, DNP3, TCP/IP, Linux, SSH, Ansible, Python, SCADA, Confluence, LLMs
1mo
Save
Mark Applied
Hide
AI Principal Engineer
Boston or Hartford or Missouri
$192k-$240k/yr OnsiteFull Time
Bachelor's in CS/Engineering/Math required (advanced degree preferred). Significant experience delivering production AI/ML systems, proficiency with Python/TypeScript/Rust, LLM and MLOps knowledge, model lifecycle and MLOps practices, and leadership of technical initiatives.
Python, TypeScript, Rust, LLM, MLOps
3d
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
$140k-$166k/yr HybridFull Time
15+ YOE5+ Mgmt15+ years in software architecture with 5+ years leading mainframe modernization; deep legacy/mainframe and cloud architecture experience; GenAI and leadership skills; Java, API, Angular, AWS expertise.
COBOL, JCL, CICS, VSAM, DB2, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation, Claude, LLM, CI/CD
2d
Save
Mark Applied
Hide
Software Engineer II - Enterprise AI Products
Hartford or Saint Paul
$120k-$199k/yr OnsiteFull Time
4+ YOEBachelor's in CS or related STEM and 4+ years software engineering; proficiency in Python, cloud (AWS/Azure), Kubernetes, CI/CD, REST APIs, LLM/AI integrations; strong communication and problem solving.
Python, JavaScript, TypeScript, Java, AWS, Azure, Kubernetes, RESTful APIs, Jenkins, GitHub Actions, Terraform, MongoDB, Temporal, MCP, LLM, Git, RAG
1w
Save
Mark Applied
Hide
Cloud AI Engineer, Lead
Lincolnshire or Holtsville
$97k-$145k/yr HybridFull Time
5+ YOEBachelor's degree,5+ years operations-style experience,expertise with Google Gemini Enterprise and ADK,multi-cloud GenAI platform experience (GCP,Azure,OpenAI,Anthropic),LLM/RAG knowledge,Kubernetes/Docker/CI/CD experience,Python scripting,cloud security and RBAC integration.
Google Gemini Enterprise, Agent Development Kit (ADK), Google Cloud Platform (GCP), Azure, OpenAI, Anthropic, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), Kubernetes (GKE/AKS), Docker, CI/CD, Python, PII masking, Role-Based Access Control (RBAC)
2mo
Save
Mark Applied
Hide
Senior Operating Platform Engineer
New York City or Greenwich or Garden City or London or Dublin
$190k-$250k/yr OnsiteFull Time
7+ YOE7+ years professional software engineering with 4+ years full-stack experience; expertise with Angular, C#/.NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD; AI/LLM workflows and financial services experience; strong communication.
Angular, C#, .NET, Python, Microsoft SQL Server, Snowflake, AWS, Kubernetes, CI/CD, LLM
4w
Save
Mark Applied
Hide
AI Solutions Engineer
New York City, New York, United States
$120k-$140k/yr OnsiteFull Time
4+ YOEBachelor's degree or equivalent, 4+ years related experience; hands-on experience with programming, APIs, data engineering, LLMs, prompt engineering, and enterprise AI solutions; strong communication and documentation skills.
Python, JavaScript, TypeScript, PHP, APIs, CI/CD
2w
Save
Mark Applied
Hide
AI Engineer and Project Lead
White Plains, New York, United States
$200k-$250k/yr OnsiteFull Time
4+ YOE4+ years software engineering/AI systems experience, Bachelor's in Computer Science/Engineering, strong Python skills, model training/fine-tuning and production deployment experience, familiarity with LLM frameworks and agentic systems.
Python, LoRA, EHR, APIs
1mo
Save
Mark Applied
Hide
Agentic AI Developer
Bloomfield or Raleigh or Lafayette
$81k-$194k/yr HybridFull Time
5+ YOE5+ years software engineering experience; deep hands-on expertise in Python, LLMs, prompt engineering, LangChain/LangGraph/LangSmith, RAG, embeddings, vector retrieval, agentic architectures; bachelor's degree in CS or related.
Python, LangChain, LangGraph, LangSmith, OpenAI, Azure OpenAI, SQL, Databricks, Anaconda
1mo
Save
Mark Applied
Hide
Staff Software Engineer - Hybrid
Charlotte or Columbus or Hartford
$116k-$174k/yr HybridFull Time
6+ YOE6+ years software engineering experience, Bachelor's degree or equivalent, US work authorization, hands-on Generative/Agentic AI and LLM experience, proficiency in Python and/or Java, AWS and Terraform experience, Angular and CI/CD familiarity.
LangChain, LangGraph, CrewAI, AutoGen, Python, Java, Amazon Web Services (AWS), Lambda, DynamoDB, S3, SQS, SNS, API Gateway, ALB, Step Functions, IAM, Angular, Terraform, Jenkins, GitHub Actions, Guidewire ClaimCenter, FastAPI, Flask, Spring Boot, Docker, ECS, EKS, CloudWatch, Datadog, Splunk, pytest, JUnit, Karate, vector databases, RAG
2mo
Save
Mark Applied
Hide
Generative AI Lead Engineer
Dallas or Stamford or Chicago
$120k-$140k/yr HybridFull Time
Generative AI, LLMs, prompt engineering; hands-on with .NET, React, Python; AI/ML architecture design (RAG); model training and optimization; Azure deployment
.NET, React, Python, LangChain, LlamaIndex, Claude, Azure
1mo
Save
Mark Applied
Hide
Senior AI Engineer
United States or New York City or Palm Beach or Los Angeles or Miami or Greenwich or Westchester County or The Hamptons or San Francisco or Manhattan
$190k-$250k/yr RemoteFull Time
4+ YOE4+ years building and operating LLM-powered production ML systems, strong Python, backend framework experience (FastAPI/Flask), LLM orchestration and retrieval design, Snowflake/dbt/Dagster/Airflow familiarity, evaluation systems, HIPAA/PHI knowledge, and strong written communication.
Python, FastAPI, Flask, Snowflake, dbt, Dagster, Airflow, vLLM, Triton, TGI, SGLang, LOINC, SNOMED CT, ICD-10, RxNorm, FHIR, HL7
3w
Save
Mark Applied
Hide
Staff ML Engineer, StockStory
Englewood Cliffs, New Jersey, United States
$140k-$165k/yr HybridFull Time
5+ YOEBachelor's in CS or equivalent, 5+ years software engineering with ML/AI systems, production ML experience, proficiency in Python/TypeScript/Java, experience with LLMs and TensorFlow or PyTorch, leadership in AI initiatives.
Python, TypeScript, Java, TensorFlow, PyTorch
1w
Save
Mark Applied
Hide
Mainframe Developer
Hartford, Connecticut, United States
HybridFull Time
15+ YOE15+ years software architecture experience with 5+ years leading mainframe modernization; deep mainframe and Java/AWS/GenAI expertise; strong leadership, reverse-engineering, and stakeholder management skills.
COBOL, JCL, CICS, VSAM, DB2, copybooks, Java, Spring Boot, Spring Cloud, REST, GraphQL, Angular, AWS, Claude, LLM, Docker, Kubernetes, ECS, EKS, Terraform, CloudFormation
2mo
Save
Mark Applied
Hide
AI Engineer
Plano or Purchase or Chicago
$94k-$156k/yr OnsiteFull Time
6+ YOEBachelor in CS/AI/ML or equivalent; 6-8 years software lifecycle; ML/LLM/agent systems; Python/Java; production-grade AI delivery; strong evaluation and automation.
Python, Java, FastAPI, asyncio, Pydantic, LangChain, LangGraph, CrewAI, MLflow, Arise, Docker, Kubernetes, Ray, Kafka, gRPC, Redis, Prometheus, OpenTelemetry, Grafana
6d
Save
Mark Applied
Hide
Founding Software Engineer - AI & Operations (Full-Stack)
Wallingford, Connecticut, United States
OnsiteFull Time
3+ YOE3+ years engineering experience with ownership of a production system; strong full‑stack fundamentals, SQL, LLM API production integrations, OCR/document extraction, and self-directed problem solving.
OpenAI, Anthropic, OCR, MaintainX, Claude Code, Copilot, SQL
Explore Jobs