HiringCafe
Join our community

257 evaluations engineer jobs at 170 companies in Irvington, NJ

4w
Save
Mark Applied
Hide
Member of Technical Staff - Research Software Engineer - Safety Evaluations Infrastructure
New York City or San Francisco or London
OnsiteFull Time
Reflection AI
Reflection AI: Developing open-source frontier artificial intelligence models and coding agents.
Experience building secure, isolated infrastructure for sensitive model evaluations; strong Python skills; security engineering fundamentals; data pipeline and sandboxing experience.
Python
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Engineer, Evaluation
San Francisco or New York City
$150k-$250k/yr HybridFull Time
Distyl AI
Distyl AI: Builds AI-native orchestration platforms for enterprise operations.
2+ YOE2+ years software engineering, strong Python, experience with evaluation- or experiment-driven development, ability to encode human judgment into tests/graders, systems-oriented mindset, and willingness to travel 10–50%.
Python, LLM
Job PostingView all
2w
Save
Mark Applied
Hide
Founding Research Engineer
New York City or San Francisco
$215k-$330k/yr OnsiteFull Time
Ambral
Ambral: AI-powered account managers for enterprise customer success teams.
4+ YOE4+ years building production software or ML systems, including 2+ years with RL environments or evaluation/agent infrastructure; strong software engineering, data processing, reproducibility, and evaluation skills.
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Engineer
New York City, New York, United States
$207k-$250k/yr OnsiteFull Time
The Farmer's Dog
The Farmer's Dog: Personalized subscription service delivering fresh, human-grade dog food.
10+ YOE10+ years software engineering experience, architecture and systems leadership, cross-functional partnership, AI/automation evaluation, mentoring experience, strong communication and problem-solving skills.
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Developer Experience Engineer
New York City, New York, United States
$180k-$250k/yr OnsiteFull Time
Crosby
Crosby: AI-powered law firm for automated contract negotiation and review.
3+ YOE3+ years software engineering experience; strong Python; hands-on experience with LLMs and OpenAI/Anthropic APIs; experience building backend systems, experimentation, evaluation, and data pipelines; strong systems thinking and communication.
Python, LLMs, OpenAI, Anthropic
Job PostingView all
1mo
Save
Mark Applied
Hide
Design Specialist, Mechanical Engineer
New York or Nashville
$125k-$158k/yr OnsiteFull Time
Turner Construction
Turner Construction: Manages and constructs large-scale commercial and infrastructure projects.
4+ YOEB.S. in Engineering and 4+ years mechanical engineering experience; Professional Engineer (PE) required; design and construction experience with mechanical systems, codes, life-cycle cost and LEED evaluation.
Bluebeam Studio, Navisworks, AutoCAD, Revit, Rhino, SketchUp
Job PostingView all
1mo
Save
Mark Applied
Hide
Reviewer - Assistant Civil Engineer
Queens, New York, United States
$66k-$76k/yr OnsiteFull Time
City of New York
City of New York: Provides municipal services and administration for New York City.
1+ YOEBaccalaureate degree in civil engineering and 1 year civil engineering experience (or bachelor\u0002s plus master's). Ability to review engineering plans, evaluate backflow prevention applications, and prepare technical reports.
Microsoft Office, GIS, Adobe Acrobat
Job PostingView all
3w
Save
Mark Applied
Hide
Research Engineer
New York, New York, United States
$200k-$400k/yr OnsiteFull Time
Antimetal
Antimetal: Automates cloud infrastructure management and cost optimization using AI.
4+ YOE4+ years applied ML/research engineering experience, production ML and agent/LLM work, proficiency in Python and Typescript, evaluation pipeline experience, strong statistical and problem-solving skills.
Python, Typescript, LLM
Job PostingView all
2w
Save
Mark Applied
Hide
Forward Deployed Engineer
London or New York City
OnsiteFull Time
Pace
Pace: Automating insurance operations using AI-native agentic software platforms.
Partners with enterprise customers to expand use cases, build product solutions, ship codebase features, integrations, and evaluations, and collaborate with engineering on larger products.
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, ML Products
New York City, New York, United States
$175k-$275k/yr OnsiteFull Time
Mirage
Mirage: AI platform for automated video creation and professional editing.
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
Job PostingView all
1mo
Save
Mark Applied
Hide
Solutions Engineer, AI
New York, New York, United States
HybridFull Time
Valence
Valence: An AI-native building enterprise coaching platforms that transform how organizations learn and develop leaders.
3+ YOE3+ years in solutions/forward-deployed/consulting engineering; LLM/AI prompt design, memory/knowledge retrieval, evaluation and deployment; stakeholder management and product collaboration; strong communication and judgment.
LLM
Job PostingView all
3w
Save
Mark Applied
Hide
AI Solutions Engineer
Parsippany or Nashville
$140k-$170k/yr HybridFull Time
Managed Health Care Associates
Managed Health Care Associates: Provides group purchasing and software for post-acute care providers.
5+ YOE5+ years software engineering experience; deep experience with agentic AI, prompt engineering, agent orchestration, CI/CD, Azure/M365, AI security, and evaluation frameworks; strong communication and cloud-native skills.
GitHub, Visual Studio Code, GitHub Copilot, Claude, Azure, M365, Azure DevOps, GitHub Actions, SonarQube, Playwright, Jira, Azure Monitor, Application Insights, Model Context Protocol (MCP)
Job PostingView all
2w
Save
Mark Applied
Hide
Senior AI/ML Engineer
New York City, New York, United States
RemoteFull Time
Pypestream
Pypestream: Enterprise-grade conversational AI agents for customer service automation.
Build inference infrastructure, own model evaluation pipelines, optimize latency, and integrate orchestration engines with frontier large language models.
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff AI Research Engineer
New York or Pittsburgh
$221k-$331k/yr OnsiteFull Time
Duolingo
DuolingoNASDAQ: DUOL: Mobile application for language learning and basic education.
Proven AI research engineering experience across LLMs, bandits, and ML stack (feature engineering, training, fine-tuning, RL, evaluation, deployment, monitoring); leadership and mentoring experience; advanced degree or equivalent experience.
LLMs, bandit models, large-scale neural network models
Job PostingView all
1mo
Save
Mark Applied
Hide
Applied AI Engineer
New York, New York, United States
$220k-$300k/yr OnsiteFull Time
Santé
Santé: Provides an operating system and AI tools that run local retail stores.
5+ YOE5+ years building and shipping production AI products; strong software engineering with TypeScript and/or Python; full ML/LLM lifecycle experience; experiment design, evaluation, and monitoring; strong collaboration and communication.
TypeScript, Python, Next.js, tRPC, Prisma, PostgreSQL, pgvector, Vercel, Langfuse, Devin, Claude, Codex
Job PostingView all
3mo
Save
Mark Applied
Hide
Communications Engineer
Aberdeen or Fort Belvoir or Huntsville or Austin or Tobyhanna or Letterkenny Army Depot or Lakehurst
OnsiteFull Time
Envision Innovative Solutions
Envision Innovative Solutions: Provides technical engineering and mission support to government agencies.
5+ YOE5+ years in communications systems; design, develop, and evaluate systems; coordinate vendor engagement and installation; assess equipment for acquisition or replacement.
Job PostingView all
1w
Save
Mark Applied
Hide
Oliver Wyman - Senior Lead AI Engineer
New York City or Boston or Toronto or Montreal
$195k-$250k/yr HybridFull Time
Marsh McLennan
Marsh McLennanNYSE: MRSH: Provides global insurance brokerage, risk management, and professional consulting services.
Expertise designing and deploying large-scale AI systems, agent platforms, LLMs, data engineering, evaluation, observability, mathematical modeling, and modern AI programming languages.
Azure Foundry, AWS Bedrock, Gemini Enterprise Agent Platform, LLM, Open-Source
Job PostingView all
2mo
Save
Mark Applied
Hide
Innovation Senior AI Engineer
Boston or Jersey City or New York City or Massachusetts or New York or New Jersey or United States or Poland
$210k-$260k/yr OnsiteFull Time
Brown Brothers Harriman
Brown Brothers Harriman: Providing global investment management, custody, and private banking services.
3+ YOE3+ years AI/ML engineering (5+ years product development), hands-on leader, expert Python, production LLM/RAG/agent experience, workflow orchestration, Azure/AWS, vector DBs, evaluation and responsible-AI practices.
Python, Agno, LangChain, LlamaIndex, Temporal, Prefect, Airflow, Azure, AWS, Pinecone, Weaviate, pgvector, LLM, RAG
Job PostingView all
22h
Save
Mark Applied
Hide
Staff AI/ML Engineer
New York City or Montreal
$230k-$280k/yr HybridFull Time
Tetrix
Tetrix: A financial technology startup providing AI-powered insights for alternative investment markets.
10+ YOE10+ years of engineering experience with recent production AI/ML focus, especially LLMs, agents, evaluations, or data extraction pipelines. Strong Python skills required; fintech experience valued.
Python, LLMs, PDFs, Excel
Job PostingView all
2w
Save
Mark Applied
Hide
Forward Deployed Engineer
New York City, New York, United States
$150k-$200k/yr HybridFull Time
Take2 AI
Take2 AI: AI agents for automated healthcare recruitment and candidate interviewing.
2+ YOERequires 2+ years of engineering experience, 1+ year with production LLM, NLP, or AI agent systems, strong full-stack skills, agent workflow deployment, evaluation frameworks, customer-facing delivery, and analytical problem-solving.
Python, GPT, Claude, Gemini, LLaMA, Mistral
Job PostingView all

Explore Jobs

Expand Your Job Search