HiringCafe
Join our community

278 evaluations engineer jobs at 175 companies in New York

4w
Save
Mark Applied
Hide
Member of Technical Staff - Research Software Engineer - Safety Evaluations Infrastructure
New York City or San Francisco or London
OnsiteFull Time
Reflection AI
Reflection AI: Developing open-source frontier artificial intelligence models and coding agents.
Experience building secure, isolated infrastructure for sensitive model evaluations; strong Python skills; security engineering fundamentals; data pipeline and sandboxing experience.
Python
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Engineer, Evaluation
San Francisco or New York City
$150k-$250k/yr HybridFull Time
Distyl AI
Distyl AI: Builds AI-native orchestration platforms for enterprise operations.
2+ YOE2+ years software engineering, strong Python, experience with evaluation- or experiment-driven development, ability to encode human judgment into tests/graders, systems-oriented mindset, and willingness to travel 10–50%.
Python, LLM
Job PostingView all
2w
Save
Mark Applied
Hide
Founding Research Engineer
New York City or San Francisco
$215k-$330k/yr OnsiteFull Time
Ambral
Ambral: AI-powered account managers for enterprise customer success teams.
4+ YOE4+ years building production software or ML systems, including 2+ years with RL environments or evaluation/agent infrastructure; strong software engineering, data processing, reproducibility, and evaluation skills.
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Engineer
New York City, New York, United States
$207k-$250k/yr OnsiteFull Time
The Farmer's Dog
The Farmer's Dog: Personalized subscription service delivering fresh, human-grade dog food.
10+ YOE10+ years software engineering experience, architecture and systems leadership, cross-functional partnership, AI/automation evaluation, mentoring experience, strong communication and problem-solving skills.
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Developer Experience Engineer
New York City, New York, United States
$180k-$250k/yr OnsiteFull Time
Crosby
Crosby: AI-powered law firm for automated contract negotiation and review.
3+ YOE3+ years software engineering experience; strong Python; hands-on experience with LLMs and OpenAI/Anthropic APIs; experience building backend systems, experimentation, evaluation, and data pipelines; strong systems thinking and communication.
Python, LLMs, OpenAI, Anthropic
Job PostingView all
1mo
Save
Mark Applied
Hide
Design Specialist, Mechanical Engineer
New York or Nashville
$125k-$158k/yr OnsiteFull Time
Turner Construction
Turner Construction: Manages and constructs large-scale commercial and infrastructure projects.
4+ YOEB.S. in Engineering and 4+ years mechanical engineering experience; Professional Engineer (PE) required; design and construction experience with mechanical systems, codes, life-cycle cost and LEED evaluation.
Bluebeam Studio, Navisworks, AutoCAD, Revit, Rhino, SketchUp
Job PostingView all
1mo
Save
Mark Applied
Hide
Evaluation and ML Systems Engineer, AI Safety and Security Engineering
Santa Clara or North Carolina or Tennessee or New York or California or Florida
$152k-$242k/yr HybridFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
5+ YOE5+ years ML engineering or evaluation experience, bachelor's degree or equivalent, benchmark and metrics design, Python engineering, experiment tracking, and statistical evaluation skills.
Python
Job PostingView all
2w
Save
Mark Applied
Hide
Product Engineer
New Hartford, New York, United States
OnsiteFull Time
Precision Castparts Corp.
Precision Castparts Corp.NYSE: BRK.B: Manufacturer of complex metal components for aerospace and industrial markets.
Bachelor's degree in engineering required, preferably metallurgy or materials science. Requires VAR/VIM/ESR melting knowledge, technical evaluation, reporting, communication, customer interaction, and troubleshooting skills.
VAR, VIM, ESR
Job PostingView all
1mo
Save
Mark Applied
Hide
Reviewer - Assistant Civil Engineer
Queens, New York, United States
$66k-$76k/yr OnsiteFull Time
City of New York
City of New York: Provides municipal services and administration for New York City.
1+ YOEBaccalaureate degree in civil engineering and 1 year civil engineering experience (or bachelor\u0002s plus master's). Ability to review engineering plans, evaluate backflow prevention applications, and prepare technical reports.
Microsoft Office, GIS, Adobe Acrobat
Job PostingView all
3w
Save
Mark Applied
Hide
Research Engineer
New York, New York, United States
$200k-$400k/yr OnsiteFull Time
Antimetal
Antimetal: Automates cloud infrastructure management and cost optimization using AI.
4+ YOE4+ years applied ML/research engineering experience, production ML and agent/LLM work, proficiency in Python and Typescript, evaluation pipeline experience, strong statistical and problem-solving skills.
Python, Typescript, LLM
Job PostingView all
2mo
Save
Mark Applied
Hide
Construction Materials Engineer
Rochester, New York, United States
$73k-$95k/yr FieldFull Time
Atlantic Testing Laboratories
Atlantic Testing Laboratories: A full-service engineering support firm providing construction materials testing and geotechnical services across New York State.
B.S. in civil engineering or related; NYS PE or EIT; ability to lift 50 lbs; strong communication, plan review, multitasking; perform materials engineering, geotechnical evaluations, and special inspections.
Laboratory Information Management System (LIMS)
Job PostingView all
2w
Save
Mark Applied
Hide
Forward Deployed Engineer
London or New York City
OnsiteFull Time
Pace
Pace: Automating insurance operations using AI-native agentic software platforms.
Partners with enterprise customers to expand use cases, build product solutions, ship codebase features, integrations, and evaluations, and collaborate with engineering on larger products.
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, ML Products
New York City, New York, United States
$175k-$275k/yr OnsiteFull Time
Mirage
Mirage: AI platform for automated video creation and professional editing.
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
Job PostingView all
1mo
Save
Mark Applied
Hide
Solutions Engineer, AI
New York, New York, United States
HybridFull Time
Valence
Valence: An AI-native building enterprise coaching platforms that transform how organizations learn and develop leaders.
3+ YOE3+ years in solutions/forward-deployed/consulting engineering; LLM/AI prompt design, memory/knowledge retrieval, evaluation and deployment; stakeholder management and product collaboration; strong communication and judgment.
LLM
Job PostingView all
2w
Save
Mark Applied
Hide
Senior AI/ML Engineer
New York City, New York, United States
RemoteFull Time
Pypestream
Pypestream: Enterprise-grade conversational AI agents for customer service automation.
Build inference infrastructure, own model evaluation pipelines, optimize latency, and integrate orchestration engines with frontier large language models.
Job PostingView all
2mo
Save
Mark Applied
Hide
Engineer - Renewable Energy & Energy Storage
Cortland, New York, United States
$70k-$75k/yr OnsiteFull Time
Intertek
IntertekLondon Stock Exchange: ITRK: Provides global testing, inspection, and certification services for products.
0+ YOEBachelor's degree in engineering required; valid driver's license; Microsoft Office expertise; ability to travel up to 50%; perform testing and evaluation of electrical storage and renewable energy products and communicate results.
Microsoft Office
Job PostingView all
2mo
Save
Mark Applied
Hide
Manufacturing Engineer - Coating
Fairport, New York, United States
$68k-$94k/yr OnsiteFull Time
Corning
CorningNYSE: GLW: Develops and manufactures specialty glass, ceramics, and optical fiber.
1+ YOEBachelor's in a technical discipline or equivalent experience, 1-3 years process/manufacturing engineering experience, knowledge of Lean/Six Sigma/DOE/SPC, ability to evaluate run data and update recipes, strong communication skills.
DOE, SPC, DMAIC, Lean, Six Sigma, interferometers, spectrophotometers, ellipsometers, SEM, profilometers, LOTO
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Product Development Engineer
Cortland, New York, United States
$97k-$145k/yr OnsiteFull Time
Enerpac Tool Group
Enerpac Tool GroupNYSE: EPAC: Manufactures high-pressure hydraulic tools and heavy lifting solutions.
5+ YOEBS in Mechanical/Textile/Biomedical Engineering, minimum 5 years engineering experience in manufacturing or regulated industries, ISO 13485 and QMS documentation experience, technical writing, project management, and supplier evaluation skills.
Enterprise Resource Platforms (ERP)
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff AI Research Engineer
New York or Pittsburgh
$221k-$331k/yr OnsiteFull Time
Duolingo
DuolingoNASDAQ: DUOL: Mobile application for language learning and basic education.
Proven AI research engineering experience across LLMs, bandits, and ML stack (feature engineering, training, fine-tuning, RL, evaluation, deployment, monitoring); leadership and mentoring experience; advanced degree or equivalent experience.
LLMs, bandit models, large-scale neural network models
Job PostingView all
1mo
Save
Mark Applied
Hide
Applied AI Engineer
New York, New York, United States
$220k-$300k/yr OnsiteFull Time
Santé
Santé: Provides an operating system and AI tools that run local retail stores.
5+ YOE5+ years building and shipping production AI products; strong software engineering with TypeScript and/or Python; full ML/LLM lifecycle experience; experiment design, evaluation, and monitoring; strong collaboration and communication.
TypeScript, Python, Next.js, tRPC, Prisma, PostgreSQL, pgvector, Vercel, Langfuse, Devin, Claude, Codex
Job PostingView all

Explore Jobs

Expand Your Job Search