2,243 evaluations engineer jobs at 1,107 companies in United States
1mo
Save
Mark Applied
Hide
Evaluations Engineer
San Francisco, California, United States
$130k-$165k/yr OnsiteFull Time
Strong engineering fundamentals, professional Python expertise, familiarity with LLMs, Git workflow experience, ability to analyze model error modes and work with cross-functional teams. In-person in San Francisco; relocation/transportation support provided.
Docent, Python, Django, React, AWS, CDK, Git
2mo
Save
Mark Applied
Hide
Field Evaluations Engineer - West US Region
California or San Diego or Brea or Vancouver or Seattle
$97k-$120k/yr FieldFull Time
8+ YOEABET-accredited bachelor's in engineering or related field, 8+ years related experience, expert knowledge of NEC/building codes and field evaluations, experience with electrical test equipment, frequent travel and airport proximity required.
Electrical Test Equipment, NEC
3mo
Save
Mark Applied
Hide
AI Evaluations Engineer
San Francisco, California, United States
$160k-$210k/yr RemoteFull Time
5+ YOE5+ years software engineering; backend systems; production infrastructure; CI/CD; observability; debugging; collaboration across teams.
Python, TypeScript, Java, CI/CD, APIs, Data Pipelines, Observability Tools
1mo
Save
Mark Applied
Hide
Evaluations Engineering - Member of Technical Staff
San Francisco, California, United States
$200k-$400k/yr OnsiteFull Time
Several years building production backend and data systems, experience with evaluation pipelines, ML/LLM fluency, strong system design and communication skills.
1mo
Save
Mark Applied
Hide
Research Engineer - Evaluations
Redwood City, California, United States
HybridFull Time
5+ YOE5+ years building ML evaluation systems or large-scale model pipelines; master's/PhD or equivalent; experience with visual data; proficiency in Python and PyTorch/JAX/TensorFlow; strong software engineering and distributed systems skills.
Python, PyTorch, JAX, TensorFlow, CI/CD
3w
Save
Mark Applied
Hide
Member of Technical Staff - Research Software Engineer - Safety Evaluations Infrastructure
New York City or San Francisco or London
OnsiteFull Time
Experience building secure, isolated infrastructure for sensitive model evaluations; strong Python skills; security engineering fundamentals; data pipeline and sandboxing experience.
Python
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Model Evaluations (Speech LLM) - San Francisco
San Francisco, California, United States
$180k-$270k/yr HybridFull Time
Python software engineering; building distributed systems, data pipelines, and evaluation harnesses at scale; partner with ML researchers to define benchmarks; build dashboards and monitor model health; debug mid-training anomalies; communicate results clearly.
Python, Distributed systems, Data pipelines, Evaluation harnesses, Dashboards, Weighs & Biases, MLflow
2mo
Save
Mark Applied
Hide
Staff Software Engineer, Quantitative Evaluations
Mountain View or San Francisco
$251k-$310k/yr HybridFull Time
4+ YOEBS in a quantitative field; 4-7 years experience; strong C++, Python, SQL skills; data analysis; building data pipelines; ML familiarity; strong coding standards.
C++, Python, SQL, Machine Learning, Data Processing, Statistics
2w
Save
Mark Applied
Hide
Evaluation Engineer
Bridgeton, Missouri, United States
OnsiteFull Time
0+ YOEBS in Mechanical Engineering,0-2 years product design/evaluation experience,excellent communication and analytical skills; Six Sigma Black Belt a plus.
3mo
Save
Mark Applied
Hide
Sr. Condition Evaluation Engineer
Long Beach, California, United States
OnsiteFull Time
Senior engineer with a degree in civil/structural engineering and experience in condition surveys, nondestructive evaluation, and as-built documentation.
1mo
Save
Mark Applied
Hide
Senior Engineering Manager, Agentic & Generative AI Benchmarking and Evaluations
Santa Clara, California, United States
$201k-$352k/yr OnsiteFull Time
8+ YOE3+ Mgmt8+ years software/ML engineering experience with 3+ years managing AI/ML teams; expertise in LLM evaluation, benchmarking, Python, SQL, Pandas, NumPy, and ML evaluation metrics.
Python, SQL, Pandas, NumPy, ROUGE, BLEU, G-Eval, OpenAI, Anthropic, Google
2mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
1mo
Save
Mark Applied
Hide
Engineer-Midland ClayDesta
Midland, Texas, United States
OnsiteFull Time
5+ YOEBachelor's degree in engineering (or equivalent experience), 5+ years engineering experience with emphasis on reservoir engineering, decline curve analysis, and economic evaluation; on-the-job experience may substitute for degree.
2mo
Save
Mark Applied
Hide
AI Engineer, Evaluation
San Francisco or New York City
$150k-$250k/yr HybridFull Time
2+ YOE2+ years software engineering, strong Python, experience with evaluation- or experiment-driven development, ability to encode human judgment into tests/graders, systems-oriented mindset, and willingness to travel 10–50%.
Python, LLM
3mo
Save
Mark Applied
Hide
Plant Engineer
Fort Worth, Texas, United States
OnsiteFull Time
5+ YOEAnalyzes, plans, installs, evaluates, certifies, and corrects mechanical systems; oversees major repairs and guides engineers.
HVAC, Chiller, Boiler, Pumps, Heat Exchangers, VFDs, AHU, Fan Coil Units, DX Units, Liebert Units, Controls
1mo
Save
Mark Applied
Hide
Senior Systems Engineer
Hanscom AFB, Massachusetts, United States
$150k-$170k/yr OnsiteFull Time
US citizen with active Secret clearance, extensive DoD systems engineering experience, expertise in requirements, test & evaluation, system architecture, and contractor evaluation; travel ~20%.
Modular Open Systems Architecture (MOSA), Systems Modeling (SysML), Cameo, Rhapsody, Microsoft Office 365, Microsoft SharePoint, SolidWorks
2w
Save
Mark Applied
Hide
General Engineer
Fort Huachuca, Arizona, United States
$108k-$148k/yr OnsiteFull Time
1+ YOEBachelor's in engineering or equivalent experience; 1 year specialized engineering experience developing facility construction programs, evaluating facilities, and performing systems analyses; must obtain and maintain Top Secret/SCI clearance.
5d
Save
Mark Applied
Hide
General Engineer
Alexandria, Virginia, United States
$122k-$158k/yr OnsiteFull Time
Engineering degree or qualifying engineering education/experience, current engineering registration or FE exam evidence, and 52 weeks of specialized GS-12-equivalent STEM engineering experience in technical reviews, assessments, or evaluations.
2mo
Save
Mark Applied
Hide
Electrical Engineer
Buford, Georgia, United States
OnsiteFull Time
Electrical engineering role requiring engineering project execution, electrical systems evaluation, manufacturing support, troubleshooting, quality assurance, and technical knowledge of electronics production.
ERP, PCBA, BOM, LEAN, Kaizen
6d
Save
Mark Applied
Hide
Chief Engineer
Washington, District of Columbia, United States
$116k-$195k/yr HybridFull Time
12+ YOEBachelor’s degree in engineering or science, 12+ years in test and evaluation, 3+ years in prototype development, DHS acquisition and systems engineering experience, and technical reporting expertise.
Explore Jobs