HiringCafe
Join our community

273 evaluations engineer jobs at 175 companies in East Orange, NJ

1mo
Save
Mark Applied
Hide
Member of Technical Staff - Research Software Engineer - Safety Evaluations Infrastructure
New York City or San Francisco or London
OnsiteFull Time
Reflection AI
Reflection AI: Private AI research lab building open foundation models and agentic software for enterprise, government, and regulated-industry users.
Experience building secure, isolated infrastructure for sensitive model evaluations; strong Python skills; security engineering fundamentals; data pipeline and sandboxing experience.
Python
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Engineer, Evaluation
San Francisco or New York City
$150k-$250k/yr HybridFull Time
Distyl AI
Distyl AI: Architecting the AI-Native Enterprise
2+ YOE2+ years software engineering, strong Python, experience with evaluation- or experiment-driven development, ability to encode human judgment into tests/graders, systems-oriented mindset, and willingness to travel 10–50%.
Python, LLM
Job PostingView all
3w
Save
Mark Applied
Hide
Founding Research Engineer
New York City or San Francisco
$215k-$330k/yr OnsiteFull Time
Ambral
Ambral: AI customer-success platform for businesses that monitors accounts, identifies churn and expansion opportunities, and automates follow-up actions.
4+ YOE4+ years building production software or ML systems, including 2+ years with RL environments or evaluation/agent infrastructure; strong software engineering, data processing, reproducibility, and evaluation skills.
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Engineer
New York City, New York, United States
$207k-$250k/yr OnsiteFull Time
The Farmer's Dog
The Farmer's Dog: Direct-to-consumer fresh dog food delivering personalized, human-grade meal plans to dog owners nationwide.
10+ YOE10+ years software engineering experience, architecture and systems leadership, cross-functional partnership, AI/automation evaluation, mentoring experience, strong communication and problem-solving skills.
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Developer Experience Engineer
New York City, New York, United States
$180k-$250k/yr OnsiteFull Time
Crosby
Crosby: AI-native law firm helping fast-growing companies review, redline, and negotiate commercial contracts with lawyers and AI.
3+ YOE3+ years software engineering experience; strong Python; hands-on experience with LLMs and OpenAI/Anthropic APIs; experience building backend systems, experimentation, evaluation, and data pipelines; strong systems thinking and communication.
Python, LLMs, OpenAI, Anthropic
Job PostingView all
1mo
Save
Mark Applied
Hide
Design Specialist, Mechanical Engineer
New York or Nashville
$125k-$158k/yr OnsiteFull Time
Turner Construction
Turner Construction: International construction services and general builder.
4+ YOEB.S. in Engineering and 4+ years mechanical engineering experience; Professional Engineer (PE) required; design and construction experience with mechanical systems, codes, life-cycle cost and LEED evaluation.
Bluebeam Studio, Navisworks, AutoCAD, Revit, Rhino, SketchUp
Job PostingView all
1mo
Save
Mark Applied
Hide
Reviewer - Assistant Civil Engineer
Queens, New York, United States
$66k-$76k/yr OnsiteFull Time
City of New York
City of New York: Official government portal for the City of New York.
1+ YOEBaccalaureate degree in civil engineering and 1 year civil engineering experience (or bachelor\u0002s plus master's). Ability to review engineering plans, evaluate backflow prevention applications, and prepare technical reports.
Microsoft Office, GIS, Adobe Acrobat
Job PostingView all
1mo
Save
Mark Applied
Hide
Research Engineer
New York, New York, United States
$200k-$400k/yr OnsiteFull Time
Antimetal
Antimetal: Private AI-powered infrastructure-management platform that helps engineering teams diagnose, fix, and prevent production issues.
4+ YOE4+ years applied ML/research engineering experience, production ML and agent/LLM work, proficiency in Python and Typescript, evaluation pipeline experience, strong statistical and problem-solving skills.
Python, Typescript, LLM
Job PostingView all
2w
Save
Mark Applied
Hide
Forward Deployed Engineer
London or New York City
OnsiteFull Time
Pace
Pace: Private AI insurance operations automating workflows for carriers, brokers, and managing general agents.
Partners with enterprise customers to expand use cases, build product solutions, ship codebase features, integrations, and evaluations, and collaborate with engineering on larger products.
Job PostingView all
1mo
Save
Mark Applied
Hide
Solutions Engineer, AI
New York, New York, United States
HybridFull Time
Valence
Valence: Enterprise AI coaching platform helping companies provide personalized guidance to managers and employees.
3+ YOE3+ years in solutions/forward-deployed/consulting engineering; LLM/AI prompt design, memory/knowledge retrieval, evaluation and deployment; stakeholder management and product collaboration; strong communication and judgment.
LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, ML Products
New York City, New York, United States
$175k-$275k/yr OnsiteFull Time
Mirage
Mirage: Private AI video building editable video tools for creators and businesses through Captions, foundation models, and an API.
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
Job PostingView all
4w
Save
Mark Applied
Hide
AI Solutions Engineer
Parsippany or Nashville
$140k-$170k/yr HybridFull Time
Managed Health Care Associates
Managed Health Care Associates: Provides group purchasing and software for post-acute care providers.
5+ YOE5+ years software engineering experience; deep experience with agentic AI, prompt engineering, agent orchestration, CI/CD, Azure/M365, AI security, and evaluation frameworks; strong communication and cloud-native skills.
GitHub, Visual Studio Code, GitHub Copilot, Claude, Azure, M365, Azure DevOps, GitHub Actions, SonarQube, Playwright, Jira, Azure Monitor, Application Insights, Model Context Protocol (MCP)
Job PostingView all
2w
Save
Mark Applied
Hide
Senior AI/ML Engineer
New York City, New York, United States
RemoteFull Time
Pypestream
Pypestream: Enterprise AI software serving large businesses with chat and voice agents that automate customer service end-to-end.
Build inference infrastructure, own model evaluation pipelines, optimize latency, and integrate orchestration engines with frontier large language models.
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff AI Research Engineer
New York or Pittsburgh
$221k-$331k/yr OnsiteFull Time
Duolingo
DuolingoNasdaq: DUOL: Public U.S. education technology providing free and subscription-based language learning and English proficiency testing.
Proven AI research engineering experience across LLMs, bandits, and ML stack (feature engineering, training, fine-tuning, RL, evaluation, deployment, monitoring); leadership and mentoring experience; advanced degree or equivalent experience.
LLMs, bandit models, large-scale neural network models
Job PostingView all
1mo
Save
Mark Applied
Hide
Applied AI Engineer
New York, New York, United States
$220k-$300k/yr OnsiteFull Time
Santé
Santé: AI-powered operating-system serving liquor stores and wine shops with point-of-sale software.
5+ YOE5+ years building and shipping production AI products; strong software engineering with TypeScript and/or Python; full ML/LLM lifecycle experience; experiment design, evaluation, and monitoring; strong collaboration and communication.
TypeScript, Python, Next.js, tRPC, Prisma, PostgreSQL, pgvector, Vercel, Langfuse, Devin, Claude, Codex
Job PostingView all
2mo
Save
Mark Applied
Hide
Innovation Senior AI Engineer
Boston or Jersey City or New York City or Massachusetts or New York or New Jersey or United States or Poland
$210k-$260k/yr OnsiteFull Time
Brown Brothers Harriman
Brown Brothers Harriman: Providing global investment management, custody, and private banking services.
3+ YOE3+ years AI/ML engineering (5+ years product development), hands-on leader, expert Python, production LLM/RAG/agent experience, workflow orchestration, Azure/AWS, vector DBs, evaluation and responsible-AI practices.
Python, Agno, LangChain, LlamaIndex, Temporal, Prefect, Airflow, Azure, AWS, Pinecone, Weaviate, pgvector, LLM, RAG
Job PostingView all
19h
Save
Mark Applied
Hide
Deployed Engineer, Professional Services (NYC)
New York City, New York, United States
$150k-$215k/yr HybridFull Time
LangChain
LangChain: Private AI software providing agent-engineering platforms and open-source frameworks for developers and enterprises.
4+ YOERequires 4+ years of software engineering experience, deep Python expertise, 2+ years building production agent systems, client-facing communication skills, and experience with agent frameworks and AI evaluation.
Python, TypeScript, JavaScript, LangChain, LangGraph, Deep Agents, Axolotl, Unsloth, Hugging Face transformers, TRL
Job PostingView all
3d
Save
Mark Applied
Hide
Staff AI/ML Engineer
New York City or Montreal
$230k-$280k/yr HybridFull Time
Tetrix
Tetrix: AI investment intelligence platform for institutional investors in private markets.
10+ YOE10+ years of engineering experience with recent production AI/ML focus, especially LLMs, agents, evaluations, or data extraction pipelines. Strong Python skills required; fintech experience valued.
Python, LLMs, PDFs, Excel
Job PostingView all
2w
Save
Mark Applied
Hide
Forward Deployed Engineer
New York City, New York, United States
$150k-$200k/yr HybridFull Time
Take2 AI
Take2 AI: AI recruiting platform for healthcare employers that automates sourcing, screening, credential verification, scheduling, and onboarding.
2+ YOERequires 2+ years of engineering experience, 1+ year with production LLM, NLP, or AI agent systems, strong full-stack skills, agent workflow deployment, evaluation frameworks, customer-facing delivery, and analytical problem-solving.
Python, GPT, Claude, Gemini, LLaMA, Mistral
Job PostingView all
2mo
Save
Mark Applied
Hide
Bridge Load Ratings - Project Engineer
New York, New York, United States
$96k-$188k/yr OnsiteFull Time
HNTB
HNTB: Infrastructure design and engineering for transportation and public works
4+ YOEBachelor’s (6 yrs), Master’s (5 yrs) or PhD (4 yrs) in Engineering; experience with bridge evaluation, load ratings, structural analysis tools; PE preferred; strong technical writing and client communication.
AASHTOWare Bridge Rating (BrR), CSiBridge, MIDAS, LARSA 4D
Job PostingView all

Explore Jobs

Expand Your Job Search