236 evaluation jobs at 142 companies in Lockport, NY
2w
Save
Mark Applied
Hide
AI Evaluation Engineer
Toronto, Ontario, Canada
$80k-$180k/yr HybridFull Time
3+ YOE3+ years in software quality/AI evaluation, degree in CS/related or equivalent, expertise in AI/LLM evaluation, regression testing, SDLC/CI-CD, and proficiency with Python and SQL.
Python, SQL, LangSmith, OpenAI Evals
1w
Save
Mark Applied
Hide
Manager, Planning and Evaluation
Toronto, Ontario, Canada
$68k-$72k/yr HybridFull Time
Experience in performance measurement, evaluation, data analysis, organizational planning, stakeholder engagement, and clear written/verbal communication; OKR, nonprofit or research experience and project management training are assets.
3mo
Save
Mark Applied
Hide
DSM Evaluation Manager - EM&V
Toronto, Ontario, Canada
$122k-$192k/yr HybridFull Time
5+ YOEBachelor’s degree; 5+ years in energy efficiency program evaluation; M&V experience; report writing; strong communication and computer skills; MS Office; ability to manage multiple tasks; client relationship building.
Microsoft Office, SharePoint, Excel, Word, Teams
1mo
Save
Mark Applied
Hide
Software Developer (Agentic Evaluation)
Toronto or Vancouver or Montreal
$88k-$129k/yr OnsiteFull Time
BS/MS in CS or related AI field; expertise in Python and ML frameworks (PyTorch, Transformers, scikit-learn); experience with LLMs, AI evaluation, statistical analysis, and developer productivity measurement.
Python, PyTorch, Transformers, scikit-learn, LangGraph, AutoGen, Anthropic Agent SDK (Claude Code), AgentBench, Langfuse, Model Context Protocol (MCP), Playwright, Selenium, Pytest, Appium, CI/CD pipelines, Azure AI Foundry/ML, AWS, VS Code, Cursor
1mo
Save
Mark Applied
Hide
US Tech - AI Engineering Senior Associate
Tampa or Raleigh or Charlotte or Chicago or Cincinnati or Cleveland or Columbia or Columbus or Dallas or Baltimore or Richmond or Rochester or Rosemont or Sacramento or Boston or St. Louis or Salt Lake City or San Antonio or San Diego or San Francisco or San Jose or Seattle or Spartanburg or Albany or Stamford or Atlanta or Toledo or Austin or Tulsa or Washington or Denver or Des Moines or Detroit or Buffalo or Florham Park or Fort Worth or Greensboro or Hartford or Houston or Grand Rapids or Indianapolis or Irvine or Jacksonville or Kansas City or Las Vegas or Little Rock or Los Angeles or Louisville or Birmingham or United States or Fayetteville or Melville or Miami or Milwaukee or Minneapolis or Montpelier or Nashville or New Orleans or United States or New York City or Oklahoma City or Orlando or Philadelphia or Phoenix or Pittsburgh or Portland
$55k-$151k/yr HybridFull Time
2+ YOEBachelor's in CS or related, 2+ years in data/AI/quality engineering, experience with test automation and CI/CD, familiarity with LLMs and prompt engineering, building automated test suites and evaluating AI agents.
CI/CD, LLMs, Microsoft Power Automate
2mo
Save
Mark Applied
Hide
Compliance Officer - Risk Evaluation and Assurance
Brooklyn or Albany or Amherst
$71k-$125k/yr HybridFull Time
5+ YOEBachelor's degree; 5+ years in compliance/risk management/auditing; strong regulatory knowledge; independent and collaborative work style.
3w
Save
Mark Applied
Hide
Per Diem Behavior Technician - Evaluation & Treatment Center
Lackawanna, New York, United States
$16-$27/hr FieldPart Time
High school diploma/GED required. Knowledge of ABA, data collection, session note documentation, RBT certification preferred, 3 years working with children preferred, strong communication and time-management.
Central Reach
1mo
Save
Mark Applied
Hide
Director, Data Science, AI Evaluations Platform
Toronto, Ontario, Canada
OnsiteFull Time
8+ YOE8+ years in data science or applied ML with experience leading technical teams; expertise in ML/LLM evaluation frameworks, LLM-as-judge, deterministic scoring, human evaluation, Python, SQL, statistics, and stakeholder communication.
Python, SQL, MLflow, Langfuse, LangSmith, OpenTelemetry, Grafana, CI/CD pipelines
2mo
Save
Mark Applied
Hide
PROGRAM EVALUATOR
Toronto, Ontario, Canada
$52-$57/hr OnsiteFull Time, Temporary
Master's degree in health sciences, applied social sciences, or health administration, or equivalent education and extensive experience; substantial public health evaluation experience using qualitative and quantitative methods.
microcomputer systems, database management, statistical packages
2mo
Save
Mark Applied
Hide
Driver Examiner 2 - Port Union Part Time - Perm - Non Bilingual
Port Union, Ontario, Canada
OnsitePart Time
2+ YOEEvaluates driving ability of applicants, conducts road tests, and completes evaluations; requires bilingual English/French, valid Ontario licenses, and prior driving experience.
Computer
1d
Save
Mark Applied
Hide
Program Officer, Racial Equity Initiatives
Buffalo or Western New York
$70k-$75k/yr OnsiteFull Time
5+ YOEBachelor's degree required; 5+ years in philanthropy, engagement, education, evaluation, research, or program management; evaluation, analytical, facilitation, communication, and project management skills required.
Microsoft Office Suite, Power BI, Tableau
2mo
Save
Mark Applied
Hide
Bilingual Vocational Specialist
Ottawa or Toronto or Canada
$62k-$91k/yr RemoteFull Time
2+ YOEMinimum 2 years vocational evaluation/rehabilitation experience, bilingual French/English, Bachelor\u0000s degree preferred, eligibility for vocational evaluator credentials, strong MS Office and reporting skills.
Microsoft Office, OaSIS, Career Handbook, NOC
2mo
Save
Mark Applied
Hide
Nurse Practitioner – Veteran Disability Evaluations Buffalo, NY
Buffalo, New York, United States
$135k/yr OnsiteFull Time
Active unrestricted NP license, MSN or higher, strong clinical evaluation and documentation skills; experience in relevant specialties (family, internal, EM, PM&R, orthopedics, occupational medicine) preferred.
2mo
Save
Mark Applied
Hide
Mechanical Integrity Inspector
West Seneca, New York, United States
$25-$30/hr OnsiteFull Time
2+ YOEInspect, test, and evaluate customer equipment; field travel; AutoCAD/Excel; PPE; travel up to 20%.
AutoCAD, MS Word, MS Excel, Ultrasonic testing equipment, Air monitors
1w
Save
Mark Applied
Hide
Academic Assistant - CPS721 - Artificial Intelligence I
Toronto, Ontario, Canada
$50-$55/hr OnsiteTemporary
Must be enrolled in MSc or PhD in Computer Science at TMU, previously taken CPS721 with A/A+, and prior assistant evaluation if applicable.
3w
Save
Mark Applied
Hide
Product Specialist
Toronto, Ontario, Canada
OnsiteFull Time
Serve as technical advisor and workflow expert, deliver demos, configure workflows, conduct training, support evaluations, and translate field feedback.
3w
Save
Mark Applied
Hide
Facultative Underwriter
Cambridge or Toronto
$90k-$120k/yr HybridFull Time
5+ YOEEvaluate and manage property and casualty facultative reinsurance risks; negotiate placements; ensure compliance with guidelines; strong analytical and communication skills.
1w
Save
Mark Applied
Hide
Academic Scholar - Clinical Assistant or Associate Professor, Child Neurology/Epilepsy, Department of Neurology
Buffalo, New York, United States
OnsiteFull Time
M.D. or D.O. (or equivalent), BC/BE in Neurology, fellowship trained in Epilepsy, clinical expertise in epilepsy surgery evaluation and invasive EEG required.
2w
Save
Mark Applied
Hide
Part Time Surgical Technology Clinical Instructor
Sanborn, New York, United States
$903-$1k/hr OnsitePart Time
CST certification and recent surgery experience; ability to teach clinical surgical technology, maintain student records, evaluate competency, and operate computers.
1w
Save
Mark Applied
Hide
Clinical Operations Team Lead
Orchard Park, New York, United States
$24-$44/hr OnsiteFull Time
5+ YOECoordinate and supervise clinical team, ensure quality clinical care, maintain compliance with state and federal regulations, and perform staff evaluations and training.