72 evaluations engineer jobs at 52 companies in Warwick, RI
2mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
1mo
Save
Mark Applied
Hide
Senior Systems Engineer
Newport, Rhode Island, United States
OnsiteFull Time
5+ YOEBachelor's in engineering, 5+ years engineering experience, mechanical and model-based systems engineering, test & evaluation, ability to obtain US Secret security clearance, strong communication skills.
2mo
Save
Mark Applied
Hide
Senior Engineer - Waterfront/Structural (50635)
East Greenwich or Portsmouth
$135k-$175k/yr OnsiteFull Time
12+ YOEPE required, 12+ years project engineering experience, Bachelor's (or Master's) in civil engineering, experience with evaluation and structural design of waterfront infrastructure, supervisory and technical leadership skills.
5d
Save
Mark Applied
Hide
Applied AI Engineer
Canada or San Francisco or Raleigh or Boston
HybridFull Time
Applied GenAI experience with prompt engineering, structured outputs, RAG, evaluation datasets, production LLM features, multimodal inputs, and model quality, cost, and latency optimization.
LLMX, Attachments, OCR, RAG
1mo
Save
Mark Applied
Hide
SYSTEMS ENGINEER III
Middletown, Rhode Island, United States
OnsiteFull Time
8+ YOEBachelor's in a technical field, U.S. citizenship, DoD Secret clearance at hire, ~8+ years systems engineering or cyber experience, familiarity with RMF/NIST/STIGs, configuration management, test & evaluation, and strong communication skills.
RMF, NIST SP 800-53, STIGs, DevSecOps, Agile, Kubernetes, AWS
1mo
Save
Mark Applied
Hide
Wastewater Infrastructure Assessment Project Engineer
Burlington or Bedford or Portsmouth or Providence or Portland or Middletown
$78k-$125k/yr HybridFull Time
3+ YOEEIT required, B.S. in civil or environmental engineering, 3+ years sewer/system assessment and design experience, PACP preferred, experience with sewer evaluations, flow monitoring, and data/asset management.
1w
Save
Mark Applied
Hide
Oliver Wyman - Senior Lead AI Engineer
New York City or Boston or Toronto or Montreal
$195k-$250k/yr HybridFull Time
Expertise designing and deploying large-scale AI systems, agent platforms, LLMs, data engineering, evaluation, observability, mathematical modeling, and modern AI programming languages.
Azure Foundry, AWS Bedrock, Gemini Enterprise Agent Platform, LLM, Open-Source
2mo
Save
Mark Applied
Hide
Innovation Senior AI Engineer
Boston or Jersey City or New York City or Massachusetts or New York or New Jersey or United States or Poland
$210k-$260k/yr OnsiteFull Time
3+ YOE3+ years AI/ML engineering (5+ years product development), hands-on leader, expert Python, production LLM/RAG/agent experience, workflow orchestration, Azure/AWS, vector DBs, evaluation and responsible-AI practices.
Python, Agno, LangChain, LlamaIndex, Temporal, Prefect, Airflow, Azure, AWS, Pinecone, Weaviate, pgvector, LLM, RAG
3mo
Save
Mark Applied
Hide
Power Module Component Engineer
Andover or Warwick
$125k-$172k/yr HybridFull Time
5+ YOEBSEE or MSEE in electrical engineering, 5+ years component engineering experience in power module development, expertise specifying/evaluating inductors, capacitors and semiconductors, simulation tools (SPICE/COMSOL/ANSYS) and Python/MATLAB/C++.
SPICE, COMSOL, ANSYS, Python, MATLAB, C++
2mo
Save
Mark Applied
Hide
Senior Project Mechanical Engineer
Nashua or Foxborough or Cranston or Glastonbury or Boston or Maine
FieldFull Time
5+ YOEB.S. in Mechanical Engineering and active PE required; 5+ years evaluating mechanical failures; experience with field investigations, catastrophe response, report writing, travel (25–30%), and Microsoft Office/CRM.
Microsoft Word, Microsoft Excel, Microsoft Outlook, CRM software
1mo
Save
Mark Applied
Hide
Senior AI Security Automation Engineer
Quincy or Toronto or Princeton or Boston or Clifton or Austin
$120k-$203k/yr HybridFull Time
7+ YOE7+ years software engineering, 3+ years building AI/ML/LLM solutions; expertise in cloud-native architectures, RAG, AI evaluation/observability, CI/CD, security, and mentoring engineers.
AWS, Azure, GCP, Jenkins, Harness, Spinnaker, Argo CD, Python, JavaScript/TypeScript, Rust, Go (Golang), Bash, PowerShell, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, vector databases
1mo
Save
Mark Applied
Hide
Principal Engineer Team Lead, AV Behavior
Boston or Pittsburgh or Las Vegas or United States
$200k-$275k/yr HybridFull Time
5+ YOE3+ MgmtBachelor's in Systems Engineering/Autonomy/Robotics with 7+ yrs (or Master’s/PhD with 5+ yrs); 3+ yrs leading evaluation programs; proficiency in Python and SQL; strong statistics and data science skills.
Python, SQL, SOTIF, ISO 26262, UL4600
2mo
Save
Mark Applied
Hide
Lead Energy Storage Engineer
Boston or Chicago
$150k-$170k/yr HybridFull Time
7+ YOE7+ years related experience (5+ years in battery energy storage), bachelor’s in engineering required, EIT/PE preferred, deep knowledge of battery technologies, NFPA 855/NEC/UL standards, vendor evaluation, safety and code compliance.
NFPA 855, NEC, UL 9540, UL 9540A, UL 1973, UL 1741, UL 1642
1mo
Save
Mark Applied
Hide
Member of Technical Staff – Engineer, Policy Evaluation & Experiment Infrastructure
Cambridge or San Francisco
$152k-$203k/yr OnsiteFull Time
Experience building reliable evaluation tooling for robot policies, strong software fundamentals, hands-on robot or policy experience, interest in ML systems, and ability to deliver end-to-end.
Python
2mo
Save
Mark Applied
Hide
Test & Evaluation Engineer
Quincy, Massachusetts, United States
$146k-$194k/yr OnsiteFull Time
10+ YOE7+ MgmtBachelor's in engineering (or equivalent experience), 10+ years systems engineering/integration and testing, 7+ years lead test conductor experience, Top Secret clearance eligibility, maritime rules knowledge, Linux and software debugging experience, travel and extended hours ability.
Lattice OS, Linux, Go, Java, C++, Python, JavaScript, MIL-STD-1553, MIL-STD-1760, AS8775, AS5653
2mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
1w
Save
Mark Applied
Hide
Risk Management Framework (RMF) Test Engineer
Groton, Connecticut, United States
OnsiteFull Time
2+ YOEHigh school diploma, 2+ years evaluating system compliance against RMF, 2+ years IT systems exposure, active Secret clearance, and ability to obtain DoD Top Secret clearance. Security+ and cybersecurity tools preferred.
Active Directory, Exchange, Tanium, Trellix, ACAS, Nessus, Evaluate STIG, STIG Manager, VRAM, CMRS, Enterprise Mission Assurance Support Service (eMASS), Plan of Action & Milestones
1mo
Save
Mark Applied
Hide
AI Engineer
Springfield or New York City or Boston
$141k-$185k/yr HybridFull Time
4+ YOE4+ years in data science/AI engineering with production ML/LLM experience, Python and SQL proficiency, ability to build and evaluate AI solutions, and a Bachelor’s in a quantitative field (Master’s preferred).
LLMs, Bedrock AgentCore, AWS Strands, Azure, MCP/A2A protocols, Python, SQL, vector databases, Degreed
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
McLean or San Francisco or New York City or San Jose or Cambridge
$230k-$286k/yr OnsiteFull Time
4+ YOEBachelor's plus 6 years or master's plus 4 years in AI/ML development; 6 years programming in Python, Go, Scala, or Java; experience building scalable AI systems and leading engineering teams.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
3mo
Save
Mark Applied
Hide
Machine Learning Engineer
Boston, Massachusetts, United States
HybridFull Time
5+ YOEML/AI engineering with NLP focus; Python proficiency; data processing, model evaluation, and LLM experience; cloud; strong communication; security clearance a plus.
Python, NumPy, Pandas, Scikit-Learn, Transformers, Langraph, LlamaIndex, Ollama, Docker, Kubernetes
Explore Jobs
Expand Your Job Search
Top Cities Near Warwick for Evaluations Engineer
- Evaluations Engineer jobs in Boston, MA
- Evaluations Engineer jobs in Worcester, MA
- Evaluations Engineer jobs in Providence, RI
- Evaluations Engineer jobs in Cambridge, MA
- Evaluations Engineer jobs in New Bedford, MA
- Evaluations Engineer jobs in Brockton, MA
- Evaluations Engineer jobs in Fall River, MA
- Evaluations Engineer jobs in Quincy, MA
- Evaluations Engineer jobs in Newton, MA
- Evaluations Engineer jobs in Cranston, RI
- Evaluations Engineer jobs in Pawtucket, RI
- Evaluations Engineer jobs in Framingham, MA
- Evaluations Engineer jobs in Waltham, MA
- Evaluations Engineer jobs in Brookline, MA
- Evaluations Engineer jobs in Taunton, MA
- Evaluations Engineer jobs in East Providence, RI
- Evaluations Engineer jobs in Attleboro, MA
- Evaluations Engineer jobs in Woonsocket, RI
- Evaluations Engineer jobs in Norwich, CT
- Evaluations Engineer jobs in Marlborough, MA