2w
Save
Mark Applied
Hide
AI Evaluation Scientist
McLean, Virginia, United States
OnsiteFull Time
2+ YOEDesign and run AI evaluation frameworks, build automated evaluation pipelines, create benchmark datasets, perform LLM/RAG error analysis; requires Python and ML library proficiency and 2+ years evaluating ML or NLP models.
Python, PyTorch, Hugging Face, scikit-learn, LangChain, Ragas, OWASP LLM Top 10
1mo
Save
Mark Applied
Hide
Research & Evaluation Lead
Arlington, Virginia, United States
HybridFull Time
5+ YOEMaster's degree and 5+ years designing and implementing program or policy evaluations; mixed-methods analysis, IRB experience, project management, survey design, vendor management, and proficiency with Excel and PowerPoint.
Asana, Qualtrics, SurveyMonkey, Power BI, Tableau, Microsoft Excel, Microsoft PowerPoint, R, SPSS, Stata
2w
Save
Mark Applied
Hide
AI Evaluation Scientist
McLean, Virginia, United States
$105k-$145k/yr OnsiteFull Time
2+ YOEAbility to design and run AI evaluation frameworks, build automated evaluation pipelines, analyze LLM/RAG behavior, and communicate findings. Requires public trust eligibility, 2+ years evaluating ML/NLP/LLM systems, and proficiency in Python and ML libraries.
Python, PyTorch, Hugging Face, scikit-learn, LangChain, Ragas, OWASP LLM Top 10
2w
Save
Mark Applied
Hide
AI Evaluation Scientist
McLean, Virginia, United States
$105k-$145k/yr OnsiteFull Time
2+ YOEDesign and run AI evaluation frameworks, build automated tests and benchmarks, perform LLM/RAG audits, and map findings to responsible AI principles; requires advanced AI evaluation experience and programming proficiency.
Python, PyTorch, Hugging Face, scikit-learn, LangChain, Ragas
1mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
3w
Save
Mark Applied
Hide
Monitoring & Evaluation Analyst
Arlington, Virginia, United States
OnsiteFull Time
5+ YOEActive Secret clearance, Bachelor’s degree, 5 years M&E experience including 3 years with security assistance programs; strong analytical, technical writing, evaluation design, and Excel skills.
Microsoft Excel
10h
Save
Mark Applied
Hide
Research and Evaluation Analyst
Richmond, Virginia, United States
$75k-$80k/yr OnsiteFull Time
Experience transforming complex datasets into insights using statistical modeling, machine learning, data governance, evaluation, reporting, and interagency coordination to support veteran services and policy.
1mo
Save
Mark Applied
Hide
Assessment and Evaluation Analyst
Alexandria, Virginia, United States
$99k-$131k/yr OnsiteFull Time
5+ YOEMaster's in Education/Research required (Doctorate preferred); 5+ years related experience preferred; expertise in program evaluation, measurement, data analysis, survey design, and professional learning delivery.
SPSS, NVivo, Microsoft Excel
1w
Save
Mark Applied
Hide
Evaluation & Assessment Analyst- Federal Health
Arlington, Virginia, United States
RemoteFull Time
5+ YOEBachelor's degree and 5 years experience in program evaluation, business analysis, or performance measurement; experience with executive dashboards, readiness assessments, and reporting; proficiency with Microsoft Excel, Power BI, SQL, and Tableau; ability to obtain Level 3 Public Trust.
Microsoft Excel, Power BI, SQL, Tableau
4w
Save
Mark Applied
Hide
Test & Evaluation Analyst
Chesapeake, Virginia, United States
OnsiteFull Time
6+ YOEBachelor's degree required, minimum 6 years testing experience, developing/executing test plans for enterprise applications, documenting defects, ability to pass federal background investigation and obtain Public Trust clearance; U.S. citizenship or permanent residency required.
Oracle Federal Financials, ServiceNow
1d
Save
Mark Applied
Hide
AEGIS Test & Evaluation Engineer - Washington, D.C.
Washington or Washington Navy Yard or Virginia or Maryland or Anacostia Annex
$120k-$199k/yr HybridFull Time
8+ YOEAbility to obtain/maintain Secret clearance, US citizenship, 8+ years AEGIS experience, test & evaluation planning, cross-organization coordination, technical writing, and MS Office skills.
Microsoft Office
1w
Save
Mark Applied
Hide
Monitoring (Measurement) & Evaluation Specialist
Vienna or Washington
$100k-$120k/yr OnsiteFull Time
Federal Resources Corporation: Provides cybersecurity and IT modernization solutions for federal agencies.
3+ YOEBachelor's degree and 3+ years M&E experience; develop logic models, indicators, data collection, analysis, reporting, and capacity building; SECRET clearance required or ability to obtain.
Microsoft Office, Microsoft Excel
3mo
Save
Mark Applied
Hide
Senior Test and Evaluation (T&E) Engineer
Norfolk, Virginia, United States
OnsiteFull Time
4+ YOE4+ years of Test & Evaluation experience; DoD/ Navy testing policies knowledge; DAWIA T&E Level II/ Practitioner; M&S/VV&A experience; strong writing and leadership.
1w
Save
Mark Applied
Hide
Manager, Test and Evaluation
Reston or Costa Mesa
$146k-$194k/yr OnsiteFull Time
8+ YOE2+ MgmtBachelor's in engineering,8+ years test engineering experience,2+ years leadership,Top Secret clearance with SCI eligibility,ability to travel ~25%,experience with DoD/IC,test planning,safety and risk management.
Lattice OS, Linux, Ubuntu, Debian, C++, Python, MATLAB
3mo
Save
Mark Applied
Hide
Test and Evaluation Engineer
Newport News, Virginia, United States
OnsiteFull Time
15+ YOERequires 15+ years military aviation experience, 10+ years flight test planning/conducting, bachelor\u0002s in a technical field, test pilot training or equivalent, Secret security clearance, MATLAB familiarity desired.
MATLAB
2mo
Save
Mark Applied
Hide
Test and Evaluation Manager
Norfolk, Virginia, United States
OnsiteFull Time
5+ YOE5+ MgmtLead testing, verification, and validation for naval navigation equipment; manage EQT; oversee test plans and schedules.
MIL-STD, U.S. Navy procedures
2mo
Save
Mark Applied
Hide
Test and Evaluation Technician
Arlington, Virginia, United States
$62k-$65k/yr OnsiteFull Time
6+ YOEAA/AS degree with 2 years’ experience; 6 years as Technician or TSO; Secret clearance; TSA suitability.
Check Point, TSA Tools
2mo
Save
Mark Applied
Hide
Senior Manager, Economic Services - Program Evaluation
McLean, Virginia, United States
OnsiteFull Time
8+ YOEPhD in Economics/Public Policy, minimum 8 years in professional services with program evaluation experience, business development skills, quantitative/qualitative research, data science/ML/LLM familiarity, excellent communication, and US work authorization.
LLM
1mo
Save
Mark Applied
Hide
Assistant Test & Evaluation (T&E) Specialist
Norfolk, Virginia, United States
$75k-$90k/yr OnsiteFull Time
Dynamo Technologies: Delivers IT and digital transformation services to federal agencies.
5+ YOEBachelor's in STEM with 5+ years USCG/DHS/DoD operational experience or 10+ years USCG operational experience; 3+ years developing test plans/reports; ability to obtain DoD Secret clearance; T&E Manager Level I certification; strong communication and project skills.
1w
Save
Mark Applied
Hide
Monitoring and Evaluation Analyst - Internal
Washington or Bonn or Maryland or Virginia
$70k-$82k/yr HybridFull Time
3+ YOEAdvanced degree required; minimum 3 years M&E/data collection and reporting experience; experience with development partners, data visualization and databases; strong writing and communication; fluency in English; existing work authorization required.
Power BI, Microsoft Excel, Microsoft Access, Alchemer
Explore Jobs
Expand Your Job Search
Top Cities in Virginia for Evaluation
- Evaluation jobs in Virginia Beach, VA
- Evaluation jobs in Norfolk, VA
- Evaluation jobs in Chesapeake, VA
- Evaluation jobs in Richmond, VA
- Evaluation jobs in Arlington, VA
- Evaluation jobs in Newport News, VA
- Evaluation jobs in Alexandria, VA
- Evaluation jobs in Hampton, VA
- Evaluation jobs in Roanoke, VA
- Evaluation jobs in Portsmouth, VA
- Evaluation jobs in Suffolk, VA
- Evaluation jobs in Lynchburg, VA
- Evaluation jobs in Harrisonburg, VA
- Evaluation jobs in Leesburg, VA
- Evaluation jobs in Charlottesville, VA
- Evaluation jobs in Blacksburg, VA
- Evaluation jobs in Danville, VA
- Evaluation jobs in Manassas, VA
- Evaluation jobs in Petersburg, VA
- Evaluation jobs in Fredericksburg, VA