HiringCafe
Join our community

10 ai evaluation engineer jobs at 10 companies in Maryland

2mo
Save
Mark Applied
Hide
AI Engineer - SME
Annapolis Junction, Maryland, United States
$206k-$221k/yr OnsiteFull Time
Gormat
Gormat: Provides cybersecurity and systems engineering services to government defense agencies
Design, build, integrate, or evaluate AI/ML-enabled applications; experience with LLMs, agentic systems, and AI frameworks; strong communication.
LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, Haystack, LlamaIndex, Python, JavaScript, TypeScript
Job PostingView all
1w
Save
Mark Applied
Hide
Applied AI Lead - Evaluation & Measurement
Frederick or Beavercreek or Fort Walton Beach or Washington
OnsiteFull Time
Leonardo DRS
Leonardo DRSNASDAQ: DRS: Manufactures advanced electronic systems for defense and military applications.
5+ YOERequires 5+ years in data, ML, or test engineering, including 3+ years in evaluation or model validation and recent hands-on LLM evaluation. Requires a bachelor's degree or equivalent, U.S. citizenship, and active or obtainable DOD clearance.
pipelines, dashboards, large-language-model, telemetry
Job PostingView all
2mo
Save
Mark Applied
Hide
SME AI Engineer
Columbia, Maryland, United States
$225k-$247k/yr OnsiteFull Time
Assured Information Security
Assured Information Security: Provides cybersecurity research and products for national defense missions.
15+ YOEMaster's (15+ yrs) or Bachelor's (18+ yrs) and extensive experience designing, building, integrating, or evaluating AI/ML applications; familiarity with LLMs, RAG, prompt engineering, agentic frameworks (e.g., LangChain); TS/SCI w/CI Poly required.
LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, Haystack, Llamalndex, Python, JavaScript, TypeScript
Job PostingView all
3mo
Save
Mark Applied
Hide
AI Engineer
Columbia, Maryland, United States
$158k-$284k/yr OnsiteFull Time
Parsons
ParsonsNYSE: PSN: Provides engineering and technology services for infrastructure and defense.
18+ YOEExperience designing or evaluating AI/ML applications; strong communication; TS SCI w/Polygraph; 18+ years with BS or 15+ years with MS; familiarity with LLMs, agentic workflows, orchestration frameworks.
LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, Haystack, LlamaIndex, Python, JavaScript
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Engineer – SME
Columbia, Maryland, United States
OnsiteFull Time
ARSIEM
ARSIEM: Provides cybersecurity and software engineering to government agencies.
15+ YOERequires active TS/SCI with polygraph and U.S. citizenship; 15+ years experience (with a relevant advanced degree option); experience building/evaluating LLM/RAG/agentic systems and familiarity with modern AI frameworks.
LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, Haystack, LlamaIndex, Python, JavaScript/TypeScript
Job PostingView all
3w
Save
Mark Applied
Hide
AI Assurance Engineer
Laurel, Maryland, United States
$100k-$245k/yr OnsiteFull Time
Johns Hopkins University Applied Physics Laboratory
Johns Hopkins University Applied Physics Laboratory: Conducts research and engineering for national security and space.
Bachelor's in relevant technical field, Python and AI software development experience, familiarity with generative AI and test & evaluation, strong communication, and ability to obtain Interim Secret and Top Secret clearances (US citizenship).
Python
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior AI/ML Security Engineer (Maryland, Fort Meade)
Fort Meade, Maryland, United States
OnsiteFull Time
Markesman Group
Markesman Group: Provides cybersecurity and intelligence services to the U.S. government.
3+ YOETS/SCI with CI-Poly required. Python, Linux, Docker experience; security assessment and red-team experience; ability to evaluate ML/LLM behavior and communicate findings. Bachelor's + 3+ years AI/ML experience (or 6+ years related).
Python, Linux, Docker, Large language models (LLMs)
Job PostingView all
1mo
Save
Mark Applied
Hide
Strategic Artificial Intelligence (AI) Engineer
Fort Meade, Maryland, United States
$130k-$150k/yr HybridFull Time
Computer World Services
Computer World Services: Provides IT modernization and cybersecurity solutions for federal government agencies.
Design, develop, and evaluate AI/ML, NLP, and computer vision models; support DISA program activities; generate reports and briefings. Bachelor's in CS/Engineering desired; DoD certifications and clearance may be required.
Job PostingView all
3w
Save
Mark Applied
Hide
Artificial Intelligence/Machine Learning (AI/ML) Engineer 2 TS/SCI w Poly
Laurel, Maryland, United States
$135k-$216k/yr OnsiteFull Time
Peraton
Peraton: National security and mission-critical government technology services provider.
5+ YOEActive TS/SCI with poly required, 5+ years applied ML experience, Master’s or PhD in AI/ML/CS/math/data fields (or Bachelor’s+5), proficiency with PyTorch or TensorFlow, experience training/deploying models and evaluating performance.
PyTorch, TensorFlow, Python, Java, C, R
Job PostingView all
2w
Save
Mark Applied
Hide
Artificial Intelligence Machine Learning Engineer 2
Annapolis Junction, Maryland, United States
$130k-$270k/yr OnsiteFull Time
Captivation Software
Captivation Software: Provides specialized software engineering for the intelligence and defense communities.
5+ YOEFive years deploying machine learning algorithms, advanced software engineering and AI/ML model evaluation skills, and a Master's or Ph.D. in a relevant field; Top Secret/SCI clearance and favorable polygraph required.
machine learning algorithms, ML libraries, AI/ML algorithms, software architecture, data modelling, data structures
Job PostingView all