HiringCafe
Join our community

31 software engineering evaluator jobs at 21 companies in Virginia

1mo
Save
Mark Applied
Hide
Senior Software Engineer, Legal — CoCounsel Forward Deployed Engineering 
Frisco or New York City or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$95k-$176k/yr HybridFull Time
Thomson Reuters
Thomson ReutersNASDAQ: TRI: Provides professional software, data, and news services globally.
5+ YOEJD or formal legal training (or equivalent experience),5+ years software engineering,proficiency in Python,AI/LLM evaluation and prompt engineering,ability to engage legal users and mentor engineers,experience delivering production-grade SaaS solutions.
Python
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Springfield, Virginia, United States
OnsiteFull Time
Modern Technology Solutions
Modern Technology Solutions: A technology and defense consulting firm providing mission-focused engineering and test and evaluation services.
8+ YOEU.S. citizen with active TS/SCI and ability to pass CI polygraph; 8+ years supporting software engineering or system integration; experience with cloud architectures, virtual infrastructure, CI/CD, DevSecOps, and AI/ML evaluation environments.
AI/ML, cloud-based architectures, virtual infrastructure, APIs, Agile, DevSecOps, CI/CD, containerization technologies, orchestration frameworks, cloud-native development
Job PostingView all
3mo
Save
Mark Applied
Hide
Backend Software Engineer - Saga
New York or Seattle or Arlington or Rosslyn
OnsiteFull Time
Rune Technologies
Rune Technologies: Develops AI-powered logistics and sustainment software for military operations.
4+ YOE4+ years backend software engineering; experience with GenAI systems, vector databases, LLM integrations, and evaluation harnesses; strong problem solving and ownership.
GenAI, vector databases, LLM integrations, RAG architectures, tool-call frameworks, production-grade software
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Engineer
Springfield, Virginia, United States
OnsiteFull Time
Modern Technology Solutions, Inc.
Modern Technology Solutions, Inc.: Provides engineering, technology, and cybersecurity services for national security.
3+ YOEU.S. citizen with active TS/SCI and ability to pass CI polygraph; 3+ years software development/scripting (Python, Bash); experience with data processing, workflow automation, troubleshooting, and collaboration on AI/ML evaluation workflows.
Python, Bash, APIs, AI/ML, GEOINT, Agile, DevSecOps
Job PostingView all
6d
Save
Mark Applied
Hide
Software Engineer
Dahlgren, Virginia, United States
$75k-$100k/yr OnsiteFull Time
Bowhead
Bowhead: Federal government contracting and professional services provider.
2+ YOEBachelor's degree in engineering, science, or a technical field and 2+ years of experience; MATLAB or Python scripting, testing and evaluation, communication, Microsoft Office proficiency, and ability to obtain Secret clearance required.
MATLAB, Python, Microsoft Office, Microsoft Excel, Microsoft Project, Microsoft PowerPoint, Microsoft Word
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Software Engineer I, Evaluation Services
Chicago or California or Colorado or Florida or Georgia or Illinois or Indiana or Minnesota or Missouri or Montana or New Jersey or New York or North Carolina or Ohio or Oregon or Pennsylvania or South Carolina or Texas or Utah or Vermont or Virginia or Washington or Wisconsin or District of Columbia
$125k-$175k/yr HybridFull Time
NinjaTrader
NinjaTrader: Provides futures brokerage services and a trading software platform.
5+ YOE5+ years software engineering with API development and partner integrations; strong REST/WebSocket/JSON/OAuth skills; proficiency in TypeScript/JavaScript or Python; excellent troubleshooting and communication.
REST APIs, WebSockets, JSON, OAuth, Postman, curl, browser developer tools, network analyzers, TypeScript, JavaScript, Python, React, Node.js, Swagger/OpenAPI, ReadMe
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Software/System Test Engineer (Remote)
Sterling, Virginia, United States
$40-$70/hr RemotePart Time, Contract
TestPros
TestPros: Provides independent IT assessment and cybersecurity compliance services.
7+ YOERequires 7+ years in software testing, ISO/IEC 25010:2023 implementation, software or AI systems evaluation, test planning, execution, evidence capture, defect documentation, and strong reporting skills.
ISO/IEC 25010:2023, JIRA, WCAG
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Evaluation Engineer
Bucharest or Boulder or Boston or Chicago or Glendora or Richmond or London or Auckland
lei16k-lei19k/mo HybridFull Time
Yes Energy
Yes Energy: Provides real-time electric power market data and trading analytics.
5+ YOEBachelor's in CS/Data/Math, 5+ years software engineering with focus on testing/evaluation or AI/ML tooling, strong Python, experience building evaluation pipelines and LLM eval concepts, familiarity with RAG and production data pipelines.
RAGAS, LangSmith, PromptFlow, Snowflake, Python, RAG
Job PostingView all
2w
Save
Mark Applied
Hide
AI Engineer - VA
Virginia, United States
OnsiteFull Time
LawPro.ai
LawPro.ai: AI platform for medical record analysis in injury law.
5+ YOE5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying LLMs in production; RAG, embeddings, vector databases, agentic workflows, EvalOps, cloud infrastructure, and production software engineering required.
large language models (LLMs), RAG, embedding models, vector databases, AWS, GCP, EvalOps, Evals-as-a-Service
Job PostingView all
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
Job PostingView all
2w
Save
Mark Applied
Hide
System Safety Engineer, Senior
Huntsville or McLean
$99k-$225k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
10+ YOERequires 10+ years in engineering, system test and evaluation, or safety programs; MIL-STD-882E and AOP-52 experience; STEM bachelor's degree; and Secret clearance.
MIL-STD-882E, AOP-52, System Safety Program Plans (SSPP), Preliminary Hazard Analysis (PHA), Subsystem and System Hazard Analysis (SHA/SSHA), Operating and Support Hazard Analysis (O&SHA), Explosive Ordnance Disposal (EOD), Safety Assessment Reports (SAR), Weapon System Explosives Safety Review Board (WSESRB), Software Systems Safety Technical Review Panel (SSSTRP), digital engineering, machine learning, artificial intelligence, software development, fault tree analysis
Job PostingView all
3mo
Save
Mark Applied
Hide
Engineer/Scientist V
Chesapeake, Virginia, United States
OnsiteFull Time
Engineering Services Network
Engineering Services Network: Provider of engineering, technical, and IT services for defense and government customers.
15+ YOEFifteen years of software maintenance experience including DoD C4ISR, Agile, and leadership in testing, evaluation, and logistics support.
AWS, JIRA, Confluence, JAMA, Scrum
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Machine Learning Engineer, AI Evaluation
Alexandria, Virginia, United States
$100k-$130k/yr HybridFull Time
SHRM
SHRM: Provides professional certification, research, and advocacy for HR management.
7+ YOEBachelor's degree or equivalent experience and 7+ years in ML/LLM engineering, applied AI, data science, or research infrastructure. Requires Python, production systems, AI evaluation, cloud infrastructure, and reproducibility expertise.
Python, BigQuery, Vertex AI, IAM, Looker, Looker Studio, Google Cloud Platform
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
Afresh
Afresh: AI-powered inventory management for grocery store fresh food departments.
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Forward Deployed AI Engineer (GenAI, AWS)
New Jersey or New York or Pennsylvania or North Carolina or Connecticut or Massachusetts or Virginia
RemoteFull Time
Provectus: Builds and deploys custom artificial intelligence and data solutions.
8+ YOE8+ years building production software, hands-on coding (Python/TypeScript), cloud-native AWS delivery, shipped GenAI/LLM systems to production, built evaluation suites, strong stakeholder communication and domain learning ability.
Claude, Claude Code, Cowork, AWS, Python, TypeScript, Kubernetes, ECS, PyTorch, SageMaker, MLflow, Neo4j, AWS Neptune, AWS CDK, CloudFormation, Terraform, ChatGPT
Job PostingView all
2w
Save
Mark Applied
Hide
AI Platform Engineer
Arlington, Virginia, United States
$125k-$145k/yr OnsiteFull Time
Forterra
Forterra: Develops autonomous ground vehicle systems and software for defense.
3+ YOERequires 3+ years building software systems, recent LLM or agentic systems experience, Python, shell, CI, Linux, agent architecture, AI evaluation, production workloads, enterprise identity, and strong communication.
Python, MCP, CI, Linux, OAuth2, OIDC, SAML, DPO, QLoRA, GRPO, CUI, ITAR, NIST 800-171, FedRAMP, GovCloud
Job PostingView all
2w
Save
Mark Applied
Hide
Principal AI Engineer
Reston, Virginia, United States
$179k-$198k/yr HybridFull Time
Stanley Martin Homes
Stanley Martin Homes: Designs and builds residential homes and master-planned communities.
8+ YOE8+ years engineering experience; bachelor's degree or equivalent; production experience with LLM APIs, agent frameworks, Python, cloud platforms, evaluation, security, and governance; hybrid work in Reston required.
Anthropic Claude, Claude Code, Snowflake, Omni, Model Context Protocol (MCP), Microsoft Azure, Microsoft Dynamics, Salesforce, Python, TypeScript, JavaScript, SQL, Copilot Studio, Azure AI Foundry, Power Platform
Job PostingView all
2w
Save
Mark Applied
Hide
AI Solutions Engineer
Reston, Virginia, United States
$123k-$179k/yr HybridFull Time
Bechtel
Bechtel: Designs and constructs large-scale industrial and infrastructure projects.
7+ YOEBachelor's degree in a relevant field and 7+ years in AI/ML engineering or data science. Requires Python, ML frameworks, model validation, AI testing, LLM evaluation, and technical documentation experience.
Python, scikit-learn, PyTorch, TensorFlow, Hugging Face, Databricks, Azure Machine Learning, MLflow, Microsoft Copilot Studio, AutoGen, LangChain, Azure, DevOps, Git, CI/CD, RAG
Job PostingView all
1mo
Save
Mark Applied
Hide
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid)
Fort Belvoir, Virginia, United States
HybridFull Time
Solerity
Solerity: Provides IT and engineering services for federal government agencies.
Active Top Secret clearance, mid-to-senior ML engineering experience; proficiency in Python, ML frameworks, model evaluation, cloud environments, CI/CD, and backend service development.
Python, PyTorch, TensorFlow, Scikit-learn, AWS, Azure, Google Cloud, Git, CI/CD, Docker, Kubernetes
Job PostingView all
2d
Save
Mark Applied
Hide
Cybersecurity Test & Evaluation Specialist
Manassas, Virginia, United States
$101k-$110k/yr OnsiteFull Time
General Dynamics Mission Systems
General Dynamics Mission SystemsNYSE: GD: Designs and manufactures defense and mission-critical technology solutions.
5+ YOEBachelor's degree plus 5 years of relevant experience or master's degree plus 3 years; Secret clearance, U.S. citizenship, software testing, networking, Linux, and computer equipment assembly experience required.
Microsoft Word, Microsoft Excel, Microsoft PowerPoint, Microsoft Outlook, Linux, UDP, TCP/IP, ICMP, Strike Software, TTWCS, TCIP, MDS, AN/BYG-1
Job PostingView all

Explore Jobs

Expand Your Job Search