Fredericksburg • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Fredericksburg • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Fredericksburg • 50 milesRemote · Hybrid · Onsite · Field · All Environments
Fredericksburg • 50 milesRemote · Hybrid · Onsite · Field · All Environments
42 software engineering evaluator jobs at 31 companies in Fredericksburg, VA
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Legal — CoCounsel Forward Deployed Engineering
Frisco or New York City or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$95k-$176k/yr HybridFull Time
5+ YOEJD or formal legal training (or equivalent experience),5+ years software engineering,proficiency in Python,AI/LLM evaluation and prompt engineering,ability to engage legal users and mentor engineers,experience delivering production-grade SaaS solutions.
Python
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Evaluation Flywheel — Autonomous Vehicles
Santa Clara or Washington or Georgia or North Carolina or Washington
$224k-$357k/yr RemoteFull Time
12+ YOE12+ years software engineering experience, strong Python and data engineering skills, deep experience evaluating ML/robotics systems, metric and dataset curation, and technical leadership.
Python, LLMs, VLMs
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Springfield, Virginia, United States
OnsiteFull Time
8+ YOEU.S. citizen with active TS/SCI and ability to pass CI polygraph; 8+ years supporting software engineering or system integration; experience with cloud architectures, virtual infrastructure, CI/CD, DevSecOps, and AI/ML evaluation environments.
AI/ML, cloud-based architectures, virtual infrastructure, APIs, Agile, DevSecOps, CI/CD, containerization technologies, orchestration frameworks, cloud-native development
3mo
Save
Mark Applied
Hide
Backend Software Engineer - Saga
New York or Seattle or Arlington or Rosslyn
OnsiteFull Time
4+ YOE4+ years backend software engineering; experience with GenAI systems, vector databases, LLM integrations, and evaluation harnesses; strong problem solving and ownership.
GenAI, vector databases, LLM integrations, RAG architectures, tool-call frameworks, production-grade software
2mo
Save
Mark Applied
Hide
Software Engineer
Springfield, Virginia, United States
OnsiteFull Time
3+ YOEU.S. citizen with active TS/SCI and ability to pass CI polygraph; 3+ years software development/scripting (Python, Bash); experience with data processing, workflow automation, troubleshooting, and collaboration on AI/ML evaluation workflows.
Python, Bash, APIs, AI/ML, GEOINT, Agile, DevSecOps
6d
Save
Mark Applied
Hide
Software Engineer
Dahlgren, Virginia, United States
$75k-$100k/yr OnsiteFull Time
2+ YOEBachelor's degree in engineering, science, or a technical field and 2+ years of experience; MATLAB or Python scripting, testing and evaluation, communication, Microsoft Office proficiency, and ability to obtain Secret clearance required.
MATLAB, Python, Microsoft Office, Microsoft Excel, Microsoft Project, Microsoft PowerPoint, Microsoft Word
2w
Save
Mark Applied
Hide
Software Engineer, Applied AI
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBS/MS in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
2mo
Save
Mark Applied
Hide
Software Engineer, Agent Platform
Washington or Costa Mesa
$220k-$292k/yr OnsiteFull Time
Strong backend engineering experience building production platforms; deep expertise in LLM agent framework design and evaluation; familiarity with model post-training workflows (SFT, RL); emphasis on reliability and partnering with ML/product teams.
Lattice OS, Langchain, Deepagents, Claude SDK, Kubernetes, Docker
1w
Save
Mark Applied
Hide
Software Engineer - Prediction and Planning ML
Sunnyvale or Washington or San Diego or Fort Walton Beach or Ann Arbor or London or Stuttgart or Munich or Stockholm or Bengaluru or Seoul or Tokyo
$151k-$258k/yr OnsiteFull Time
3+ YOEBachelor’s in a related technical field; 3+ years building production software; deep learning model development expertise; C++ or Python proficiency with intermediate C++; ML modeling, evaluation, deployment, and optimization experience.
C++, Python, NeurIPS, CVPR, ICML, ICLR, ICCV, ECCV, IROS, ICRA
2w
Save
Mark Applied
Hide
Senior Software Engineer, Search AI Rater Quality
Washington, D.C. or New York
$174k-$252k/yr OnsiteFull Time
5+ YOEBachelor's degree or equivalent experience, 5 years of software development, search relevance or information retrieval evaluation, and exploratory data analysis using SQL, R, or Python.
SQL, R, Python, Large Language Models (LLMs)
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
2w
Save
Mark Applied
Hide
Senior Software/System Test Engineer (Remote)
Sterling, Virginia, United States
$40-$70/hr RemotePart Time, Contract
7+ YOERequires 7+ years in software testing, ISO/IEC 25010:2023 implementation, software or AI systems evaluation, test planning, execution, evidence capture, defect documentation, and strong reporting skills.
ISO/IEC 25010:2023, JIRA, WCAG
3mo
Save
Mark Applied
Hide
Lead AI Engineer — Productivity Systems
Durham or Miami or Palo Alto or Washington
$12k-$18k/mo HybridFull Time
Proven experience shipping LLM-powered systems in production; strong prompt/context engineering, evaluation and guardrail development, and software engineering skills (Python/TypeScript/Clojure).
Python, TypeScript, Clojure, n8n, Zapier, AWS, Claude Code, Cursor, Copilot, Slack, Google Workspace, Jira, Terraform, RAG, MCP
2w
Save
Mark Applied
Hide
Expert Test Engineer
Washington, District of Columbia, United States
$116k-$195k/yr HybridFull Time
12+ YOEBachelor's degree in engineering, sciences, or related field; 12+ years in test and evaluation; DHS acquisition and systems engineering lifecycle experience; technical reporting and senior briefings. Public Trust and Secret clearances required.
Digital Transformation, Cybersecurity, IT, Data Analytics, Software Development, Verification and Validation, Technology Readiness Assessment, Modeling and Simulation, National Institute of Standards and Technology Artificial Intelligence Risk Management Framework
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
2mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Washington or United States
$180k-$250k/yr RemoteFull Time
Experience building, training, evaluating, and deploying production ML/CV models; strong PyTorch or JAX experience; strong software engineering; BS/MS/PhD in CS or related field (or equivalent experience).
PyTorch, JAX, vision-language models (VLMs), LLM, GPU
2mo
Save
Mark Applied
Hide
Mid Level Test & Evaluation Engineer
Washington, District of Columbia, United States
HybridFull Time
3+ YOEMust be US citizen with active Secret clearance and ability to sustain Top Secret/SCI; bachelor's +5 years or master's +3 years in engineering; experience in test & evaluation, SETR/TEMP knowledge, hardware/software testing, modeling & simulation, MS Office proficiency, and up to 25% CONUS travel.
Microsoft Excel, Microsoft PowerPoint, Microsoft Word, AutoCAD
2w
Save
Mark Applied
Hide
System Safety Engineer, Senior
Huntsville or McLean
$99k-$225k/yr OnsiteFull Time
10+ YOERequires 10+ years in engineering, system test and evaluation, or safety programs; MIL-STD-882E and AOP-52 experience; STEM bachelor's degree; and Secret clearance.
MIL-STD-882E, AOP-52, System Safety Program Plans (SSPP), Preliminary Hazard Analysis (PHA), Subsystem and System Hazard Analysis (SHA/SSHA), Operating and Support Hazard Analysis (O&SHA), Explosive Ordnance Disposal (EOD), Safety Assessment Reports (SAR), Weapon System Explosives Safety Review Board (WSESRB), Software Systems Safety Technical Review Panel (SSSTRP), digital engineering, machine learning, artificial intelligence, software development, fault tree analysis
2d
Save
Mark Applied
Hide
Senior AI Platform Engineer, Microsoft 365 & Copilot (3 year LTE)
Seattle or Washington
$157k/yr OnsiteFull Time, Temporary
10+ YOE10+ years in AI, software, cloud, platform, Microsoft 365, or Power Platform engineering; enterprise AI experience; Microsoft cloud expertise; secure data access, governance, evaluation, and operational experience.
Microsoft 365, Microsoft Copilot, Copilot Studio, Power Platform, SharePoint, Microsoft Teams, OneDrive, Exchange, Viva, Anthropic Claude, OpenAI ChatGPT, Power Apps, Power Automate, Dataverse, Azure AI, Azure OpenAI, Microsoft Graph, Entra ID, PowerShell, Semantic Kernel, Azure AI Search, Microsoft Excel, APIs
18h
Save
Mark Applied
Hide
AI Engineer
Washington, D.C. or Atlanta or San Francisco
$223k-$259k/yr RemoteFull Time
5+ YOE5+ years of software engineering experience, including production LLM systems. Requires agentic systems expertise, strong Python, developer tooling, evaluation methods, systems fundamentals, ownership, and communication skills.
Python, Pydantic, MCP, OpenTelemetry, vLLM, Rust, Swift, Kotlin, Xcode, iOS simulators, CLIs, CI/CD