51 software engineering evaluator jobs at 35 companies in Baltimore, MD
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Legal — CoCounsel Forward Deployed Engineering
Frisco or New York City or Toronto or Ann Arbor or Eagan or San Francisco or Los Angeles or Irvine or McLean or Washington
$95k-$176k/yr HybridFull Time
5+ YOEJD or formal legal training (or equivalent experience),5+ years software engineering,proficiency in Python,AI/LLM evaluation and prompt engineering,ability to engage legal users and mentor engineers,experience delivering production-grade SaaS solutions.
Python
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Evaluation Flywheel — Autonomous Vehicles
Santa Clara or Washington or Georgia or North Carolina or Washington
$224k-$357k/yr RemoteFull Time
12+ YOE12+ years software engineering experience, strong Python and data engineering skills, deep experience evaluating ML/robotics systems, metric and dataset curation, and technical leadership.
Python, LLMs, VLMs
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Springfield, Virginia, United States
OnsiteFull Time
8+ YOEU.S. citizen with active TS/SCI and ability to pass CI polygraph; 8+ years supporting software engineering or system integration; experience with cloud architectures, virtual infrastructure, CI/CD, DevSecOps, and AI/ML evaluation environments.
AI/ML, cloud-based architectures, virtual infrastructure, APIs, Agile, DevSecOps, CI/CD, containerization technologies, orchestration frameworks, cloud-native development
3mo
Save
Mark Applied
Hide
Backend Software Engineer - Saga
New York or Seattle or Arlington or Rosslyn
OnsiteFull Time
4+ YOE4+ years backend software engineering; experience with GenAI systems, vector databases, LLM integrations, and evaluation harnesses; strong problem solving and ownership.
GenAI, vector databases, LLM integrations, RAG architectures, tool-call frameworks, production-grade software
2mo
Save
Mark Applied
Hide
Software Engineer
Springfield, Virginia, United States
OnsiteFull Time
3+ YOEU.S. citizen with active TS/SCI and ability to pass CI polygraph; 3+ years software development/scripting (Python, Bash); experience with data processing, workflow automation, troubleshooting, and collaboration on AI/ML evaluation workflows.
Python, Bash, APIs, AI/ML, GEOINT, Agile, DevSecOps
2w
Save
Mark Applied
Hide
Software Engineer, Applied AI
San Francisco or Los Angeles or Washington or San Diego or Seattle or London
$150k-$170k/yr HybridFull Time
2+ YOEBS/MS in a technical field, 2+ years of software development, strong Python, production systems, AI/ML integration, model evaluation, and familiarity with APIs, distributed systems, containers, CI/CD, observability, and edge deployment.
Python, APIs, CI/CD, GPU
2mo
Save
Mark Applied
Hide
Software Engineer, Agent Platform
Washington or Costa Mesa
$220k-$292k/yr OnsiteFull Time
Strong backend engineering experience building production platforms; deep expertise in LLM agent framework design and evaluation; familiarity with model post-training workflows (SFT, RL); emphasis on reliability and partnering with ML/product teams.
Lattice OS, Langchain, Deepagents, Claude SDK, Kubernetes, Docker
1w
Save
Mark Applied
Hide
Software Engineer - Prediction and Planning ML
Sunnyvale or Washington or San Diego or Fort Walton Beach or Ann Arbor or London or Stuttgart or Munich or Stockholm or Bengaluru or Seoul or Tokyo
$151k-$258k/yr OnsiteFull Time
3+ YOEBachelor’s in a related technical field; 3+ years building production software; deep learning model development expertise; C++ or Python proficiency with intermediate C++; ML modeling, evaluation, deployment, and optimization experience.
C++, Python, NeurIPS, CVPR, ICML, ICLR, ICCV, ECCV, IROS, ICRA
2w
Save
Mark Applied
Hide
Senior Software Engineer, Search AI Rater Quality
Washington, D.C. or New York
$174k-$252k/yr OnsiteFull Time
5+ YOEBachelor's degree or equivalent experience, 5 years of software development, search relevance or information retrieval evaluation, and exploratory data analysis using SQL, R, or Python.
SQL, R, Python, Large Language Models (LLMs)
2mo
Save
Mark Applied
Hide
Full Stack Software Engineer
Fort Meade or Annapolis Junction
$87k-$198k/yr OnsiteFull Time
7+ YOETS/SCI with polygraph required; Bachelor's +7 years (or 12+ years without degree); experience with Python or Java, C++, Docker or Kubernetes, Agile, JIRA, BitBucket/GitHub; strong customer and technical evaluation skills.
Python, Java, C++, Docker, Kubernetes, Agile, JIRA, Integrated Development Environments (IDEs), BitBucket, GitHub
3w
Save
Mark Applied
Hide
Principal Cyber Software Test Engineer (TG)
Annapolis Junction or San Antonio or Aurora or Cary
$99k-$155k/yr OnsiteFull Time
5+ YOETS/SCI with Polygraph required, Bachelor's+5 years (or HS+9) related experience, ability to obtain required certifications within 6 months, experience with test & evaluation planning and analysis.
3w
Save
Mark Applied
Hide
Principal Cyber Software Test Engineer (TG)
Annapolis Junction or San Antonio or Aurora or Cary
$99k-$155k/yr OnsiteFull Time
5+ YOERequires TS/SCI with Polygraph, STEM degree plus 5 years (or HS plus 9 years), experience in test & evaluation, ability to obtain role certifications within 6 months, strong analysis and T&E skills.
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
2w
Save
Mark Applied
Hide
Senior Software/System Test Engineer (Remote)
Sterling, Virginia, United States
$40-$70/hr RemotePart Time, Contract
7+ YOERequires 7+ years in software testing, ISO/IEC 25010:2023 implementation, software or AI systems evaluation, test planning, execution, evidence capture, defect documentation, and strong reporting skills.
ISO/IEC 25010:2023, JIRA, WCAG
3mo
Save
Mark Applied
Hide
Lead AI Engineer — Productivity Systems
Durham or Miami or Palo Alto or Washington
$12k-$18k/mo HybridFull Time
Proven experience shipping LLM-powered systems in production; strong prompt/context engineering, evaluation and guardrail development, and software engineering skills (Python/TypeScript/Clojure).
Python, TypeScript, Clojure, n8n, Zapier, AWS, Claude Code, Cursor, Copilot, Slack, Google Workspace, Jira, Terraform, RAG, MCP
1mo
Save
Mark Applied
Hide
MCCO Test Engineer | Active TS/SCI CI Poly
Fort Meade, Maryland, United States
$88k-$120k/yr OnsiteFull Time
2+ YOEActive TS/SCI with CI Poly, 2+ years software test engineering experience, bachelor's degree (or equivalent experience), and expertise in planning and executing software test & evaluation.
2w
Save
Mark Applied
Hide
Expert Test Engineer
Washington, District of Columbia, United States
$116k-$195k/yr HybridFull Time
12+ YOEBachelor's degree in engineering, sciences, or related field; 12+ years in test and evaluation; DHS acquisition and systems engineering lifecycle experience; technical reporting and senior briefings. Public Trust and Secret clearances required.
Digital Transformation, Cybersecurity, IT, Data Analytics, Software Development, Verification and Validation, Technology Readiness Assessment, Modeling and Simulation, National Institute of Standards and Technology Artificial Intelligence Risk Management Framework
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
2mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Washington or United States
$180k-$250k/yr RemoteFull Time
Experience building, training, evaluating, and deploying production ML/CV models; strong PyTorch or JAX experience; strong software engineering; BS/MS/PhD in CS or related field (or equivalent experience).
PyTorch, JAX, vision-language models (VLMs), LLM, GPU
2mo
Save
Mark Applied
Hide
Mid Level Test & Evaluation Engineer
Washington, District of Columbia, United States
HybridFull Time
3+ YOEMust be US citizen with active Secret clearance and ability to sustain Top Secret/SCI; bachelor's +5 years or master's +3 years in engineering; experience in test & evaluation, SETR/TEMP knowledge, hardware/software testing, modeling & simulation, MS Office proficiency, and up to 25% CONUS travel.
Microsoft Excel, Microsoft PowerPoint, Microsoft Word, AutoCAD
Explore Jobs
Expand Your Job Search
Top Cities Near Baltimore for Software Engineering Evaluator
- Software Engineering Evaluator jobs in Washington, DC
- Software Engineering Evaluator jobs in Arlington, VA
- Software Engineering Evaluator jobs in Alexandria, VA
- Software Engineering Evaluator jobs in Frederick, MD
- Software Engineering Evaluator jobs in Gaithersburg, MD
- Software Engineering Evaluator jobs in Rockville, MD
- Software Engineering Evaluator jobs in Bowie, MD
- Software Engineering Evaluator jobs in York, PA
- Software Engineering Evaluator jobs in Annapolis, MD
- Software Engineering Evaluator jobs in College Park, MD
- Software Engineering Evaluator jobs in Laurel, MD
- Software Engineering Evaluator jobs in Herndon, VA
- Software Engineering Evaluator jobs in Greenbelt, MD
- Software Engineering Evaluator jobs in Fairfax, VA
- Software Engineering Evaluator jobs in Middletown, DE
- Software Engineering Evaluator jobs in Westminster, MD
- Software Engineering Evaluator jobs in Hyattsville, MD
- Software Engineering Evaluator jobs in Takoma Park, MD
- Software Engineering Evaluator jobs in Easton, MD
- Software Engineering Evaluator jobs in Vienna, VA