27 software engineering evaluator jobs at 16 companies in North Carolina
1d
Save
Mark Applied
Hide
Software Engineer
Austin or Research Triangle Park or United States or New York or Washington
$129k-$185k/yr RemoteFull Time
5+ YOE5+ years of software engineering experience or equivalent. Requires Python, Go, Java, or similar; Linux/Unix; AI coding evaluation; secure development; REST APIs; CI/CD; containers; orchestration; production troubleshooting; and mentoring.
Python, Go, Java, Linux, Unix, Docker Swarm, Kubernetes, RESTful APIs, CI/CD, Kanban, Agile, Microsoft Excel
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Evaluation Flywheel — Autonomous Vehicles
Santa Clara or Washington or Georgia or North Carolina or Washington
$224k-$357k/yr RemoteFull Time
12+ YOE12+ years software engineering experience, strong Python and data engineering skills, deep experience evaluating ML/robotics systems, metric and dataset curation, and technical leadership.
Python, LLMs, VLMs
1mo
Save
Mark Applied
Hide
Sr. Software Engineer I, Evaluation Services
Chicago or California or Colorado or Florida or Georgia or Illinois or Indiana or Minnesota or Missouri or Montana or New Jersey or New York or North Carolina or Ohio or Oregon or Pennsylvania or South Carolina or Texas or Utah or Vermont or Virginia or Washington or Wisconsin or District of Columbia
$125k-$175k/yr HybridFull Time
5+ YOE5+ years software engineering with API development and partner integrations; strong REST/WebSocket/JSON/OAuth skills; proficiency in TypeScript/JavaScript or Python; excellent troubleshooting and communication.
REST APIs, WebSockets, JSON, OAuth, Postman, curl, browser developer tools, network analyzers, TypeScript, JavaScript, Python, React, Node.js, Swagger/OpenAPI, ReadMe
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Evaluation Flywheel — Autonomous Vehicles
Santa Clara or Georgia or Washington or North Carolina or District of Columbia
$224k-$357k/yr OnsiteFull Time
12+ YOE12+ years software experience in AV/robotics/large-scale ML, BS/MS or equivalent, strong Python and data engineering, metric and dataset curation, precision/recall methodology, and cross-team technical leadership.
Python, LLMs, VLMs
3w
Save
Mark Applied
Hide
Principal Cyber Software Test Engineer (TG)
Annapolis Junction or San Antonio or Aurora or Cary
$99k-$155k/yr OnsiteFull Time
5+ YOETS/SCI with Polygraph required, Bachelor's+5 years (or HS+9) related experience, ability to obtain required certifications within 6 months, experience with test & evaluation planning and analysis.
3w
Save
Mark Applied
Hide
Principal Cyber Software Test Engineer (TG)
Annapolis Junction or San Antonio or Aurora or Cary
$99k-$155k/yr OnsiteFull Time
5+ YOERequires TS/SCI with Polygraph, STEM degree plus 5 years (or HS plus 9 years), experience in test & evaluation, ability to obtain role certifications within 6 months, strong analysis and T&E skills.
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
3mo
Save
Mark Applied
Hide
Lead AI Engineer — Productivity Systems
Durham or Miami or Palo Alto or Washington
$12k-$18k/mo HybridFull Time
Proven experience shipping LLM-powered systems in production; strong prompt/context engineering, evaluation and guardrail development, and software engineering skills (Python/TypeScript/Clojure).
Python, TypeScript, Clojure, n8n, Zapier, AWS, Claude Code, Cursor, Copilot, Slack, Google Workspace, Jira, Terraform, RAG, MCP
2w
Save
Mark Applied
Hide
AI Engineer - NC
North Carolina, United States
OnsiteFull Time
5+ YOE5+ years of AI/ML engineering experience evaluating, fine-tuning, and deploying LLMs in production; cloud infrastructure, RAG, embeddings, vector databases, agentic workflows, EvalOps, and production software engineering required.
LLM, AWS, GCP, RAG, EvalOps, Evals-as-a-Service, vector databases
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
1w
Save
Mark Applied
Hide
Observability & Evaluation Engineer
Charlotte, North Carolina, United States
HybridFull Time
7+ YOERequires 7+ years of engineering experience, 5+ years of Python, observability, LLM evaluation, Agile, and production support experience; knowledge of RAG, AI quality, telemetry, and monitoring.
Python, Kubernetes, CI/CD
2mo
Save
Mark Applied
Hide
Field Engr II
Charlotte, North Carolina, United States
$122k/yr RemoteFull Time
3+ YOEBachelor’s degree in Engineering (or foreign equivalent) and 3 years' experience; experience with circuit evaluation, turbomachinery controller tuning, control valve/turbine/compressor calculations, troubleshooting and updating Compressor Controls Corporation hardware/software; up to 40% travel.
Honeywell Forge, Compressor Controls Corporation
1mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP
4d
Save
Mark Applied
Hide
INSTRUMENTATION - CALIBRATION TECH. III
Concord, North Carolina, United States
$40-$42/hr OnsiteFull Time
Requires pharmaceutical calibration experience, tolerance calculation and evaluation knowledge, cGMP knowledge, instrumentation software experience preferred, and an associate degree in instrumentation technology or electronics.
Blue Mountain (RAM), Calman, Procal
1mo
Save
Mark Applied
Hide
Senior Forward Deployed AI Engineer (GenAI, AWS)
New Jersey or New York or Pennsylvania or North Carolina or Connecticut or Massachusetts or Virginia
RemoteFull Time
Provectus: Builds and deploys custom artificial intelligence and data solutions.
8+ YOE8+ years building production software, hands-on coding (Python/TypeScript), cloud-native AWS delivery, shipped GenAI/LLM systems to production, built evaluation suites, strong stakeholder communication and domain learning ability.
Claude, Claude Code, Cowork, AWS, Python, TypeScript, Kubernetes, ECS, PyTorch, SageMaker, MLflow, Neo4j, AWS Neptune, AWS CDK, CloudFormation, Terraform, ChatGPT
1d
Save
Mark Applied
Hide
AI Engineer
New York City or United States or Raleigh-Durham or Atlanta or Philadelphia
$150k-$300k/yr HybridFull Time
Production experience launching LLM or agent products, strong Python, agent frameworks, RAG, prompt engineering, evaluation systems, ML tools, orchestration workflows, and stakeholder communication.
Python, AWS, PyTorch, scikit-learn, SQL, Spark, Airflow, ZenML, Kedro, dbt
2w
Save
Mark Applied
Hide
GenAI Engineer
Charlotte or Dallas or Houston or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent experience; hands-on GenAI and Agentic AI development using orchestration frameworks, vector databases, cloud AI platforms, governance, evaluation, and deployment tools.
SAS, R, Python, LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, Pinecone, Weaviate, Milvus, pgvector, FAISS, ChromaDB, Azure AI Search, Azure OpenAI, AWS Bedrock, Vertex AI, OpenAI, Anthropic, Gemini, Hugging Face, PyTorch, LoRA, QLoRA, PEFT, GitHub Actions, Jenkins, Terraform, Helm, Kubernetes, React, Angular, TypeScript, GraphQL, RDBMS, LLMs
3mo
Save
Mark Applied
Hide
AI Engineer (Research & Development)
Raleigh, North Carolina, United States
OnsiteFull Time
3+ YOE3+ years AI/ML experience; strong Python; expertise in NLP/LLMs; design, build, evaluate AI/ML models; experience with LLMs, RAG, prompting; able to work in a small, collaborative team; full-time on-site in Raleigh, NC.
Python, PyTorch, TensorFlow, scikit-learn, Hugging Face
1w
Save
Mark Applied
Hide
Lead Information Technology Specialist (APPSW)
Fresno or Washington or Jacksonville or Chamblee or Chamblee or Fairview Heights or Covington or Lanham or Detroit or Kansas City or Saint Louis or Charlotte or Holtsville or Philadelphia or Guaynabo or San Juan or Memphis or Austin or Austin or Farmers Branch or Ogden or Kearneysville
$126k-$193k/yr OnsiteFull Time
1+ YOEOne year of GS-13-equivalent specialized IT experience leading projects, applying advanced software engineering and cybersecurity practices, evaluating solutions, and providing technical leadership.
Artificial Intelligence (AI), Agile, DevOps, CI/CD, Software Development Life Cycle (SDLC)
Explore Jobs
Expand Your Job Search
Top Cities in North Carolina for Software Engineering Evaluator
- Software Engineering Evaluator jobs in Charlotte, NC
- Software Engineering Evaluator jobs in Raleigh, NC
- Software Engineering Evaluator jobs in Greensboro, NC
- Software Engineering Evaluator jobs in Durham, NC
- Software Engineering Evaluator jobs in Winston-Salem, NC
- Software Engineering Evaluator jobs in Fayetteville, NC
- Software Engineering Evaluator jobs in Cary, NC
- Software Engineering Evaluator jobs in Wilmington, NC
- Software Engineering Evaluator jobs in High Point, NC
- Software Engineering Evaluator jobs in Greenville, NC
- Software Engineering Evaluator jobs in Asheville, NC
- Software Engineering Evaluator jobs in Concord, NC
- Software Engineering Evaluator jobs in Gastonia, NC
- Software Engineering Evaluator jobs in Jacksonville, NC
- Software Engineering Evaluator jobs in Chapel Hill, NC
- Software Engineering Evaluator jobs in Rocky Mount, NC
- Software Engineering Evaluator jobs in Huntersville, NC
- Software Engineering Evaluator jobs in Burlington, NC
- Software Engineering Evaluator jobs in Wilson, NC
- Software Engineering Evaluator jobs in Kannapolis, NC