HiringCafe
Join our community

20 software engineering evaluator jobs at 17 companies in Pennsylvania

1mo
Save
Mark Applied
Hide
Sr. Software Engineer I, Evaluation Services
Chicago or California or Colorado or Florida or Georgia or Illinois or Indiana or Minnesota or Missouri or Montana or New Jersey or New York or North Carolina or Ohio or Oregon or Pennsylvania or South Carolina or Texas or Utah or Vermont or Virginia or Washington or Wisconsin or District of Columbia
$125k-$175k/yr HybridFull Time
NinjaTrader
NinjaTrader: Provides futures brokerage services and a trading software platform.
5+ YOE5+ years software engineering with API development and partner integrations; strong REST/WebSocket/JSON/OAuth skills; proficiency in TypeScript/JavaScript or Python; excellent troubleshooting and communication.
REST APIs, WebSockets, JSON, OAuth, Postman, curl, browser developer tools, network analyzers, TypeScript, JavaScript, Python, React, Node.js, Swagger/OpenAPI, ReadMe
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Perception Architecture
Pittsburgh, Pennsylvania, United States
HybridFull Time
Stack AV
Stack AV: Develops autonomous driving technology for the commercial trucking industry.
1+ YOEExperience architecting, training, and evaluating deep learning models; fluency in Python and C++; degree in robotics/computer vision/machine learning with relevant experience; background in detection, segmentation, tracking, or sensor fusion.
Python, C++
Job PostingView all
1mo
Save
Mark Applied
Hide
Agentic AI Architect - Intelligence Engineering (East)
Atlanta or Boston or Charlotte or Hartford or Miami or New Brunswick or New York City or Philadelphia or Raleigh or Washington
$108k-$218k/yr HybridFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years software engineering experience with 2+ years on generative/agentic AI; experience designing multi-agent systems, RAG, cloud AI platforms, Python and API frameworks, evaluation and governance for production AI systems.
Amazon Web Services, Azure, Google Cloud, AWS Bedrock, Azure AI Foundry, OpenAI Service, GCP Vertex AI, Gemini, Databricks, Lang Graph, Strands Agents SDK, OpenAI Agents SDK, Google ADK, Model Context Protocol (MCP), LangSmith, RAGAS, DeepEval, Claude Code, Cursor, Kiro, Python, FastAPI, Flask
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Modeler
Malvern, Pennsylvania, United States
$130k-$160k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
10+ YOE10+ years Python software engineering, hands-on Amazon Bedrock, prompt engineering, AWS fundamentals, model evaluation, and experience building observable production AI systems.
Python, Amazon Bedrock, AWS Lambda, S3, SQS, SNS, EventBridge, CloudWatch, IAM, Secrets Manager, AWS Textract, PyTorch, scikit-learn, PostgreSQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal AI Engineer
United States or Pennsylvania
$160k-$208k/yr RemoteFull Time
Vertex
VertexNASDAQ: VERX: Automates global indirect tax calculation and compliance for enterprises.
12+ YOE12+ years software/AI engineering with hands-on experience building LLM orchestration, MCP servers, agents, and retrieval/RAG systems; bachelor's in CS or related; strong evaluation, observability, and stakeholder skills.
LangGraph, LlamaIndex, Semantic Kernel, Model Context Protocol (MCP)
Job PostingView all
3w
Save
Mark Applied
Hide
Applied AI Engineer, Founding Team
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$63k-$219k/yr OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
5+ YOERequires 5+ years in software engineering, AI/ML, or enterprise technology; experience with retrieval systems, agentic AI, MCP, evaluation frameworks, and a bachelor's degree or equivalent.
Oracle 23ai, Model Context Protocol (MCP), Claude, Anthropic, Oracle EPM, Oracle ERP, Oracle Cloud Infrastructure (OCI)
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$156k-$231k/yr HybridFull Time
Afresh
Afresh: AI-powered inventory management for grocery store fresh food departments.
3+ YOE3+ years building production software or ML/data systems; strong Python and systems/API design; experience with LLM retrieval/RAG, agents, evaluation, Databricks/MLflow and modern data stacks.
Python, PySpark, dbt, Databricks, Delta Lake, Unity Catalog, MLflow, Astronomer, Airflow, Claude, GitHub, Shortcut, Notion, pgvector, Pinecone, Weaviate, LangGraph, MCP
Job PostingView all
4w
Save
Mark Applied
Hide
Sr AI Context Engineer
Lee's Summit or Missouri or Alaska or Hawaii or California or Washington or Oregon or Colorado or Wyoming or Montana or New York or Connecticut or Vermont or Pennsylvania or Maine or United States
$125k-$158k/yr RemoteFull Time
GEHA
GEHA: Provides health and dental insurance to federal employees.
5+ YOE5+ years backend/software or applied ML experience, 1–2 years GenAI/RAG focus, strong Python and SQL, experience with vector search, document parsing, HIPAA-compliant handling of PHI, and retrieval evaluation.
Python, SQL, Airflow, Prefect, Temporal, LlamaIndex, Unstructured.io, LangChain, Pinecone, pgvector, Azure AI Search, Weaviate, Qdrant, Ragas, TruLens, Arize Phoenix
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Forward Deployed AI Engineer (GenAI, AWS)
New Jersey or New York or Pennsylvania or North Carolina or Connecticut or Massachusetts or Virginia
RemoteFull Time
Provectus: Builds and deploys custom artificial intelligence and data solutions.
8+ YOE8+ years building production software, hands-on coding (Python/TypeScript), cloud-native AWS delivery, shipped GenAI/LLM systems to production, built evaluation suites, strong stakeholder communication and domain learning ability.
Claude, Claude Code, Cowork, AWS, Python, TypeScript, Kubernetes, ECS, PyTorch, SageMaker, MLflow, Neo4j, AWS Neptune, AWS CDK, CloudFormation, Terraform, ChatGPT
Job PostingView all
1d
Save
Mark Applied
Hide
AI Engineer
New York City or United States or Raleigh-Durham or Atlanta or Philadelphia
$150k-$300k/yr HybridFull Time
Sciemo
Sciemo: AI-powered business planning platform for consumer brands.
Production experience launching LLM or agent products, strong Python, agent frameworks, RAG, prompt engineering, evaluation systems, ML tools, orchestration workflows, and stakeholder communication.
Python, AWS, PyTorch, scikit-learn, SQL, Spark, Airflow, ZenML, Kedro, dbt
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Engineer - Machine Learning
Ambler or New York City
HybridFull Time
Berkadia
Berkadia: Commercial real estate financing, investment sales, and servicing.
6+ YOERequires 6+ years of Python-focused software development, traditional ML and generative AI systems, AI agents, evaluation harnesses, cloud infrastructure, MLOps, unstructured data, Agile, and CI/CD; bachelor's preferred.
Python, React, JavaScript, MLOps, CI/CD, Agile, Berkie
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Engineer, AI
Pennsylvania, United States
RemoteFull Time
Anaplan
Anaplan: Provider of cloud-native enterprise business planning and modeling software.
Extensive hands-on experience building and deploying ML and Generative AI systems, expertise with LLMs, prompt engineering, MLOps/LLMOps, Python, CI/CD, and production model monitoring and evaluation.
Python, LLM APIs, MLOps, LLMOps, CI/CD, Pinecone, Weaviate, Qdrant, vLLM, TensorRT, Ray, LangSmith, W&B, MLflow
Job PostingView all
3mo
Save
Mark Applied
Hide
Computer Engineer
State College, Pennsylvania, United States
$77k-$164k/yr OnsiteFull Time
Penn State University
Penn State University: Provides higher education and conducts extensive academic research programs.
5+ YOEPython, Linux (bash), cloud architectures; preferred Java or C/C++; DoD development experience; AI/ML model development/evaluation; bachelor's degree in engineering or science; security clearance eligibility
Python, Linux, Bash, Cloud architectures, Java, C/C++, AI/ML
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Engineer Tech Lead, Embodied AI & Off-Board Performance Evaluation
Boston or Las Vegas or Pittsburgh or United States
$200k-$275k/yr HybridFull Time
Motional
Motional: Develops autonomous vehicle technology for driverless ride-hailing and delivery.
10+ YOE10+ years software/AI/AV experience, Bachelor's in CS/Engineering/Robotics, expertise with LLMs/VLMs, Python (expert), AV performance metrics, vector DBs, cloud infrastructure; strong analytical and system-design skills.
Large Language Models (LLMs), Vision-Language Models (VLMs), LanceDB, Ray, AWS, GCP, Python, C++
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Information Technology Specialist (APPSW)
Fresno or Washington or Jacksonville or Chamblee or Chamblee or Fairview Heights or Covington or Lanham or Detroit or Kansas City or Saint Louis or Charlotte or Holtsville or Philadelphia or Guaynabo or San Juan or Memphis or Austin or Austin or Farmers Branch or Ogden or Kearneysville
$126k-$193k/yr OnsiteFull Time
IRS Office of Chief Counsel
IRS Office of Chief Counsel: Represents the IRS in tax litigation and legal matters.
1+ YOEOne year of GS-13-equivalent specialized IT experience leading projects, applying advanced software engineering and cybersecurity practices, evaluating solutions, and providing technical leadership.
Artificial Intelligence (AI), Agile, DevOps, CI/CD, Software Development Life Cycle (SDLC)
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Manager, Applied Science
Illinois or Kansas or Delaware or Colorado or Virginia or Michigan or Iowa or Florida or Texas or California or Pennsylvania or New Jersey or Massachusetts or Indiana or New York or Arizona or Connecticut or District of Columbia
$208k-$312k/yr HybridFull Time
Relativity
Relativity: AI-powered platform for legal discovery and data intelligence.
6+ YOE1+ MgmtMaster's or PhD (or equivalent) with 6+ years applied AI/ML experience, 1+ year people leadership, production AI system development, evaluation, error analysis, and strong software engineering skills.
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Project Manager
Sharon, Pennsylvania, United States
OnsiteFull Time
Rider Levett Bucknall
Rider Levett Bucknall: Global independent construction and property consultancy.
5+ YOE5+ MgmtFour-year degree in architecture, construction management, or engineering science, or equivalent experience; 5–10 years managing staff and major projects, including scopes, budgets, work plans, contracts, and performance evaluation.
computer
Job PostingView all
3mo
Save
Mark Applied
Hide
Principal Access Network Systems Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
Comcast
ComcastNASDAQ: CMCSA: Provides global telecommunications, media content, and entertainment services.
10+ YOE Lead strategic architecture and system design for next-generation access and transport technologies; evaluate hardware/software architectures; design RF/optical networks; develop PoCs; collaborate with partners.
FPGA, ASIC, Python, RF, Optical networking, WiFi, O-RAN
Job PostingView all

Explore Jobs

Expand Your Job Search