26 monitoring evaluation jobs at 24 companies in San Francisco, CA

4d
Save
Mark Applied
Hide
Exp. Manager – SoQM Monitoring, Evaluation & Reporting
New York or Los Angeles or Troy or Houston or Chicago or Grand Rapids or Owings Mills or Columbia or Richmond or Memphis or Raleigh or Boston or San Jose or San Francisco or Austin or Kalamazoo or Spokane or Denver or Atlanta or Orlando or Dallas or Phoenix or San Antonio or Milwaukee or Madison or McLean or Woodbridge or Stamford or Miami or Philadelphia or Charlotte or Greenville or West Palm Beach or Orange County or St. Louis or Fort Lauderdale or Seattle or Pittsburgh or Tulsa or Cincinnati or Cleveland or Columbus or Akron or Tampa or Minneapolis or Salt Lake City or Norfolk or Jacksonville or Nashville or Las Vegas or Indianapolis or San Diego or Metairie or Tallahassee or Omaha
$130k-$160k/yr OnsiteFull Time
BDO USA
BDO USA: Provides accounting, tax, and business advisory services to organizations.
6+ YOEBachelor’s degree in Accounting, six or more years of related experience, CPA, advanced Microsoft Excel, Microsoft Office, and knowledge of audit quality and professional standards.
Microsoft Excel, Microsoft Office Suite, Microsoft Word, Microsoft PowerPoint, Microsoft Outlook, Microsoft Teams
2mo
Save
Mark Applied
Hide
Autonomy Behavior Monitoring Data Scientist
Foster City or Boston
$176k-$240k/yr HybridFull Time
Zoox
ZooxNASDAQ: AMZN: Developing autonomous robotaxis for urban ride-hailing services.
2+ YOEB.S. or M.S. in a quantitative field (or equivalent), 2+ years data science experience focused on metric design/performance evaluation, strong Python production skills, experience with time-series/sensor data, and cross-functional communication.
Python, C++
1mo
Save
Mark Applied
Hide
Material Project Manager - Metals BU
Santa Clara, California, United States
$101k-$139k/yr OnsiteFull Time
Applied Materials
Applied MaterialsNASDAQ: AMAT: Produces equipment and services for chip and display manufacturing.
Experience managing materials strategy, supplier sourcing and evaluation, MRP coordination, commercialization plans, and supplier performance monitoring.
MRP
3mo
Save
Mark Applied
Hide
Senior Applied AI Engineer
San Francisco, California, United States
OnsiteFull Time
Alterion
Alterion: Building a control plane for enterprise AI agents.
5+ YOE5+ years in software/ML engineering; strong Python; production services; LLMs experience; model evaluation and monitoring; PyTorch or similar.
Python, PyTorch, LLMs, Machine Learning Pipelines, APIs
1mo
Save
Mark Applied
Hide
Program Specialist - Special Education
Richmond, California, United States
OnsiteFull Time
West Contra Costa Unified School District
West Contra Costa Unified School District: Provides public K-12 and adult education in Contra Costa.
Support staff in developing, monitoring, and evaluating special education programs; implement IEP decisions; coordinate placements; consult with teams and ensure legal compliance.
1w
Save
Mark Applied
Hide
Program and Project Management Advisor
San Francisco or Lakewood or Washington or Atlanta or Chicago or Boston or Kansas City or Raleigh or New York or Philadelphia or Fort Worth or Tacoma
$128k-$197k/yr OnsiteFull Time
U.S. General Services Administration
U.S. General Services Administration: Manages federal real estate and provides government-wide procurement services.
1+ YOESpecialized experience equivalent to GS-13 providing authoritative program advice, monitoring and evaluating national programs, developing recommendations, and establishing metrics and training.
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Model Evaluations (Speech LLM) - San Francisco
San Francisco, California, United States
$180k-$270k/yr HybridFull Time
Plaud
Plaud: Develops AI-powered voice recorders and automated transcription software.
Python software engineering; building distributed systems, data pipelines, and evaluation harnesses at scale; partner with ML researchers to define benchmarks; build dashboards and monitor model health; debug mid-training anomalies; communicate results clearly.
Python, Distributed systems, Data pipelines, Evaluation harnesses, Dashboards, Weighs & Biases, MLflow
2w
Save
Mark Applied
Hide
Data Scientist, GTM Intelligence
San Francisco, California, United States
$290k-$340k/yr HybridFull Time
OpenAI
OpenAI: Develops artificial intelligence models and generative AI software services.
Advanced SQL and production Python, experience owning production decision systems, feature engineering, model evaluation, monitoring, stakeholder discovery, and shipping data products.
Python, SQL, Databricks, Spark, dbt, Airflow, Salesforce
2w
Save
Mark Applied
Hide
Senior AI Engineer — Agents
San Francisco, California, United States
HybridFull Time
Mira Mace
Mira Mace: AI-powered healthcare advocacy and navigation for Medicare beneficiaries.
Experience building and shipping LLM-powered systems or agents, strong AI fluency (prompting, retrieval, evaluation), production monitoring, and solid software engineering practices.
Python, TypeScript, FastAPI, Next.js, Postgres
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Agent Oversight
San Francisco or New York City
$216k-$270k/yr OnsiteFull Time
Scale AI
Scale AI: Provides data and infrastructure for training artificial intelligence models.
5+ YOE5+ years as an ML engineer or applied scientist with production ML/LLM systems; experience building evaluation/monitoring or continuous-learning infrastructure; strong experimentation and collaboration skills.
LLMs, RLHF, SFT
1mo
Save
Mark Applied
Hide
MRI Technologist
Dublin or Brentwood or Oakland or Walnut Creek
$43-$50/hr OnsiteTemporary
Golden State Orthopedics & Spine
Golden State Orthopedics & Spine: Physician-owned medical group providing comprehensive musculoskeletal and orthopedic care.
ARRT or ARMRIT certification and CRT required; high school preferred. Operate MRI equipment, ensure patient safety, evaluate scan quality, and monitor patients during exams.
3mo
Save
Mark Applied
Hide
Pediatrics - Neurology/Epilepsy
San Francisco, California, United States
$332k-$342k/yr OnsiteFull Time
The Permanente Medical Group
The Permanente Medical Group: Physician-led medical group providing patient care for Kaiser Permanente.
BC/BE in pediatric neurology/epilepsy, ability to interpret routine and continuous EEG/vEEG, participate in inpatient video EEG monitoring and epilepsy surgery evaluation, EMR proficiency, and teaching experience.
Electronic Medical Records (EMR), vEEG, MEG
2mo
Save
Mark Applied
Hide
Speech and Language Pathologist 2026/2027 school year- One School Site
Richmond, California, United States
OnsiteFull Time
Richmond College Prep Schools
Richmond College Prep Schools: A public charter school offering primary and middle school education.
Provide direct speech and language therapy, conduct assessments and evaluations, develop individualized treatment plans, support communication across settings, and use progress monitoring and data to inform services.
5d
Save
Mark Applied
Hide
Machine Learning Engineer
San Francisco, California, United States
$176k/yr HybridFull Time
Bardeen
Bardeen: AI-powered platform for automating browser-based workflows and tasks.
1+ YOEMaster's in computational science and engineering or related machine learning field plus 1 year of experience with deep learning, LLMs, Python, cloud infrastructure, evaluation, monitoring, and distributed inference.
Python, Hugging Face, OpenAI, Gemini, Anthropic, AWS, GCP, OpenAI SDK, Gemini SDK, Anthropic SDK, Hugging Face Transformers, GPT, Mistral, LLaMA
3w
Save
Mark Applied
Hide
Certified Registered Nurse Anesthetist - Santa Rosa Hospital - Anesthesiology - Per Diem Varies
Santa Rosa, California, United States
$117-$152/hr OnsiteTemporary
Kaiser Permanente
Kaiser Permanente: Provides integrated medical care and health insurance plans.
Provides anesthesia care including evaluation, administration, monitoring, and post-op reporting. Requires CRNA and CA RN licensure, BLS; ACLS preferred; NPI and Medicare/Medi-Cal eligibility.
1w
Save
Mark Applied
Hide
Project Management Analyst
San Francisco, California, United States
OnsiteFull Time
UCSF Health
UCSF Health: Academic medical center providing advanced patient care and research.
1+ YOEBachelor's or equivalent and 1–3 years project or administrative experience; ability to monitor budgets, evaluate vendor estimates, review payments, prepare reports, manage vendor relationships, and use Microsoft Office.
Microsoft Office Suite, UCSF business systems
1w
Save
Mark Applied
Hide
Builder - Senior Software Engineer, AI
Santa Clara, California, United States
OnsiteFull Time
Reevo
Reevo: AI-native revenue operating system for go-to-market teams.
5+ YOE5+ years of software engineering experience focused on AI/ML systems, with expertise in LLMs, RAG, AI frameworks, model deployment, monitoring, prompt engineering, evaluation, vector databases, and semantic search.
RAG, large language models, AI/ML, ML operations, vector databases, embedding systems, semantic search
3d
Save
Mark Applied
Hide
Senior Medical Director, Oncology Clinical Development - Lung
Zug or Waltham or Stevenage or Upper Providence or Warsaw or London or Cambridge or Rockville or San Francisco
$284k-$474k/yr HybridFull Time
GSK
GSKLondon Stock Exchange: GSK: Develops and manufactures innovative vaccines and specialty medicines.
Medical degree and advanced specialty training in oncology, hematology, or related specialty; oncology clinical development experience; medical monitoring, safety evaluation, clinical data interpretation, GCP, ICH, and regulatory knowledge.
Clinical Data Interpretation, Clinical Pharmacology, Clinical Trial Designs, Clinical Trials Monitoring, Digital Fluency, Drug Development, Drug Regulatory Affairs, Evidence Based Decision Making, Executive Presence, Hematology and Oncology, Matrix Leadership, Real World Evidence (RWE), Scientific Presentations, Strategic Direction
2w
Save
Mark Applied
Hide
Tech Lead, Applied AI
San Francisco, California, United States
$230k-$270k/yr HybridFull Time
Abby Care
Abby Care: Trains and pays family members to provide home care.
8+ YOE8+ years in software engineering, ML, or applied AI; technical leadership experience; expertise with language models, agent architectures, retrieval, tool use, evaluation, and production monitoring; strong systems and backend fundamentals.
language models, agent architectures, retrieval, tool use, knowledge graphs, workflow engines, state machines
1mo
Save
Mark Applied
Hide
Nurse Practitioner / Physician Assistant – Valeda Specialist
Walnut Creek, California, United States
$104k-$150k/yr OnsiteFull Time
Bay Area Retina Associates
Bay Area Retina Associates: Specialized medical and surgical treatments for retinal diseases.
Perform patient evaluations, determine Valeda treatment eligibility, administer Valeda Light Delivery System treatments, document in EMR, educate patients, monitor patients, coordinate care, maintain equipment, and meet productivity and quality standards.
Valeda Light Delivery System, EMR, practice management system