109 pyspark developer jobs at 56 companies in Cotati, CA
1w
Save
Mark Applied
Hide
Sr. Software Engineer - PySpark
Scottsdale or San Francisco or Chicago or New York City
$118k-$152k/yr HybridFull Time
5+ YOEBachelor's-level education typical; minimum 5 years software engineering experience; strong with Git, Spring/Spring Boot, SQL, REST, Docker/Kubernetes, Kafka, automated testing and DevOps practices.
Git, Git flow, Spring, Spring Boot, SQL, Confluence, CI/CD, Docker, Kubernetes, Kafka, Hadoop, Hive, XML, JSON, YAML, Redis, HBASE, AeroSpike, REST
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Machine Learning Engineer III
Pleasanton or Santa Clara or San Francisco
$160k-$240k/yr HybridFull Time
3+ YOE3+ years building and deploying production ML systems with deep learning, NLP, information retrieval, recommender systems; 2+ years Python; experience with PyTorch or TensorFlow, MLOps (Kubeflow, Docker/K8s), cloud (AWS/GCP), PySpark/SQL; advanced degree or strong research record preferred.
PyTorch, TensorFlow, LangChain, LangGraph, PySpark, SQL, Kubeflow, Docker, K8s, AWS, GCP, Python, PEFT, DeepEval, RAGAS, DSPy
1mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
1mo
Save
Mark Applied
Hide
Lead Machine Learning Engineer - LMTS
San Francisco or Palo Alto or Bellevue
$173k-$286k/yr HybridFull Time
3+ YOE3+ years data science (3-5+ preferred) with 2+ years in cybersecurity; hands-on with Spark/PySpark, Snowflake, Flink, Apache Kafka; Docker, Kubernetes, Apache Airflow; Python, TensorFlow, PyTorch; MLOps/CI/CD, feature stores, ML governance; strong communication and stakeholder management.
Spark, PySpark, Snowflake, Flink, Apache Kafka, Docker, Kubernetes, Apache Airflow, Python, TensorFlow, PyTorch, CI/CD
2mo
Save
Mark Applied
Hide
Machine Learning Software Engineer Intern - Winter 2027
San Francisco or New York City
HybridInternship, Temporary
Currently enrolled in an M.Sc. or Ph.D. in computer science or related field; strong backend programming skills (Python, PySpark, PyTorch); ML experience, LLM familiarity preferred; excellent communication and learning mindset.
Python, PySpark, PyTorch, LLMs
3d
Save
Mark Applied
Hide
Software Engineer
San Francisco or Seattle or Maryland or New Jersey or New York or Alaska or Hawaii or Maine or Mississippi or North Dakota or South Dakota or Vermont or West Virginia or Wyoming
$118k-$183k/yr HybridFull Time
3+ YOEBachelor's degree in a relevant field, 3+ years of software development, and experience with search engines, distributed processing, public cloud services, and CI/CD tools.
C#, Java, C++, Go, Elasticsearch, Solr, Apache Spark, Kafka, Azure, AWS, GCP, Git, Jenkins, Azure DevOps, Docker, Kubernetes
4d
Save
Mark Applied
Hide
Software Engineer
San Francisco or Seattle or Maryland or New Jersey or New York or Alaska or Hawaii or Maine or Mississippi or North Dakota or South Dakota or Vermont or West Virginia or Wyoming
$112k-$183k/yr HybridFull Time
3+ YOEBachelor's degree in a relevant field, 3+ years of software development, and experience with large-scale data systems, search engines, distributed processing, and public cloud services.
Azure, Docker, Kubernetes, Elasticsearch, Solr, Apache Spark, Kafka, AWS, GCP, Git, Jenkins, Azure DevOps, C#, Java, C++, Go
1w
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
2mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
$140k-$230k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong SQL; Python; TypeScript; Airflow; AWS Glue; PySpark; Snowflake/PostgreSQL; backend frameworks; observability and data quality mechanisms.
Python, TypeScript, Apache Airflow, PySpark, AWS Glue, Snowflake, PostgreSQL, NestJS, GraphQL, AWS
5d
Save
Mark Applied
Hide
Entry-Level Software Engineer
Dallas or Seattle or Houston or San Francisco or Chicago or Philadelphia or El Segundo or Atlanta or New York
$80k-$92k/yr HybridFull Time
Pursuing a Bachelors or Masters in MIS, Computer Science, or Computer Engineering (graduation Dec 2026–Aug 2027); legal US work authorization without sponsorship; software development or internship experience; strong communication and problem-solving skills.
AWS, Azure, Google Cloud, Databricks, PySpark, CI/CD, Docker, Terraform, Azure OpenAI, AWS Bedrock, LangChain, Python, Java, SQL, JavaScript, .NET, React, Angular
2w
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco or New York City
$185k-$195k/yr HybridFull Time
5+ YOE5+ years data engineering experience, strong dbt and Databricks skills, Python/PySpark, streaming and CDC ingestion, data quality and observability, experience with operational integrations.
dbt, Databricks, Python, PySpark, Delta Lake, Delta Live Tables, Airflow, Cloud Run, Cloud Functions, BigQuery, GCP, AWS, Salesforce, NetSuite, Stripe, Mulesoft, Great Expectations, Unity Catalog, Terraform, Spacelift, Boomi
1w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco, California, United States
$133k-$236k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; proficiency in SQL, Python, PySpark, Airflow, Databricks; experience with high-volume telemetry, AI/ML data pipelines, and data governance.
SQL, Python, PySpark, Airflow, Databricks, Unity Catalog, Azure
1mo
Save
Mark Applied
Hide
Sr. Data Engineer
San Francisco, California, United States
$120k-$160k/yr HybridFull Time
Experienced in data modeling, large-scale data pipelines, ETL/ELT, Python and PySpark, machine learning/NLP, data warehousing, and collaboration across engineering and product teams.
Python, numpy, pandas, scikit-learn, nltk, TensorFlow, matplotlib, PySpark
2w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or San Francisco
$170k-$200k/yr HybridFull Time
5+ YOE5+ years building and operating production ETL pipelines, strong Python and SQL skills, Spark/PySpark, Databricks/Delta Lake, Airflow, data modeling and data quality expertise.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
2w
Save
Mark Applied
Hide
Staff Data Engineer
Denver or San Francisco
$190k-$264k/yr HybridFull Time
10+ YOE10+ years building scalable data platforms; expert PySpark, Python, SQL; experience with Kafka, Spark, Iceberg, data lakes, AWS; strong data modeling and security awareness.
PySpark, Python, SQL, MongoDB, Kafka, Spark, Iceberg, EKS, EMR, Serverless, Glue, Athena, S3, Databricks, Snowflake
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City
$120k-$235k/yr OnsiteFull Time
3+ YOEMaster's (3+ yrs) or Bachelor's (4+ yrs) in CS/Math/Engineering or equivalent experience; experience building production data systems, instrumentation/telemetry, experimentation, PySpark/SQL, and mentoring engineers; must pass Microsoft background checks.
ADLS, Azure Synapse, Microsoft Fabric, Databricks, PySpark, SQL, Cosmos, Scope, Conform, Aria
2mo
Save
Mark Applied
Hide
Staff Data Engineer - Data & ML Platform
San Francisco, California, United States
$198k-$296k/yr HybridFull Time
8+ YOE8+ years data engineering; strong Python and SQL; distributed processing (PySpark/Flink); cloud pipelines; mentoring.
Python, SQL, Flink, PySpark, Kafka, Delta Lake, dbt, Airflow, Aurora PostgreSQL, AWS
2w
Save
Mark Applied
Hide
Software Engineer
Boston or San Francisco or New York City or Paris or London
$90k-$120k/yr RemoteFull Time
2+ YOE2+ years backend engineering experience, strong programming and debugging skills, SQL and data modeling, Git and CI/CD experience, familiarity with AI coding assistants, and strong communication.
Claude Code, SQL, Git, CI/CD, Databricks, Apache Spark, Docker, Kubernetes, MLflow, Airflow, Kubeflow, Argo, Dagster, Terraform, Ansible, Grafana, Elasticsearch, Lucene, GraphQL, scikit-learn, TensorFlow, PyTorch
Explore Jobs