11 pyspark data engineer jobs at 5 companies in Sublimity, OR
3w
Save
Mark Applied
Hide
Data Engineer
Beaverton, Oregon, United States
OnsiteFull Time
3+ YOE3+ years data engineering experience with Databricks, Azure, Python, PySpark, and SQL; strong knowledge of distributed data systems, data governance, and ETL/ELT design.
Azure, Databricks, Python, SQL, Apache Spark, PySpark, Azure Data Lake Storage, Delta Lake, Unity Catalog, Databricks Workflows, Delta Live Tables, Structured Streaming, Kafka, Event Hubs, Microsoft Power BI
2w
Save
Mark Applied
Hide
Lead Data Engineer
Beaverton, Oregon, United States
OnsiteFull Time
8+ YOE8+ years data engineering experience with Databricks, PySpark, SQL, Apache Spark and AWS; experience leading teams, CI/CD, data modeling, real-time frameworks; Bachelor's degree or equivalent required.
Databricks Lakehouse Platform, Databricks, PySpark, SQL, Apache Spark, Delta Lake, AWS, S3, RDS, Kafka, Kinesis, Git, CI/CD
2w
Save
Mark Applied
Hide
Lead Data Engineer
Beaverton, Oregon, United States
OnsiteFull Time
8+ YOE8+ years data engineering experience with Databricks, PySpark, SQL, and Apache Spark; experience with Databricks Lakehouse, Delta Lake, AWS (S3,RDS); leadership, CI/CD, Git, and data modeling skills.
Databricks, PySpark, SQL, Apache Spark, Databricks Lakehouse Platform, Delta Lake, AWS, S3, RDS, Kafka, Kinesis, Git, CI/CD
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1d
Save
Mark Applied
Hide
Sr. Data Engineer
Beaverton, Oregon, United States
OnsiteFull Time
3+ YOERequires 3–5 years of data engineering experience, dimensional modeling, data marts or warehouses, complex SQL, Azure Databricks, Python, scalable pipelines, and a bachelor's degree or equivalent experience.
Azure Databricks, Databricks, Apache Spark, SQL, Python, Microsoft Azure
1w
Save
Mark Applied
Hide
Sr. Data Operations Engineer
Beaverton, Oregon, United States
OnsiteFull Time
5+ YOE5+ years data/ML operations experience with Azure Databricks, ADF, ADLS, SQL, Python/PySpark, monitoring, CI/CD, secure file transfer, and experience in regulated environments.
Azure Databricks, Unity Catalog, ADF, ADLS, SQL Server, Power BI, Fivetran, MOVEit Automation, GoAnywhere, Azure Monitor, Log Analytics, SQL, Python, PySpark, Azure DevOps, GitHub
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Senior Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$305k/yr HybridFull Time
5+ YOE5+ years data engineering; 3+ years Palantir Foundry/Gotham/AIP experience; 5+ years cloud (AWS/Azure/GCP); 5+ years Python/PySpark/Java; Bachelor’s in CS/Engineering or equivalent; strong client-facing and communication skills.
Palantir Foundry, Palantir Gotham, Palantir AIP, Python, PySpark, Java, TypeScript, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
2w
Save
Mark Applied
Hide
Senior Principal Software Engineer
Beaverton, Oregon, United States
OnsiteFull Time
14+ YOE5+ MgmtBachelor's in CS or related,14+ years software engineering,5+ years principal/staff engineering,5+ years cloud engineering,experience with distributed systems,data platforms,ML,frontend and DevOps practices.
Java, Node.js, EC2, Lambda, DynamoDB, Elasticsearch, Google Cloud, Azure, Databricks, Snowflake, Kafka, Kinesis, Apache Spark, Apache Airflow, dbt, LLMs, PyTorch, TensorFlow, CI/CD, IaC, JavaScript, CSS, HTML5, Vue, React, Redux
2w
Save
Mark Applied
Hide
Senior Principal Software Engineer
Beaverton, Oregon, United States
OnsiteFull Time
14+ YOE5+ MgmtBachelor's in CS or related,14+ years software engineering experience,5+ years principal-level leadership,5+ years cloud engineering,experience with distributed systems,modern data platforms,ML/LLM stacks,DevOps and front-end tech.
Java, node.js, EC2, Lambda, DynamoDB, Elasticsearch, Google Cloud, Azure, Databricks, Snowflake, Kafka, Kinesis, Apache Spark, Apache Airflow, dbt, LLMs, PyTorch, TensorFlow, Spark, MLOps, CI/CD, IaC, javascript, CSS, html5, Vue, React/redux
2mo
Save
Mark Applied
Hide
Manager III, Software Development - Content Data Platform
Austin or Bozeman or Denver or Minneapolis or Missoula or Portland or Salt Lake City or Seattle or Charlotte or Kalispell or Boise or Charleston or Dallas or Fort Worth or Phoenix or Richmond or Spokane or Vermont
$150k-$188k/yr RemoteFull Time
5+ Mgmt5+ years managing software engineers; experience building data platform/infrastructure and migration off legacy systems; hiring and team development skills; experience with data quality, SLOs, and operational reliability; US work authorization required; ability to travel.
GCP, Managed Spark, BigQuery, BigLake, Pub/Sub, Managed Airflow, Apache Iceberg, Spark, PySpark, DuckDB, dbt, Airflow, GDAL, PostGIS, Apache Sedona, DuckDB spatial extensions, Knowledge Graph, AI-assisted tools