27 pyspark data engineer jobs at 17 companies in El Mirage, AZ
1w
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent experience; experience with PySpark, AWS Redshift, AWS Glue and Gen AI; ability to work across SDLC, support production systems; US work authorization required; relocation/travel possible.
PySpark, AWS Redshift, Gen AI, AWS Glue
1w
Save
Mark Applied
Hide
GCP Data Engineer
Phoenix, Arizona, United States
OnsiteFull Time, Contract
6+ YOERequires 6+ years of big data engineering experience, GCP, SQL, PySpark, Spark, Python, Scala, Hive, Pig, MapReduce, large-scale platforms, and enterprise data delivery experience.
GCP, Google Cloud Storage (GCS), DataProc, BigQuery, Composer, Airflow, PySpark, Spark, Python, Data Frames, Spanner DB, Graph DB, Scala, Hive, Pig, MapReduce, SQL
6d
Save
Mark Applied
Hide
Staff Data Engineer
Tempe, Arizona, United States
$170k-$185k/yr HybridFull Time
10+ YOE10+ years in data or software engineering, including 3+ at Staff level; Python, Spark/PySpark, distributed systems, AWS, Kubernetes, streaming, cloud warehouses, observability, orchestration, and a CS or engineering degree.
Python, Apache Spark, PySpark, Amazon Web Services (AWS), Amazon Elastic Kubernetes Service (EKS), Amazon EC2, Amazon Simple Queue Service (SQS), Amazon Relational Database Service (RDS), Kubernetes, Apache Kafka, Apache Flink, Amazon Kinesis, Redpanda, Snowflake, Google BigQuery, Databricks, Jira, DAGs
2w
Save
Mark Applied
Hide
Fabric Data Engineer
Scottsdale, Arizona, United States
HybridFull Time
3+ YOE3+ years data engineering with strong SQL, Python/PySpark, Microsoft Fabric or comparable cloud platform, streaming experience, lakehouse design, CI/CD, and mentoring; DP-700 preferred; bachelor's or equivalent.
Microsoft Fabric, Fabric Data Factory, Dataflows Gen2, PySpark, Spark SQL, T-SQL, Python, Scala, Fabric Eventstream, Azure Event Hubs, IoT Hub, OneLake, Microsoft Purview, Power BI, Git, Kafka, Azure Synapse, Databricks, Fabric deployment pipelines, Model Context Protocol (MCP)
2mo
Save
Mark Applied
Hide
Data Engineer
Scottsdale, Arizona, United States
OnsiteFull Time
3+ YOE3+ years in data engineering or ETL/ELT, production-grade pipeline experience, Azure cloud experience preferred, strong SQL and data modeling skills, bachelor's degree in CS/IT/Engineering or equivalent.
Azure Data Factory, Azure Synapse, Azure Data Lake, Synapse Analytics, SQL, PySpark, Spark, Databricks, Delta Lake, CI/CD, DevOps, APIs
3mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Tempe, Arizona, United States
OnsiteFull Time
8+ YOESenior Databricks Data Engineer with Azure, Databricks Lakehouse, SQL, Python, PySpark; Delta Lake, Unity Catalog, CI/CD; 8+ years of experience.
Azure, Databricks, Delta Lake, Unity Catalog, Airflow, Python, SQL, PySpark, Spark SQL, Databricks Workflows, Repos, Delta Live Tables, REST APIs
3mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Tempe, Arizona, United States
OnsiteFull Time
8+ YOEEight plus years designing and building scalable data pipelines in modern data warehousing; strong SQL, Python, PySpark; Azure, Databricks, Delta Lake, Unity Catalog, Airflow; CI/CD; governance.
Databricks, Azure, Python, PySpark, Spark SQL, Delta Lake, Unity Catalog, Airflow, Databricks Workflows, Databricks Repos, Delta Live Tables, CI/CD, REST API
1d
Save
Mark Applied
Hide
Data Engineer
Mesa or Plano or Teaneck
$65k/yr HybridFull Time
Bachelor’s or Master’s degree in a related field; Python and SQL skills; data pipeline, orchestration, cloud, architecture, containerization, CI/CD, and data modeling knowledge.
Python, SQL, Apache Spark, Apache Airflow, Prefect, Snowflake, Databricks, BigQuery, Docker, Kubernetes, GitHub, AWS, Microsoft Azure, Google Cloud Platform, JSON, XML, ETL, ELT, CI/CD
2w
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
6d
Save
Mark Applied
Hide
Data Engineer I
Phoenix, Arizona, United States
$78k-$125k/yr HybridFull Time
3+ YOEBachelor’s or master’s degree in computer science, engineering, or related field; 3+ years of experience; Python, Apache Spark, ETL/ELT, data governance, cloud platforms, REST API, and ML pipeline experience.
Python, Apache Spark, Airflow, AWS, Azure, GCP, REST API, ETL, ELT
1mo
Save
Mark Applied
Hide
Lead Engineer, Data Platforms
Tempe or Phoenix or Alabama or Arizona or California or Colorado or Florida or Idaho or Kansas or Kentucky or Missouri or New Mexico or Nevada or Oklahoma or Oregon or Tennessee or Texas or Utah or Washington or Wyoming or Louisiana or Illinois or Indiana or North Carolina or Ohio or Michigan or New Jersey or Arkansas or Georgia
RemoteFull Time
7+ YOE7+ years data/software engineering experience (4+ years on backend or data infrastructure). Bachelor\u0002s in CS or related (or 4 years experience). Expert Python and SQL, Snowflake, Airflow, Power BI, AWS services, CI/CD, DataDog, Kafka, ETL/ELT tools, data governance, and strong communication skills.
Python, SQL, Snowflake, Snowpipe, SnowSQL, Airflow, Microsoft Power BI, AWS, IAM, VPC, Glue, S3, SFTP, Lambda, CloudWatch, SNS, Gitlab CI/CD, DataDog, Kafka, Workato, ADF, Matillion, DBT, Databricks, Fivetran, pyspark
3mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Tempe, Arizona, United States
OnsiteFull Time
8+ YOE8+ years designing scalable data pipelines; expertise in SQL, Python; ETL/ELT; Azure, Snowflake, Databricks; governance and performance tuning.
Databricks, Azure, Snowflake, Python, SQL, PySpark, Airflow, Databricks Notebooks, Delta Lake, Unity Catalog, REST APIs
2mo
Save
Mark Applied
Hide
Senior Software Engineer - DevOps & Data Engineering
Chandler, Arizona, United States
OnsiteContract
16+ YOEStrong software engineering background, CI/CD and repo management experience, Terraform and cloud/IaC knowledge, data engineering experience, willingness to learn PySpark and data architecture, familiarity with Claude and Cursor.
Terraform, PySpark, Claude, Cursor
1mo
Save
Mark Applied
Hide
Senior Software Data Architect (Phoenix)
Phoenix, Arizona, United States
$172k-$200k/yr RemoteFull Time
15+ YOE5+ Mgmt15+ years software engineering/data architecture with 5+ years in senior/lead roles; Databricks lakehouse experience, Spark/PySpark, Python, cloud (Azure preferred), data modeling, ETL/ELT, data governance, BI (Power BI), CI/CD, and strong leadership and communication skills.
Databricks, Databricks Agentic, Unity Catalog, Spark SQL, PySpark, Delta, Iceberg, Python, AI/BI Dashboard, Genie Spaces, Power BI, SQL Server, PostgreSQL, MongoDB, Cassandra, Hive, Azure, AWS, GCP, CI/CD, Agile, Scrum
6d
Save
Mark Applied
Hide
Consultant, Cybersecurity (Data Engineer)
Columbus or Scottsdale or United States or Des Moines
$118k-$222k/yr HybridFull Time
6+ YOERequires advanced Databricks, Spark, Python, and SQL skills; high-volume security data pipeline experience; cybersecurity knowledge; and typically six years of technology experience with four years in cybersecurity.
Databricks, Apache Spark, Python, SQL, OCSF, Windows, Linux/Unix, PowerShell, Bash, Windows Batch, MITRE ATT&CK, PICERL
2mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
3w
Save
Mark Applied
Hide
Lead Eventing AWS Engineer (Kafka/Kinesis)
Bloomington or Dunwoody or Richardson or Tempe
$81k-$142k/yr HybridFull Time
Design and build event-driven data pipelines, canonical data models, CDC pipelines, materialized read models, and lead lakehouse migrations using AWS and Databricks technologies.
Kafka, Kinesis, Confluent Kafka, Kinesis, SQS, SNS, EventBridge, Lambda, AWS Glue, Step Functions, DynamoDB, Neptune, RDS, OpenSearch, Aurora, Databricks Lakehouse Platform, Delta Lake, Unity Catalog, Databricks SQL, dbt, PySpark, SQL, Iceberg, Redshift, Snowflake, GitLab, Terraform, GitHub Copilot, Neo4j
2mo
Save
Mark Applied
Hide
Manager III, Software Development - Content Data Platform
Austin or Bozeman or Denver or Minneapolis or Missoula or Portland or Salt Lake City or Seattle or Charlotte or Kalispell or Boise or Charleston or Dallas or Fort Worth or Phoenix or Richmond or Spokane or Vermont
$150k-$188k/yr RemoteFull Time
5+ Mgmt5+ years managing software engineers; experience building data platform/infrastructure and migration off legacy systems; hiring and team development skills; experience with data quality, SLOs, and operational reliability; US work authorization required; ability to travel.
GCP, Managed Spark, BigQuery, BigLake, Pub/Sub, Managed Airflow, Apache Iceberg, Spark, PySpark, DuckDB, dbt, Airflow, GDAL, PostGIS, Apache Sedona, DuckDB spatial extensions, Knowledge Graph, AI-assisted tools
Explore Jobs