23 pyspark data engineer jobs at 15 companies in Apache Junction, AZ

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1w
Save
Mark Applied
Hide
Staff Engineer II - Data Engineer
Phoenix or Dallas
OnsiteFull Time
Western Alliance Bank
Western Alliance BankNYSE: WAL: National commercial bank providing specialized financial and business solutions.
7+ YOE7+ years data engineering experience with ETL, EDW, cloud data platforms, T-SQL/PL/SQL/Spark SQL, Azure services, PySpark; Bachelor's degree required; leadership and regulatory knowledge preferred.
T-SQL, PL/SQL, Spark SQL, Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, Databricks, Azure Data Lake, Azure DevOps, PySpark, Visio, Lucidchart, Agile, SAFe, Scrum
1mo
Save
Mark Applied
Hide
Fabric Data Engineer — Workplace Engineering
Wayne or Charlotte or Dallas or Fort Worth or Scottsdale
HybridFull Time
Vanguard
Vanguard: Provides mutual funds, ETFs, and investment management services.
8+ YOE8+ years software/data/platform engineering experience, 5+ years on Microsoft/Azure data stack; hands-on with Microsoft Fabric, OneLake, PySpark, SQL, KQL; CI/CD and IaC experience; Bachelor\u0002s in CS/Engineering or equivalent.
Microsoft Fabric, OneLake, Microsoft Power BI, AWS S3, Microsoft Entra ID, Okta, Microsoft Purview, PySpark, Azure Data Factory, Dataflows Gen2, Databricks, Azure Synapse, Azure SQL, SQL Server, SQL, KQL, Terraform, Bicep, GitHub, Azure DevOps, microsoft/fabric Terraform provider, microsoft fabric-cicd Python library, Fabric REST API, Snowflake, Cosmos, Eventhouse
1mo
Save
Mark Applied
Hide
Data Engineer
Scottsdale, Arizona, United States
OnsiteFull Time
Troon
Troon: Provides management and hospitality services for golf and country clubs.
3+ YOE3+ years in data engineering or ETL/ELT, production-grade pipeline experience, Azure cloud experience preferred, strong SQL and data modeling skills, bachelor's degree in CS/IT/Engineering or equivalent.
Azure Data Factory, Azure Synapse, Azure Data Lake, Synapse Analytics, SQL, PySpark, Spark, Databricks, Delta Lake, CI/CD, DevOps, APIs
2mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Tempe, Arizona, United States
OnsiteFull Time
Kestra Financial
Kestra Financial: Empowers independent financial professionals with wealth management platform solutions.
8+ YOESenior Databricks Data Engineer with Azure, Databricks Lakehouse, SQL, Python, PySpark; Delta Lake, Unity Catalog, CI/CD; 8+ years of experience.
Azure, Databricks, Delta Lake, Unity Catalog, Airflow, Python, SQL, PySpark, Spark SQL, Databricks Workflows, Repos, Delta Live Tables, REST APIs
2mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Tempe, Arizona, United States
OnsiteFull Time
Kestra Holdings
Kestra Holdings: Provides wealth management platforms and technology for independent financial professionals.
8+ YOEEight plus years designing and building scalable data pipelines in modern data warehousing; strong SQL, Python, PySpark; Azure, Databricks, Delta Lake, Unity Catalog, Airflow; CI/CD; governance.
Databricks, Azure, Python, PySpark, Spark SQL, Delta Lake, Unity Catalog, Airflow, Databricks Workflows, Databricks Repos, Delta Live Tables, CI/CD, REST API
2mo
Save
Mark Applied
Hide
MID-LEVEL DATA ENGINEER-Python, AWS, Spark (Hybrid)
Bloomington or Richardson or Tempe or Dunwoody
HybridFull Time
State Farm
State Farm: Provider of auto, home, life, and health insurance.
2+ YOE2-4 years as a Data Engineer; proficiency in Python, Spark SQL/PySpark, R, Java, Bash; hands-on AWS (ETL tools, Lambda, Step Functions, S3, DynamoDB, Kinesis, Redshift, SageMaker); Spark/Databricks; IaC (OpenTofu); CI/CD with Airflow.
Python, Apache Spark, PySpark, R, Java, Bash, AWS, Glue, EMR Serverless, Lambda, Step Functions, EventBridge, S3, DynamoDB, Kinesis Firehose, Redshift, Iceberg, SageMaker, Databricks, OpenTofu, Terraform, Airflow, SQL, Athena
4d
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$145k-$223k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
8+ YOEBachelor's degree in CS or related,8+ years relevant experience building data platforms,experience with data warehouse, big data, ETL, cloud, AI/ML lifecycle, and delivering production systems.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, HDFS, Elastic Search, Oracle, SQL Server, IBM Infosphere, AppDynamics, Kubernetes
3w
Save
Mark Applied
Hide
Lead Engineer, Data Platforms
Tempe or Phoenix or Alabama or Arizona or California or Colorado or Florida or Idaho or Kansas or Kentucky or Missouri or New Mexico or Nevada or Oklahoma or Oregon or Tennessee or Texas or Utah or Washington or Wyoming or Louisiana or Illinois or Indiana or North Carolina or Ohio or Michigan or New Jersey or Arkansas or Georgia
RemoteFull Time
Dutch Bros
Dutch BrosNYSE: BROS: Operates and franchises drive-thru shops serving handcrafted beverages.
7+ YOE7+ years data/software engineering experience (4+ years on backend or data infrastructure). Bachelor\u0002s in CS or related (or 4 years experience). Expert Python and SQL, Snowflake, Airflow, Power BI, AWS services, CI/CD, DataDog, Kafka, ETL/ELT tools, data governance, and strong communication skills.
Python, SQL, Snowflake, Snowpipe, SnowSQL, Airflow, Microsoft Power BI, AWS, IAM, VPC, Glue, S3, SFTP, Lambda, CloudWatch, SNS, Gitlab CI/CD, DataDog, Kafka, Workato, ADF, Matillion, DBT, Databricks, Fivetran, pyspark
1d
Save
Mark Applied
Hide
AWS Python Data Engineer
Raleigh or Richardson or Tempe
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with AWS, Python, data processing (PySpark), NoSQL and SQL, CI/CD, Docker/Kubernetes, Terraform; bachelor\u0002s degree or equivalent experience; authorized to work in the U.S. without sponsorship.
EC2, ECS, ECR, EFS, EMR, Lambda, Step Functions, RDS, Glue, S3, API Gateway, SQS, SNS, REST APIs, Python, PySpark, GitLab, Git, Docker, Kubernetes, Terraform, FastAPI, Flask, PostgreSQL, DynamoDB
1mo
Save
Mark Applied
Hide
Software Engineer Lead - Data Product Organization (Cloudera Hadoop, Neo4j, Spark/PySpark)
Pittsburgh or Strongsville or Denver or Phoenix or Birmingham or Dallas
$55k-$138k/yr OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
3+ YOEExperience with Cloudera Hadoop, Neo4j, Spark/PySpark, HDFS/Hive/Impala, Iceburg and streaming; strong communication and leadership; 3+ years relevant experience; Bachelor\u0002s degree typical.
Cloudera Hadoop, Neo4j, Spark, PySpark, HDFS, HQL, Hive, Impala, Beeline, Linux, Apache Kafka, Iceburg
2mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Tempe, Arizona, United States
OnsiteFull Time
Kestra Financial
Kestra Financial: Independent wealth management platform for financial professionals.
8+ YOE8+ years designing scalable data pipelines; expertise in SQL, Python; ETL/ELT; Azure, Snowflake, Databricks; governance and performance tuning.
Databricks, Azure, Snowflake, Python, SQL, PySpark, Airflow, Databricks Notebooks, Delta Lake, Unity Catalog, REST APIs
1mo
Save
Mark Applied
Hide
Senior Software Engineer - DevOps & Data Engineering
Chandler, Arizona, United States
OnsiteContract
Koantek
Koantek: Systems integrator delivering Databricks-powered data and AI solutions.
16+ YOEStrong software engineering background, CI/CD and repo management experience, Terraform and cloud/IaC knowledge, data engineering experience, willingness to learn PySpark and data architecture, familiarity with Claude and Cursor.
Terraform, PySpark, Claude, Cursor
1w
Save
Mark Applied
Hide
Senior Software Data Architect (Phoenix)
Phoenix, Arizona, United States
$172k-$200k/yr RemoteFull Time
ComplexCare Solutions
ComplexCare Solutions: Provides health assessments and clinical engagement for health plans.
15+ YOE5+ Mgmt15+ years software engineering/data architecture with 5+ years in senior/lead roles; Databricks lakehouse experience, Spark/PySpark, Python, cloud (Azure preferred), data modeling, ETL/ELT, data governance, BI (Power BI), CI/CD, and strong leadership and communication skills.
Databricks, Databricks Agentic, Unity Catalog, Spark SQL, PySpark, Delta, Iceberg, Python, AI/BI Dashboard, Genie Spaces, Power BI, SQL Server, PostgreSQL, MongoDB, Cassandra, Hive, Azure, AWS, GCP, CI/CD, Agile, Scrum
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Manager III, Software Development - Content Data Platform
Austin or Bozeman or Denver or Minneapolis or Missoula or Portland or Salt Lake City or Seattle or Charlotte or Kalispell or Boise or Charleston or Dallas or Fort Worth or Phoenix or Richmond or Spokane or Vermont
$150k-$188k/yr RemoteFull Time
onXmaps
onXmaps: Digital mapping and navigation apps for outdoor recreation.
5+ Mgmt5+ years managing software engineers; experience building data platform/infrastructure and migration off legacy systems; hiring and team development skills; experience with data quality, SLOs, and operational reliability; US work authorization required; ability to travel.
GCP, Managed Spark, BigQuery, BigLake, Pub/Sub, Managed Airflow, Apache Iceberg, Spark, PySpark, DuckDB, dbt, Airflow, GDAL, PostGIS, Apache Sedona, DuckDB spatial extensions, Knowledge Graph, AI-assisted tools
2mo
Save
Mark Applied
Hide
Senior System Analyst – Kinaxis / Data Engineering (Supply Chain Planning)
Phoenix, Arizona, United States
OnsiteFull Time
Honeywell International
Honeywell InternationalNASDAQ: HON: Designs and manufactures technologies for aerospace, buildings, and industry.
5+ YOE5+ years Kinaxis Maestro/RapidResponse; end-to-end supply chain planning; SAP integration; data engineering (ETL, SQL or Python).
Kinaxis Maestro, RapidResponse, SAP, ETL tools, SQL, Python, Airflow, ADF, SSIS, Snowflake, PySpark