HiringCafe
Join our community

42 pyspark data engineer jobs at 26 companies in Arizona

3w
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global leader in next-generation digital services and consulting.
Bachelor's degree or equivalent experience; experience with PySpark, AWS Redshift, AWS Glue and Gen AI; ability to work across SDLC, support production systems; US work authorization required; relocation/travel possible.
PySpark, AWS Redshift, Gen AI, AWS Glue
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Illinois or Arkansas or Idaho or Georgia or Alabama or Iowa or Utah or California or Arizona or Kansas or Florida or Colorado or Connecticut or Indiana or Delaware or Kentucky
$65k-$173k/yr RemoteFull Time
CVS Health
CVS HealthNYSE: CVS: Diversified healthcare integrating retail, pharmacy, and insurance services.
4+ YOERequires 4+ years with SQL and relational databases, 2+ years in cloud and on-premises data engineering platforms, SQL/Python/PySpark, data modeling, warehousing, troubleshooting, and a bachelor's degree in computer science or engineering.
SQL, Amazon Web Services (AWS), Google Cloud Platform (GCP), Microsoft Azure, Databricks, Snowflake, Microsoft SQL Server, Oracle, Teradata, Python, PySpark
Job PostingView all
3w
Save
Mark Applied
Hide
GCP Data Engineer
Phoenix, Arizona, United States
OnsiteFull Time, Contract
NucleusTeq
NucleusTeq: Private software services delivering data, cloud, AI, and digital transformation solutions to enterprises.
6+ YOERequires 6+ years of big data engineering experience, GCP, SQL, PySpark, Spark, Python, Scala, Hive, Pig, MapReduce, large-scale platforms, and enterprise data delivery experience.
GCP, Google Cloud Storage (GCS), DataProc, BigQuery, Composer, Airflow, PySpark, Spark, Python, Data Frames, Spanner DB, Graph DB, Scala, Hive, Pig, MapReduce, SQL
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Data Engineer
Tempe, Arizona, United States
$170k-$185k/yr HybridFull Time
RevolutionParts
RevolutionParts: SaaS eCommerce platform helping automotive dealers and manufacturers sell OEM parts and accessories online.
10+ YOE10+ years in data or software engineering, including 3+ at Staff level; Python, Spark/PySpark, distributed systems, AWS, Kubernetes, streaming, cloud warehouses, observability, orchestration, and a CS or engineering degree.
Python, Apache Spark, PySpark, Amazon Web Services (AWS), Amazon Elastic Kubernetes Service (EKS), Amazon EC2, Amazon Simple Queue Service (SQS), Amazon Relational Database Service (RDS), Kubernetes, Apache Kafka, Apache Flink, Amazon Kinesis, Redpanda, Snowflake, Google BigQuery, Databricks, Jira, DAGs
Job PostingView all
4w
Save
Mark Applied
Hide
Fabric Data Engineer
Scottsdale, Arizona, United States
HybridFull Time
Arrivia
Arrivia: B2B travel loyalty technology provider powering white-label booking, rewards, and marketing programs for brands, members, and employees.
3+ YOE3+ years data engineering with strong SQL, Python/PySpark, Microsoft Fabric or comparable cloud platform, streaming experience, lakehouse design, CI/CD, and mentoring; DP-700 preferred; bachelor's or equivalent.
Microsoft Fabric, Fabric Data Factory, Dataflows Gen2, PySpark, Spark SQL, T-SQL, Python, Scala, Fabric Eventstream, Azure Event Hubs, IoT Hub, OneLake, Microsoft Purview, Power BI, Git, Kafka, Azure Synapse, Databricks, Fabric deployment pipelines, Model Context Protocol (MCP)
Job PostingView all
2w
Save
Mark Applied
Hide
Lead Data Engineer - Remote (WFH)
Virginia or District of Columbia or Maryland or Tennessee or Florida or Arizona or Colorado or Oregon or Texas
$130k-$160k/yr RemoteFull Time
Cognitive Medical Systems
Cognitive Medical Systems: IT and software engineering services firm serving U.S. government healthcare programs; physician-led and service-disabled veteran-owned.
8+ YOEBachelor's degree in computer science, data engineering, or related field; 8+ years in data engineering, including 4+ years with high-volume batch ETL; expert Python and PySpark; CMS public trust background check eligibility.
Apache Airflow, PySpark, Amazon S3, Amazon Redshift Serverless, Snowflake, Databricks, Amazon Athena, Amazon SQS, AWS Lambda, Amazon EventBridge, Linux, RHEL, CentOS, Amazon Linux 2, Bash, SQL, GitHub, Jenkins, JFrog Artifactory, JFrog Xray, SonarQube, Snyk, BDD, TDD
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Archimedes
Archimedes: Privately held specialty drug management serving employers, health plans, and health systems.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
Scottsdale, Arizona, United States
OnsiteFull Time
Troon
Troon: Global golf, club, and hospitality management services.
3+ YOE3+ years in data engineering or ETL/ELT, production-grade pipeline experience, Azure cloud experience preferred, strong SQL and data modeling skills, bachelor's degree in CS/IT/Engineering or equivalent.
Azure Data Factory, Azure Synapse, Azure Data Lake, Synapse Analytics, SQL, PySpark, Spark, Databricks, Delta Lake, CI/CD, DevOps, APIs
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Tempe, Arizona, United States
OnsiteFull Time
Kestra Financial
Kestra Financial: Private U.S. wealth-management platform and independent broker-dealer/RIA supporting financial advisors with investment, insurance, technology, and practice services.
8+ YOESenior Databricks Data Engineer with Azure, Databricks Lakehouse, SQL, Python, PySpark; Delta Lake, Unity Catalog, CI/CD; 8+ years of experience.
Azure, Databricks, Delta Lake, Unity Catalog, Airflow, Python, SQL, PySpark, Spark SQL, Databricks Workflows, Repos, Delta Live Tables, REST APIs
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Tempe, Arizona, United States
OnsiteFull Time
Kestra Holdings
Kestra Holdings: Private wealth-management holding providing investment, trust, technology, and back-office services to independent financial professionals.
8+ YOEEight plus years designing and building scalable data pipelines in modern data warehousing; strong SQL, Python, PySpark; Azure, Databricks, Delta Lake, Unity Catalog, Airflow; CI/CD; governance.
Databricks, Azure, Python, PySpark, Spark SQL, Delta Lake, Unity Catalog, Airflow, Databricks Workflows, Databricks Repos, Delta Live Tables, CI/CD, REST API
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$175k-$270k/yr HybridFull Time
Early Warning Services
Early Warning Services: U.S. bank-owned fintech and consumer reporting agency providing identity, fraud-risk, and real-time payment solutions to financial institutions.
8+ YOE8+ years building large-scale data platforms, distributed systems, cloud-native data pipelines, EM/ML operationalization, and data warehouse/Big Data solutions; Bachelor's in CS or related.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, Aerospike, Elastic Search, IBM Infosphere, Oracle, SQL Server, AppDynamics, Kubernetes
Job PostingView all
6d
Save
Mark Applied
Hide
Sr. Data Engineer - Snowflake and Lakehouse
Phoenix or Johnston
$100k-$115k/yr OnsiteFull Time
Cognizant
CognizantNASDAQ: CTSH: Global professional services providing technology and consulting services.
5+ YOERequires 5+ years delivering enterprise Snowflake data engineering solutions, advanced SQL, Snowpipe, dbt, Snowpark, Python, Spark, Kafka, AWS, data modeling, governance, and CI/CD experience.
Snowflake, Snowpipe, Snowpipe Streaming, dbt, Snowpark, Python, Apache Spark, Dynamic Tables, Snowflake Tasks, Apache Iceberg, Kafka, Change Data Capture (CDC), AWS, Amazon S3, AWS IAM, AWS Glue, AWS Lambda, SQL, Git, CI/CD, Java, Apache Airflow
Job PostingView all
6d
Save
Mark Applied
Hide
Sr. Data Engineer - Snowflake and Lakehouse
Phoenix or Johnston
$100k-$115k/yr OnsiteFull Time
Cognizant
CognizantNASDAQ: CTSH: Global professional services providing technology and consulting services.
5+ YOERequires 5+ years delivering Snowflake data engineering solutions, advanced SQL, Snowpipe, dbt, Snowpark with Python and Spark, Kafka or CDC, AWS services, data modeling, governance, Git, and CI/CD.
Snowflake, Snowpipe, Snowpipe Streaming, dbt, Snowpark, Python, Apache Spark, Snowflake Tasks, Apache Iceberg, Kafka, Change Data Capture (CDC), Amazon Web Services (AWS), Amazon S3, AWS IAM, AWS Glue, AWS Lambda, SQL, Git, CI/CD, Java, Interactive Tables, Apache Airflow, SnowPro Core, SnowPro Advanced
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer II (ICP)
Arizona, United States
RemoteFull Time
Innovation Care Partners
Innovation Care Partners: A nonprofit healthcare system providing hospital, primary, specialty, and urgent care across the greater Phoenix area.
2+ YOEBachelor's in computer science or related field, 3+ years with integration or ETL tools, and 2+ years in data lakehouse, database development, and big data using Python, SQL, PL/SQL, Bash, Databricks, or Apache Spark.
Microsoft Purview, Python, SQL, PL/SQL, Bash, Databricks, Apache Spark, Azure, AWS, MySQL, Oracle, SQL Server
Job PostingView all
3w
Save
Mark Applied
Hide
Director, Data Engineering
Florida or Montana or Michigan or Massachusetts or Rhode Island or West Virginia or Oregon or Oklahoma or Minnesota or New York or South Carolina or Kentucky or Virginia or Colorado or New Jersey or Wisconsin or Utah or Pennsylvania or Ohio or North Carolina or Nebraska or Mississippi or South Dakota or Maryland or Louisiana or Kansas or Iowa or Illinois or Tennessee or Delaware or Connecticut or California or Hawaii or Arkansas or District of Columbia or Georgia or Missouri or Arizona or Alabama or New Hampshire or Texas or Vermont or Indiana or Washington or Nevada or Idaho or New Mexico or Maine
$195k-$210k/yr RemoteFull Time
AmeriLife
AmeriLife: National leader in developing, marketing and distributing insurance solutions.
10+ YOE5+ MgmtBachelor's degree,10+ years data engineering,5+ years leading teams,expert Databricks/Spark/Python/PySpark/SQL,Databricks platform and Unity Catalog experience,CI/CD and IaC familiarity,strong leadership and stakeholder skills.
Databricks Lakehouse Platform, Databricks, Unity Catalog, Delta Live Tables (Lakeflow), Delta Lake, Apache Spark, SQL, Python, PySpark, Databricks Workflows, Git, Azure
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Engineer, Data Platforms
Tempe or Phoenix or Alabama or Arizona or California or Colorado or Florida or Idaho or Kansas or Kentucky or Missouri or New Mexico or Nevada or Oklahoma or Oregon or Tennessee or Texas or Utah or Washington or Wyoming or Louisiana or Illinois or Indiana or North Carolina or Ohio or Michigan or New Jersey or Arkansas or Georgia
RemoteFull Time
Dutch Bros
Dutch BrosNYSE: BROS: Drive-thru beverage focused on community and connection.
7+ YOE7+ years data/software engineering experience (4+ years on backend or data infrastructure). Bachelor\u0002s in CS or related (or 4 years experience). Expert Python and SQL, Snowflake, Airflow, Power BI, AWS services, CI/CD, DataDog, Kafka, ETL/ELT tools, data governance, and strong communication skills.
Python, SQL, Snowflake, Snowpipe, SnowSQL, Airflow, Microsoft Power BI, AWS, IAM, VPC, Glue, S3, SFTP, Lambda, CloudWatch, SNS, Gitlab CI/CD, DataDog, Kafka, Workato, ADF, Matillion, DBT, Databricks, Fivetran, pyspark
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Data Engineer - FP&A
Phoenix, Arizona, United States
OnsiteFull Time
Cognite
Cognite: Industrial AI and data software serving energy, manufacturing, and power companies with operational data and AI.
5+ YOE5+ years in data-intensive roles; experience building production data pipelines with Python, SQL and REST APIs; hands-on Azure, Microsoft Fabric, Power BI, GitHub and Terraform; strong business acumen for FP&A integrations.
Azure, GCP, Microsoft Fabric, Power BI, Cognite Data Fusion®, Python, SQL, REST APIs, PySpark, Spark SQL, PowerShell, GitHub, GitHub Actions, Terraform, Key Vault
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Platform Engineer
Ohio or New York or New Jersey or Missouri or Minnesota or Michigan or Massachusetts or Indiana or Illinois or Georgia or Florida or Colorado or California or Arizona or Pennsylvania or Wisconsin or Texas or United States
$120k-$160k/yr RemoteFull Time
Clinician Nexus
Clinician Nexus: SullivanCotter is a private health care workforce consulting firm serving health systems and mission-driven organizations.
5+ YOE5+ years experience; degree in CS/Software Engineering/Information Systems/IT or equivalent; proficiency in Python/Scala/Java/SQL, Apache Spark, Databricks, ELT/ETL, streaming, RESTful/gRPC, SDLC, testing and CI/CD tooling; strong design and mentoring skills.
Python, Scala, Java, SQL, Apache Spark, Databricks, Pytest, GitHub Actions, Poetry, Git, RESTful, gRPC
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Tempe, Arizona, United States
OnsiteFull Time
Kestra Financial
Kestra Financial: Private U.S. wealth-management platform and independent broker-dealer/RIA supporting financial advisors with investment, insurance, technology, and practice services.
8+ YOE8+ years designing scalable data pipelines; expertise in SQL, Python; ETL/ELT; Azure, Snowflake, Databricks; governance and performance tuning.
Databricks, Azure, Snowflake, Python, SQL, PySpark, Airflow, Databricks Notebooks, Delta Lake, Unity Catalog, REST APIs
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer - DevOps & Data Engineering
Chandler, Arizona, United States
OnsiteContract
Koantek
Koantek: Databricks-exclusive systems integrator helping enterprises modernize data platforms and operationalize AI through consulting and engineering services.
16+ YOEStrong software engineering background, CI/CD and repo management experience, Terraform and cloud/IaC knowledge, data engineering experience, willingness to learn PySpark and data architecture, familiarity with Claude and Cursor.
Terraform, PySpark, Claude, Cursor
Job PostingView all

Explore Jobs

Expand Your Job Search