HiringCafe
Join our community

36 pyspark data engineer jobs at 14 companies in Eden Prairie, MN

1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: General merchandise retailer operating physical stores and e-commerce.
7+ YOE7+ years data engineering experience; BS/MS preferred; expertise with Hadoop/Spark, PySpark/Scala/Java, cloud platforms (AWS/GCP/Azure), APIs, streaming (Kafka/Flink/Kinesis), and data modeling.
Hadoop, Spark, Scala, Java, PySpark, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer II - Databricks Platform
Hartford or Hunt Valley or Saint Paul
$127k-$209k/yr HybridFull Time
Travelers
TravelersNew York Stock Exchange: TRV: Provider of commercial and personal property casualty insurance.
8+ YOEBachelor’s in STEM or equivalent, ~8 years related experience with additional data engineering experience, strong Databricks/PySpark/AWS skills, data governance and quality experience, stakeholder communication and leadership.
Databricks, Unity Catalog, Pyspark, AWS, Genie
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer with AI/ML
Minneapolis or Washington or United States
$73k-$130k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
5+ YOEBachelor's in CS/IT, 5+ years data engineering experience with Python, PySpark, SQL, ETL, cloud platforms and CI/CD; experience with LLMs/Generative AI and responsible AI principles preferred.
Python, PySpark, Databricks, T-SQL, SQL, Hadoop, Spark, Airflow, Snowflake, Azure (ML Studio), AWS, GCP, GitHub Actions, Docker, LangChain, HuggingFace, OpenAI APIs, LLMs
Job PostingView all
2d
Save
Mark Applied
Hide
Data Engineer Principal_3003
Minneapolis, Minnesota, United States
$110k-$150k/yr HybridFull Time
Allianz
AllianzXetra: ALV: Provides global insurance products and financial asset management services
7+ YOE7+ years of hands-on data engineering experience, including enterprise platform migration or re-engineering. Requires Azure, Databricks, Spark, Python, SQL, data governance, and stakeholder communication expertise.
Azure Synapse Analytics, Spark Pool, Dedicated SQL Pool, Azure Data Lake Storage Gen2, Delta Lake, Oracle GoldenGate Replication, Azure Analysis Services, Power BI, YAML, PySpark, SQL, Azure Databricks, Delta Live Tables, Unity Catalog, Apache Spark, Spark SQL, Python, Oracle DB, SQL Server, Azure SQL DB, Salesforce, APIs, Azure DevOps, GitHub Actions, Terraform, ARM, Docker, Event Hub, Kafka, Kinesis, MLOps, Dynatrace, Tableau
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Underwriting Technical Lead
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
10+ YOEBachelor's in STEM or equivalent; ~10 years related experience with 6+ years in data engineering; expertise with AWS (S3, Glue, Redshift, Lambda, EMR), Databricks, dbt, PySpark; AI/ML knowledge; technical leadership and mentoring experience.
AWS, S3, Glue, Redshift, Lambda, EMR, Databricks, dbt, PySpark, Azure Data Factory, Synapse Analytics, Azure Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
Quality Bicycle Products
Quality Bicycle Products: Distributor and manufacturer of bicycles and cycling components.
8+ YOEBachelor's degree required; 8+ years data engineering experience; expert SQL (T-SQL, PL/SQL); 5+ years building ETL/ELT with Azure Data Factory/Fabric/SAP Data Services; Power BI/DAX experience; machine learning and mentoring experience.
T-SQL, PL/SQL, SQL, SQL Server, Azure Data Factory, Fabric Data Pipelines, Microsoft Fabric, OneLake, SAP Data Services, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, eCommerce, Python, PySpark, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Kafka, Event Hubs, Spark Structured Streaming, Microsoft Purview, Databricks, Delta Sharing, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus, AWS, LangChain/LangGraph
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement and group purchasing organization.
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
Quality Bicycle Products
Quality Bicycle Products: Distributor of bicycle parts, accessories, and proprietary cycling brands.
8+ YOE8+ years data engineering experience, expert SQL, 5+ years ETL/ELT with Azure/Data Factory/Fabric, bachelor\u0002s degree in CS/IS/Engineering, experience with SAP integrations, Power BI/DAX, ML and modern lakehouse architectures.
Microsoft Fabric, OneLake, SAP Data Services, SQL Server, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, Azure Data Factory, Fabric Data Pipelines, Python, PySpark, SQL, T-SQL, PL/SQL, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, Databricks, Delta Sharing, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Microsoft Purview, Kafka, Event Hubs, Spark Structured Streaming, AWS, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus
Job PostingView all
1mo
Save
Mark Applied
Hide
Databricks Platform & Data Engineer (Plano, TX, US)
Plano or Minneapolis or Chicago or Atlanta
$135k-$247k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
12+ YOE12+ years experience with 5+ years on Databricks; deep expertise in Apache Spark, Delta Lake, Databricks platform setup, cloud (AWS/Azure/GCP), data governance, and client-facing delivery.
Databricks, Apache Spark, Scala, Python, Delta Lake, Unity Catalog, Dataflow, Genie, Kafka, Structured Streaming, MLOps, AWS, Azure, GCP, PowerPoint
Job PostingView all
1w
Save
Mark Applied
Hide
Data Architect
Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington
$152k-$206k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
10+ YOE3+ MgmtBachelor's or master's degree; 10+ years in data engineering or architecture and 3+ years in leadership. Requires cloud, data modeling, ETL, programming, and team leadership expertise.
Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks, Snowflake, Delta Lake, Apache Spark, Python, SQL, Java, Scala, Hadoop, Kafka, Amazon Redshift, Azure Synapse, Google BigQuery, Docker, Kubernetes
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Manager, Data Engineering & Analytics
Burnsville, Minnesota, United States
$170k-$215k/yr OnsiteFull Time
Trystar
Trystar: Designs and manufactures electrical power distribution and backup equipment.
8+ YOE3+ MgmtBachelor's degree,8+ years in enterprise data management,3+ years people leadership,hands-on Microsoft Fabric/medallion architecture experience,SQL/Pyspark/DAX proficiency,and strong communication for cross-functional influence.
Microsoft Fabric, OneLake, Lakehouse, Databricks, Data Factory, Synapse Data Engineering, Power BI, Microsoft Purview, Epicor, SAP, SQL, Pyspark, DAX, Azure
Job PostingView all
6d
Save
Mark Applied
Hide
Staff Engineer (e-ST)
Minneapolis, Minnesota, United States
$173k/yr HybridFull Time
Thrivent
Thrivent: Member-owned fraternal benefit society offering financial and insurance services.
6+ YOEBachelor's degree in MIS, computer science, or related field plus 6 years of data engineering experience; expertise in Big Data, pipelines, Spark, Hadoop, and cloud technologies required.
Hadoop, Apache Spark, Kafka, Python, Java, Scala, Snowflake, Databricks, StreamSets, Bamboo, Informatica, IICS, DB2, AWS, Microsoft Azure, Google Cloud, OpenStack, Docker, Ansible, Chef, Lambdas, Microservices, Terraform
Job PostingView all
2mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1mo
Save
Mark Applied
Hide
Technology Consultant 2
Minneapolis, Minnesota, United States
$69k-$112k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Databricks, Azure Data Factory (ADF), Python (PySpark/Spark), Azure, Airflow, Kubernetes, Snowflake; AI/ML model deployment experience; bachelor’s degree or equivalent experience; authorized to work in the U.S. (no employer sponsorship).
Databricks, Databricks Machine Learning, Azure Data Factory (ADF), Python, PySpark, Spark, Azure, Airflow, Kubernetes, Snowflake, GitHub, CI/CD
Job PostingView all
6d
Save
Mark Applied
Hide
Staff Engineer (e-ST)
Minneapolis, Minnesota, United States
$173k/yr HybridFull Time
Thrivent
Thrivent: Provides financial advice, insurance, and investments to member-owners.
6+ YOEBachelor’s degree in MIS, computer science, or related field plus 6 years of data engineering experience. Requires Big Data, pipeline, cloud, programming, architecture, and data modeling experience.
Hadoop, Apache Spark, Kafka, Python, Java, Scala, Snowflake, Databricks, StreamSets, Bamboo, Informatica, IICS, DB2, AWS, Azure, Google Cloud, OpenStack, Docker, Ansible, Chef, Lambdas, Microservices, Terraform
Job PostingView all
3w
Save
Mark Applied
Hide
Lead Solution Cloud Architect
Minneapolis, Minnesota, United States
$140k-$170k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
12+ YOE12–15 years IT experience with cloud and data architecture, 5+ years AWS, 3–5+ years Databricks, proficiency in Python/SQL/PySpark, Terraform/CloudFormation, CI/CD and strong data governance and security expertise.
Amazon EC2, Amazon S3, AWS Glue, AWS Lambda, Amazon Kinesis, AWS IAM, Amazon Redshift, Amazon EMR, Databricks, Delta Lake, MLflow, Unity Catalog, Python, SQL, PySpark, Terraform, CloudFormation, GitOps, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Azure Purview, Azure DevOps
Job PostingView all
2mo
Save
Mark Applied
Hide
Manager III, Software Development - Content Data Platform
Austin or Bozeman or Denver or Minneapolis or Missoula or Portland or Salt Lake City or Seattle or Charlotte or Kalispell or Boise or Charleston or Dallas or Fort Worth or Phoenix or Richmond or Spokane or Vermont
$150k-$188k/yr RemoteFull Time
onXmaps
onXmaps: Digital mapping and navigation apps for outdoor recreation.
5+ Mgmt5+ years managing software engineers; experience building data platform/infrastructure and migration off legacy systems; hiring and team development skills; experience with data quality, SLOs, and operational reliability; US work authorization required; ability to travel.
GCP, Managed Spark, BigQuery, BigLake, Pub/Sub, Managed Airflow, Apache Iceberg, Spark, PySpark, DuckDB, dbt, Airflow, GDAL, PostGIS, Apache Sedona, DuckDB spatial extensions, Knowledge Graph, AI-assisted tools
Job PostingView all

Explore Jobs

Expand Your Job Search