HiringCafe
Join our community

41 pyspark data engineer jobs at 19 companies in Eagan, MN

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
4d
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Eden Prairie, Minnesota, United States
$73k-$130k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
6+ YOESenior data engineer with 6+ years in data engineering, Python/PySpark, Databricks, Azure, CI/CD, and SQL; experienced in Agile environments.
Databricks, Apache Spark, Python, Azure, Delta Lake, Azure Data Factory, GitHub Actions, Azure DevOps, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Minneapolis or Saint Paul or North America or South America
$50k-$56k/yr RemoteFull Time
Tergar International
Tergar International: Provides meditation training and Tibetan Buddhist spiritual programs.
3+ YOE3+ years data engineering experience; strong Python, PySpark, JavaScript, SQL; Linux (Bash); AWS Lambda/Glue; PostgreSQL/MySQL/Redshift; Git and CI/CD; data modeling, governance, and stakeholder collaboration skills.
Linux (Bash), Python, PySpark, JavaScript, SQL, PostgreSQL, MySQL, Amazon Redshift, AWS Lambda, Glue Jobs, Workflows, Git, CI/CD, HubSpot, HubSpot API, Microsoft Power BI, Docker, Google Tag Manager, PostHog, Terraform, ETL, ELT
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer, Underwriting Technical Lead
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
10+ YOEBachelor's in STEM or equivalent; ~10 years related experience with 6+ years in data engineering; expertise with AWS (S3, Glue, Redshift, Lambda, EMR), Databricks, dbt, PySpark; AI/ML knowledge; technical leadership and mentoring experience.
AWS, S3, Glue, Redshift, Lambda, EMR, Databricks, dbt, PySpark, Azure Data Factory, Synapse Analytics, Azure Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
St. Paul, Minnesota, United States
$102k-$131k/yr HybridFull Time
Accelint
Accelint: Provides AI-driven autonomous systems for national security missions.
2+ YOEBachelor’s in CS/Engineering or related field; 2-5 years with Airflow and Spark; containerization (Kubernetes/Docker/Helm); DoD/domain experience preferred.
Apache Airflow, Apache Spark, Kubernetes, Docker, Helm, ETL, Data Warehousing, AWS S3, PostgreSQL, TypeScript, Express, FastAPI
Job PostingView all
1w
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
Quality Bicycle Products
Quality Bicycle Products: Distributor and manufacturer of bicycles and cycling components.
8+ YOEBachelor's degree required; 8+ years data engineering experience; expert SQL (T-SQL, PL/SQL); 5+ years building ETL/ELT with Azure Data Factory/Fabric/SAP Data Services; Power BI/DAX experience; machine learning and mentoring experience.
T-SQL, PL/SQL, SQL, SQL Server, Azure Data Factory, Fabric Data Pipelines, Microsoft Fabric, OneLake, SAP Data Services, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, eCommerce, Python, PySpark, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Kafka, Event Hubs, Spark Structured Streaming, Microsoft Purview, Databricks, Delta Sharing, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus, AWS, LangChain/LangGraph
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement and group purchasing organization.
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Cloud Data Engineer - Multi-Cloud Data Platforms
Irving or Chicago or Hopkins
$133k-$157k/yr HybridFull Time
U.S. Bank
U.S. BankNYSE: USB: Provider of personal, business, and institutional financial services.
6+ YOE6+ years experience building cloud-native data pipelines and products across Azure, AWS, Databricks, and Snowflake; strong Spark and SQL skills; experience with security, governance, and domain-oriented data architectures.
Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, AWS Glue, S3, Databricks, Snowflake, Apache Spark, Delta Lake, SQL, REST, SOAP, GraphQL, Kafka, MQ, AWS SQS, RabbitMQ, API Gateway, OAuth 2.0, TLS, mTLS, JWT, IAM, RBAC, Microsoft Power BI, Tableau
Job PostingView all
1w
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
Quality Bicycle Products
Quality Bicycle Products: Distributor of bicycle parts, accessories, and proprietary cycling brands.
8+ YOE8+ years data engineering experience, expert SQL, 5+ years ETL/ELT with Azure/Data Factory/Fabric, bachelor\u0002s degree in CS/IS/Engineering, experience with SAP integrations, Power BI/DAX, ML and modern lakehouse architectures.
Microsoft Fabric, OneLake, SAP Data Services, SQL Server, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, Azure Data Factory, Fabric Data Pipelines, Python, PySpark, SQL, T-SQL, PL/SQL, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, Databricks, Delta Sharing, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Microsoft Purview, Kafka, Event Hubs, Spark Structured Streaming, AWS, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus
Job PostingView all
2w
Save
Mark Applied
Hide
Databricks Platform & Data Engineer (Plano, TX, US)
Plano or Minneapolis or Chicago or Atlanta
$135k-$247k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
12+ YOE12+ years experience with 5+ years on Databricks; deep expertise in Apache Spark, Delta Lake, Databricks platform setup, cloud (AWS/Azure/GCP), data governance, and client-facing delivery.
Databricks, Apache Spark, Scala, Python, Delta Lake, Unity Catalog, Dataflow, Genie, Kafka, Structured Streaming, MLOps, AWS, Azure, GCP, PowerPoint
Job PostingView all
2w
Save
Mark Applied
Hide
Data Product Manager, IC
Maple Grove, Minnesota, United States
$102k-$194k/yr HybridFull Time
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
5+ YOEBachelor's in a technical field or equivalent; 5+ years in data product/architecture/engineering roles; experience with cloud data platforms, enterprise data modeling, governance, SQL, and modern data stack tools.
Snowflake, dbt, Apache Airflow, SQL, AWS, Tableau, Sigma, ThoughtSpot, Python, Pandas, NumPy, PySpark, Databricks, Redshift, Azure, Google Cloud
Job PostingView all
2w
Save
Mark Applied
Hide
Data Product Manager, IC
Maple Grove, Minnesota, United States
$102k-$194k/yr HybridFull Time
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
5+ YOE5+ years in data product/architecture/engineering roles, experience delivering enterprise data products on cloud platforms, strong SQL and data modeling skills, governance experience, and stakeholder communication.
Snowflake, dbt, Apache Airflow, SQL, AWS, Tableau, Sigma, ThoughtSpot, Python, Pandas, NumPy, PySpark, Databricks, Redshift, Azure, Google Cloud
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Platform Engineer (AI & Analytics) - Hybrid (Minneapolis, MN, US, 55416)
Minneapolis, Minnesota, United States
$110k-$151k/yr HybridFull Time
Allianz
AllianzXetra: ALV: Provides global insurance products and financial asset management services
6+ YOE6+ years in data engineering/DevOps/cloud; experience with Azure, Databricks, Terraform, Kubernetes, PySpark and GitHub Actions; infrastructure-as-code and CI/CD experience; U.S. work authorization required.
Azure, Databricks, Databricks DAB, Terraform, Kubernetes, GitHub Actions, PySpark, Spark, Unity Catalog, Delta tables, CLI
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineering Associate Director (Microsoft Fabric & Databricks)
Minneapolis, Minnesota, United States
$152k-$259k/yr HybridFull Time
Protiviti
ProtivitiNYSE: RHI: Global consulting firm providing risk management and internal audit services.
9+ YOE9+ years experience in professional services or industry; bachelor’s degree in a relevant discipline; leadership, client relationship, and project management skills; expertise with Microsoft Fabric, Azure Databricks, SQL, data engineering, and related Microsoft data technologies.
Microsoft Fabric, Azure Databricks, PySpark, SparkSQL, Power BI, Azure Storage, Git, Microsoft Purview, SQL, Python, Spark, C#, Java, Scala, R, DAX, MDX, M, Microsoft Office, Microsoft Word, Microsoft Excel, Microsoft PowerPoint, Microsoft Visio, Microsoft Access, Azure AI tooling, DevOps, DataOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1mo
Save
Mark Applied
Hide
Technical Lead Engineer
Davidson or Tyler or Minneapolis or Columbia or La Crosse
$124k-$173k/yr HybridFull Time
Trane Technologies
Trane TechnologiesNYSE: TT: Global provider of heating, ventilation, and air conditioning solutions.
5+ YOE2+ Mgmt5+ years data analytics experience; leadership; strong SQL/ETL/ELT, Python/R, Spark; cloud platforms; stakeholder management.
SQL, T-SQL, PLSQL, R, Python, Apache Spark, ETL, ELT, Apache Airflow, data warehousing, data lineage, GCP, AWS, Informatica, Oracle
Job PostingView all
1mo
Save
Mark Applied
Hide
ML Developer, Senior
Toronto or Minneapolis or Canada or North America or Europe or Africa or Asia or Australia
$129k-$231k/yr OnsiteFull Time
Dayforce
Dayforce: Provides cloud-based human capital management and payroll software solutions.
4+ YOE4+ years ML/Data Science experience, 2+ years MLOps, advanced Python, SQL, Spark/PySpark, PyTorch/TensorFlow, MLflow, experience with transformer models, data cleaning/transformation, debugging, and strong communication; English required.
SQL, Spark, PySpark, Python, PyTorch, TensorFlow, MLflow, Databricks, Azure, Azure SQL, Azure Functions, Azure Logic Apps, Azure Key Vault, Azure Storage Accounts, Azure Virtual Machines, Azure Monitor, Log Analytics
Job PostingView all
1mo
Save
Mark Applied
Hide
ML Developer, Senior
Toronto or Minneapolis or Canada or North America or Europe or Africa or Asia
$129k-$231k/yr OnsiteFull Time
Dayforce
DayforceNYSE: DAY: Cloud platform providing global human capital and payroll management.
4+ YOE4+ years ML/Data Science experience, 2+ years MLOps, advanced SQL and Spark/PySpark, Python and ML frameworks (PyTorch, TensorFlow, MLFlow), model deployment, data transformation, and strong collaboration and communication skills. English required.
SQL, Spark, PySpark, Python, PyTorch, TensorFlow, MLFlow, Databricks, Azure, Azure SQL, Function/Logic Apps, Key Vault, Storage Accounts, Virtual Machines, Azure Monitor, Log Analytics
Job PostingView all
2w
Save
Mark Applied
Hide
Data Product Manager, IC
Maple Grove, Minnesota, United States
$102k-$194k/yr HybridFull Time
Boston Scientific
Boston ScientificNYSE: BSX: Developing and manufacturing innovative medical devices for less-invasive treatments.
5+ YOEBachelor's or equivalent experience; 5+ years in data product management/architecture/engineering; experience with cloud data platforms, enterprise data modeling, data governance, Snowflake, dbt, Airflow, SQL, AWS, and BI tools; strong stakeholder and communication skills.
Snowflake, dbt, Apache Airflow, SQL, AWS, Tableau, Sigma, ThoughtSpot, Python, Pandas, NumPy, PySpark, Databricks, Redshift, Azure, Google Cloud
Job PostingView all

Explore Jobs

Expand Your Job Search