HiringCafe
Join our community

38 spark data engineer jobs at 20 companies in Eagan, MN

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
2w
Save
Mark Applied
Hide
Data Engineer Lead
Lake Elmo or Chicago or Evansville
$98k-$199k/yr OnsiteFull Time
Old National Bank
Old National BankNASDAQ: ONB: Regional financial services provider offering banking and wealth solutions.
7+ YOE7+ years data engineering experience, strong AWS/cloud and data warehouse background, expertise in SQL, Python, Spark/Databricks, leadership experience, BS in related field preferred.
AWS, S3, Glue, Lambda, Databricks, SQL, Python, Bash, Spark, GitOps
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Arden Hills or Valencia or Santa Clara
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Apache Iceberg, Python, Terraform, Bash, Spark, Flink, Alation, Atlan, DataHub, Informatica, Databricks
Job PostingView all
3w
Save
Mark Applied
Hide
Principal Data Engineer - Remote
Raleigh or Minneapolis or Washington or United States
$113k-$193k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
8+ YOE8+ years in analytics/data engineering, 6+ years Databricks (Spark, SQL, Python) experience, 5+ years cloud (Azure/GCP/AWS), 4+ years Power BI (DAX/Power Query), and experience delivering enterprise analytics and AI solutions.
Databricks, Spark, SQL, Python, Microsoft Power BI, DAX, Power Query, Azure, GCP, AWS, AI
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer Senior
Bloomington, Minnesota, United States
$52-$78/hr OnsiteFull Time
HealthPartners
HealthPartners: Integrated healthcare provider offering medical services and health insurance.
4+ YOEBachelor’s degree in a quantitative field (or Master's acceptable) plus 4+ years relevant experience. Strong programming (SQL, Python, Java, R, Spark), expert SQL, experience with relational DBs and Azure BI/analytics stack, Git, data modeling, data pipeline development, and collaboration skills.
SQL, Python, Java, R, Spark, Oracle, PostgreSQL, MySQL, Microsoft SQL Server, Azure Data Factory, Synapse, Data Explorer, Cosmos, App Insights, Microsoft Power BI, Databricks, Git, NiFi, Kafka, Flink, Sqoop, Hive, MongoDB, Jupyter notebooks, numpy, pandas, matplotlib, Microsoft PowerApps, Power Query, DAX
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
St. Paul, Minnesota, United States
$102k-$131k/yr HybridFull Time
Accelint
Accelint: Provides AI-driven autonomous systems for national security missions.
2+ YOEBachelor’s in CS/Engineering or related field; 2-5 years with Airflow and Spark; containerization (Kubernetes/Docker/Helm); DoD/domain experience preferred.
Apache Airflow, Apache Spark, Kubernetes, Docker, Helm, ETL, Data Warehousing, AWS S3, PostgreSQL, TypeScript, Express, FastAPI
Job PostingView all
2d
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer (Valencia, CA, US, 91355)
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developing and manufacturing innovative medical devices for less-invasive treatments.
13+ YOEBachelor's degree required; 13+ years data engineering experience with 6+ years building cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise in AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD, IAM
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement and group purchasing organization.
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Cloud Data Engineer - Multi-Cloud Data Platforms
Irving or Chicago or Hopkins
$133k-$157k/yr HybridFull Time
U.S. Bank
U.S. BankNYSE: USB: Provider of personal, business, and institutional financial services.
6+ YOE6+ years experience building cloud-native data pipelines and products across Azure, AWS, Databricks, and Snowflake; strong Spark and SQL skills; experience with security, governance, and domain-oriented data architectures.
Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, AWS Glue, S3, Databricks, Snowflake, Apache Spark, Delta Lake, SQL, REST, SOAP, GraphQL, Kafka, MQ, AWS SQS, RabbitMQ, API Gateway, OAuth 2.0, TLS, mTLS, JWT, IAM, RBAC, Microsoft Power BI, Tableau
Job PostingView all
2w
Save
Mark Applied
Hide
Databricks Platform & Data Engineer (Plano, TX, US)
Plano or Minneapolis or Chicago or Atlanta
$135k-$247k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
12+ YOE12+ years experience with 5+ years on Databricks; deep expertise in Apache Spark, Delta Lake, Databricks platform setup, cloud (AWS/Azure/GCP), data governance, and client-facing delivery.
Databricks, Apache Spark, Scala, Python, Delta Lake, Unity Catalog, Dataflow, Genie, Kafka, Structured Streaming, MLOps, AWS, Azure, GCP, PowerPoint
Job PostingView all
2d
Save
Mark Applied
Hide
Data Architect
Minneapolis, Minnesota, United States
$165k-$190k/yr OnsiteFull Time
Niron Magnetics
Niron Magnetics: Manufactures high-performance, rare-earth-free permanent magnets.
10+ YOE10+ years in data engineering or enterprise data architecture; deep experience with Microsoft Fabric/Azure, SQL and Python; Databricks and D365 F&O experience preferred; strong data governance and system integration skills.
Microsoft Fabric, Azure, Databricks, SQL, Python, R, Spark, D365 Finance & Operations, REST, GraphQL
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Manager - Data Engineering
Maplewood, Minnesota, United States
$188k-$230k/yr OnsiteFull Time
3M
3MNYSE: MMM: Manufacturers diversified industrial, safety, consumer, and electronics products.
10+ YOE5+ MgmtRequires bachelor's in CS/Engineering/Information Systems or related, 10+ years in data/software/platform engineering, 5+ years leading engineering teams, experience with cloud data solutions and tools like Snowflake, AWS, dbt, Python, SQL.
Snowflake, Apache Iceberg, AWS, Databricks, dbt, Python, Spark, SQL, Kafka, APIs
Job PostingView all
1mo
Save
Mark Applied
Hide
Technical Lead Engineer
Davidson or Tyler or Minneapolis or Columbia or La Crosse
$124k-$173k/yr HybridFull Time
Trane Technologies
Trane TechnologiesNYSE: TT: Global provider of heating, ventilation, and air conditioning solutions.
5+ YOE2+ Mgmt5+ years data analytics experience; leadership; strong SQL/ETL/ELT, Python/R, Spark; cloud platforms; stakeholder management.
SQL, T-SQL, PLSQL, R, Python, Apache Spark, ETL, ELT, Apache Airflow, data warehousing, data lineage, GCP, AWS, Informatica, Oracle
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineering Associate Director (Microsoft Fabric & Databricks)
Minneapolis, Minnesota, United States
$152k-$259k/yr HybridFull Time
Protiviti
ProtivitiNYSE: RHI: Global consulting firm providing risk management and internal audit services.
9+ YOE9+ years experience in professional services or industry; bachelor’s degree in a relevant discipline; leadership, client relationship, and project management skills; expertise with Microsoft Fabric, Azure Databricks, SQL, data engineering, and related Microsoft data technologies.
Microsoft Fabric, Azure Databricks, PySpark, SparkSQL, Power BI, Azure Storage, Git, Microsoft Purview, SQL, Python, Spark, C#, Java, Scala, R, DAX, MDX, M, Microsoft Office, Microsoft Word, Microsoft Excel, Microsoft PowerPoint, Microsoft Visio, Microsoft Access, Azure AI tooling, DevOps, DataOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Architect, Data Engineering
Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$199k-$245k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
10+ YOE10+ years in data/engineering; expert in Databricks/Snowflake; AI/ML incl. LLMs; cloud (AWS/Azure/GCP); data pipelines; SQL; consulting exp; 30-50% travel.
Databricks, Snowflake, Fabric, Spark, Scala, Storm, Flume, Sqoop, Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, LLMs, prompt engineering, embeddings, vector databases, Retrieval-Augmented Generation, Microsoft SQL Server, ETL, Azure SQL, Azure Data Lake, Azure Data Factory, AWS, GCP, PowerBI, Tableau
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Platform Engineer (AI & Analytics) - Hybrid (Minneapolis, MN, US, 55416)
Minneapolis, Minnesota, United States
$110k-$151k/yr HybridFull Time
Allianz
AllianzXetra: ALV: Provides global insurance products and financial asset management services
6+ YOE6+ years in data engineering/DevOps/cloud; experience with Azure, Databricks, Terraform, Kubernetes, PySpark and GitHub Actions; infrastructure-as-code and CI/CD experience; U.S. work authorization required.
Azure, Databricks, Databricks DAB, Terraform, Kubernetes, GitHub Actions, PySpark, Spark, Unity Catalog, Delta tables, CLI
Job PostingView all
1mo
Save
Mark Applied
Hide
ML Developer, Senior
Toronto or Minneapolis or Canada or North America or Europe or Africa or Asia or Australia
$129k-$231k/yr OnsiteFull Time
Dayforce
Dayforce: Provides cloud-based human capital management and payroll software solutions.
4+ YOE4+ years ML/Data Science experience, 2+ years MLOps, advanced Python, SQL, Spark/PySpark, PyTorch/TensorFlow, MLflow, experience with transformer models, data cleaning/transformation, debugging, and strong communication; English required.
SQL, Spark, PySpark, Python, PyTorch, TensorFlow, MLflow, Databricks, Azure, Azure SQL, Azure Functions, Azure Logic Apps, Azure Key Vault, Azure Storage Accounts, Azure Virtual Machines, Azure Monitor, Log Analytics
Job PostingView all
1mo
Save
Mark Applied
Hide
ML Developer, Senior
Toronto or Minneapolis or Canada or North America or Europe or Africa or Asia
$129k-$231k/yr OnsiteFull Time
Dayforce
DayforceNYSE: DAY: Cloud platform providing global human capital and payroll management.
4+ YOE4+ years ML/Data Science experience, 2+ years MLOps, advanced SQL and Spark/PySpark, Python and ML frameworks (PyTorch, TensorFlow, MLFlow), model deployment, data transformation, and strong collaboration and communication skills. English required.
SQL, Spark, PySpark, Python, PyTorch, TensorFlow, MLFlow, Databricks, Azure, Azure SQL, Function/Logic Apps, Key Vault, Storage Accounts, Virtual Machines, Azure Monitor, Log Analytics
Job PostingView all

Explore Jobs

Expand Your Job Search