HiringCafe
Join our community

56 spark data engineer jobs at 32 companies in Minnesota

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
3w
Save
Mark Applied
Hide
Data Engineer Lead
Lake Elmo or Chicago or Evansville
$98k-$199k/yr OnsiteFull Time
Old National Bank
Old National BankNASDAQ: ONB: Regional financial services provider offering banking and wealth solutions.
7+ YOE7+ years data engineering experience, strong AWS/cloud and data warehouse background, expertise in SQL, Python, Spark/Databricks, leadership experience, BS in related field preferred.
AWS, S3, Glue, Lambda, Databricks, SQL, Python, Bash, Spark, GitOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Minnesota or United States
$188k-$230k/yr RemoteFull Time
3M
3MNYSE: MMM: Manufacturers diversified industrial, safety, consumer, and electronics products.
7+ YOEBachelor's in computer science required, 7+ years data engineering experience, expertise in AI/ML data pipelines, feature engineering, Python and SQL, distributed systems (Spark/Databricks), cloud (Azure preferred), and leadership of technical initiatives.
Python, SQL, Spark, Databricks, Microsoft Azure, Data Lake, Microsoft Data Factory, Synapse, Synapse Pipelines, Microsoft Cosmos DB, Airflow, Kafka, Event Hub
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Temporary
Boston Scientific
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Forward Data Engineer
McLean or California or Colorado or Hawaii or Illinois or Maine or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or Virginia or Washington or District of Columbia or Cleveland
$130k-$265k/yr OnsiteFull Time
Accenture Federal Services
Accenture Federal ServicesNYSE: ACN: Provides technology and consulting services to U.S. federal agencies.
4+ YOE4+ years data lifecycle and ETL engineering experience; cloud and on-prem storage; Python, SQL, Spark; experience with ElasticSearch, NiFi, Palantir Foundry; Agile/Scrum experience; active TS/SCI with poly required.
Spark, Apache Iceberg, EMR, Kubernetes, Python, SQL, ElasticSearch, NiFi, Palantir Foundry, Agile, Scrum
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer
Arden Hills or Valencia or Santa Clara
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Apache Iceberg, Python, Terraform, Bash, Spark, Flink, Alation, Atlan, DataHub, Informatica, Databricks
Job PostingView all
4w
Save
Mark Applied
Hide
Staff Data Engineer
Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Indiana or Kentucky or Louisiana or Massachusetts or Maine or Maryland or Michigan or Minnesota or Missouri or North Carolina or New Jersey or New York or Oregon or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Wisconsin
$130k-$150k/yr RemoteFull Time
MissionWired
MissionWired: Providing digital fundraising and data-driven marketing for nonprofit organizations.
5+ YOE5+ years professional software engineering experience; hands-on Apache Spark and distributed data pipelines; experience managing data warehouses or lakes; mentoring and guiding technical decisions; strong data modeling and production skills.
Apache Spark, AWS, GitHub Actions, Terraform, Docker
Job PostingView all
3w
Save
Mark Applied
Hide
Principal Data Engineer - Remote
Raleigh or Minneapolis or Washington or United States
$113k-$193k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
8+ YOE8+ years in analytics/data engineering, 6+ years Databricks (Spark, SQL, Python) experience, 5+ years cloud (Azure/GCP/AWS), 4+ years Power BI (DAX/Power Query), and experience delivering enterprise analytics and AI solutions.
Databricks, Spark, SQL, Python, Microsoft Power BI, DAX, Power Query, Azure, GCP, AWS, AI
Job PostingView all
4w
Save
Mark Applied
Hide
Data Engineer Senior
Bloomington, Minnesota, United States
$52-$78/hr OnsiteFull Time
HealthPartners
HealthPartners: Integrated healthcare provider offering medical services and health insurance.
4+ YOEBachelor’s degree in a quantitative field (or Master's acceptable) plus 4+ years relevant experience. Strong programming (SQL, Python, Java, R, Spark), expert SQL, experience with relational DBs and Azure BI/analytics stack, Git, data modeling, data pipeline development, and collaboration skills.
SQL, Python, Java, R, Spark, Oracle, PostgreSQL, MySQL, Microsoft SQL Server, Azure Data Factory, Synapse, Data Explorer, Cosmos, App Insights, Microsoft Power BI, Databricks, Git, NiFi, Kafka, Flink, Sqoop, Hive, MongoDB, Jupyter notebooks, numpy, pandas, matplotlib, Microsoft PowerApps, Power Query, DAX
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Principal Data Engineer (Valencia, CA, US, 91355)
Valencia or Santa Clara or Arden Hills
$107k-$203k/yr HybridFull Time, Contract
Boston Scientific
Boston ScientificNYSE: BSX: Developing and manufacturing innovative medical devices for less-invasive treatments.
13+ YOEBachelor's degree required; 13+ years data engineering experience with 6+ years building cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise in AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
S3, Glue, Athena, Lambda, MSK, Kinesis, DynamoDB, RDS, Redshift, EMR, Step Functions, DMS, ECS, Lake Formation, DataZone, Snowflake, Python, Terraform, Bash, Spark, Flink, Apache Iceberg, Alation, Atlan, DataHub, Informatica, Databricks, CI/CD, IAM
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Data Engineer
Minnesota or Texas or United States
RemoteFull Time
NeueHealth
NeueHealth: Operates primary care clinics and provides healthcare management technology.
5+ YOEBachelor's in CS/CE/IS or equivalent, ~5 years enterprise software engineering experience, Scala expertise, experience building batch/streaming ETL pipelines, API design, cloud data solutions (Azure), and big-data architectures.
Scala, C#, SQL, Azure, Databricks, Hive, Spark, Docker, Kubernetes
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Data Engineer - Digital Pathology (Hybrid)
Rochester, Minnesota, United States
$141k-$205k/yr HybridFull Time
Mayo Clinic
Mayo Clinic: Provides integrated medical care, clinical research, and healthcare education.
5+ YOE5+ years data engineering experience with advanced SQL, Python/JavaScript (or similar), big data tools (Spark, Kafka), machine learning knowledge, and strong communication and analytical skills.
SQL, Python, JavaScript, PHP, C++, Java, API, Apache Spark, Hive, Pig, Kafka, Linux, Windows, Apache Airflow, Google Composer, Kubernetes, Docker, Jenkins, GitHub Actions, Denodo, Tableau, Power BI, SAS, ThoughtSpot, DASH, d3, React, Snowflake, SSIS, Google BigQuery, Google Cloud Platform (GCP)
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Data Engineer
Princeton or Arizona or California or Colorado or Delaware or Florida or Georgia or Illinois or Indiana or Massachusetts or Maryland or Minnesota or North Carolina or New Jersey or New York or Pennsylvania or Tennessee or Texas or Utah or Virginia or United States or United Kingdom or North America or Asia or Australia or Europe
HybridFull Time, Contract
FDM Group
FDM GroupLondon Stock Exchange: FDM: Provides IT consulting, technical training, and staff augmentation services.
3+ YOE3+ years in data engineering, software engineering, or full stack development; strong Java or Python skills; experience building data pipelines/backend services; exposure to AI/ML; experience with AWS, Azure, or GCP.
Java, Python, AWS, Azure, GCP, React, Node.js, Spark, Databricks, APIs, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement and group purchasing organization.
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Cloud Data Engineer - Multi-Cloud Data Platforms
Irving or Chicago or Hopkins
$133k-$157k/yr HybridFull Time
U.S. Bank
U.S. BankNYSE: USB: Provider of personal, business, and institutional financial services.
6+ YOE6+ years experience building cloud-native data pipelines and products across Azure, AWS, Databricks, and Snowflake; strong Spark and SQL skills; experience with security, governance, and domain-oriented data architectures.
Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, AWS Glue, S3, Databricks, Snowflake, Apache Spark, Delta Lake, SQL, REST, SOAP, GraphQL, Kafka, MQ, AWS SQS, RabbitMQ, API Gateway, OAuth 2.0, TLS, mTLS, JWT, IAM, RBAC, Microsoft Power BI, Tableau
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Platform Engineer
Ohio or New York or New Jersey or Missouri or Minnesota or Michigan or Massachusetts or Indiana or Illinois or Georgia or Florida or Colorado or California or Arizona or Pennsylvania or Wisconsin or Texas or United States
$120k-$160k/yr RemoteFull Time
SullivanCotter
SullivanCotter: Consulting and data for healthcare and nonprofit compensation strategies.
5+ YOE5+ years experience; degree in CS/Software Engineering/Information Systems/IT or equivalent; proficiency in Python/Scala/Java/SQL, Apache Spark, Databricks, ELT/ETL, streaming, RESTful/gRPC, SDLC, testing and CI/CD tooling; strong design and mentoring skills.
Python, Scala, Java, SQL, Apache Spark, Databricks, Pytest, GitHub Actions, Poetry, Git, RESTful, gRPC
Job PostingView all
2mo
Save
Mark Applied
Hide
Artificial Intelligence/Machine Learning Data Engineer
Charlotte or Morristown or Jersey City or Cleveland or California or Colorado or District of Columbia or Illinois or Maryland or Massachusetts or Minnesota or New York or New Jersey or Washington
$44-$54/hr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOEMinimum 5 years in data/ML/AI or software engineering; strong Python and SQL; experience with LLMs, agent frameworks (LangChain, Semantic Kernel, LlamaIndex, AutoGen), ML deployment and data pipelines; Associate's degree required.
MLflow, Azure ML, SageMaker, Kubeflow, TensorFlow, PyTorch, Scikit-Learn, Spark, Databricks, FAISS, Pinecone, Chroma, Milvus, Redis, CI/CD, Docker, Kubernetes, Azure, AWS, GCP, Kafka, EventHub, Kinesis, LangChain, Semantic Kernel, LlamaIndex, AutoGen, Python, SQL, Scala, Java, Go
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Software Engineer (Data)
Alabama or Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Louisiana or Maine or Maryland or Massachusetts or Michigan or Minnesota or Missouri or Nevada or North Carolina or New Jersey or New York or Ohio or Oklahoma or Oregon or Pennsylvania or Rhode Island or South Carolina or Texas or Tennessee or Utah or Virginia or Washington or Wisconsin
$153k-$171k/yr RemoteFull Time
Nava
Nava: Consultancy providing digital modernization services to government agencies.
7+ YOE3+ Mgmt7+ years engineering experience, 3+ years leading teams, experience building large-scale data services on AWS, proficiency with Apache Spark, AWS data services, Python or Ruby, strong communication and systems thinking.
Apache Spark, AWS Glue, AWS Athena, Databricks, AWS Redshift, AWS S3, AWS RDS, Python, Ruby, Power BI
Job PostingView all
3w
Save
Mark Applied
Hide
Databricks Platform & Data Engineer (Plano, TX, US)
Plano or Minneapolis or Chicago or Atlanta
$135k-$247k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
12+ YOE12+ years experience with 5+ years on Databricks; deep expertise in Apache Spark, Delta Lake, Databricks platform setup, cloud (AWS/Azure/GCP), data governance, and client-facing delivery.
Databricks, Apache Spark, Scala, Python, Delta Lake, Unity Catalog, Dataflow, Genie, Kafka, Structured Streaming, MLOps, AWS, Azure, GCP, PowerPoint
Job PostingView all

Explore Jobs

Expand Your Job Search