39 spark data engineer jobs at 17 companies in Saint Michael, MN
2mo
Save
Mark Applied
Hide
2mo
Senior Data Engineer
Eden Prairie, Minnesota, United States
$92k-$164k/yrHybridFull Time
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
5+ YOE5+ years in data/software engineering, 3+ years building pipelines with Python, Spark, Scala, and SQL; 2+ years with streaming (Kafka); 1+ year with Apache Airflow; experience with data warehousing and dimensional modeling.
Boston ScientificNYSE: BSX: Manufacturer of interventional medical devices and technologies.
13+ YOEBachelor's in CS or related, 13+ years data engineering with 6+ years building AWS cloud-native data platforms; expertise with AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
Boston ScientificNYSE: BSX: Developer and manufacturer of innovative medical devices and therapies.
13+ YOEBachelor's degree required; 13+ years data engineering experience including 6+ years designing cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise with AWS data services, Snowflake, Python, Terraform, Bash, Spark/Flink, and governance automation.
HealthPartners: Integrated healthcare provider offering medical services and health insurance.
4+ YOEBachelor’s degree in a quantitative field (or Master's acceptable) plus 4+ years relevant experience. Strong programming (SQL, Python, Java, R, Spark), expert SQL, experience with relational DBs and Azure BI/analytics stack, Git, data modeling, data pipeline development, and collaboration skills.
SQL, Python, Java, R, Spark, Oracle, PostgreSQL, MySQL, Microsoft SQL Server, Azure Data Factory, Synapse, Data Explorer, Cosmos, App Insights, Microsoft Power BI, Databricks, Git, NiFi, Kafka, Flink, Sqoop, Hive, MongoDB, Jupyter notebooks, numpy, pandas, matplotlib, Microsoft PowerApps, Power Query, DAX
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yrHybridFull Time
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yrHybridFull Time
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Cargill: Produces and distributes food, agricultural, and industrial products globally.
4+ YOEMinimum 4 years relevant experience; expertise in building data architectures, streaming and batch pipelines, Spark, SQL, Python/Java/Scala, cloud platforms (AWS/GCP/Azure), and data governance.
AWS Principal Data Engineer (Valencia, CA, US, 91355)
Valencia or Santa Clara or Arden Hills
$107k-$203k/yrHybridFull Time, Contract
Boston ScientificNYSE: BSX: Developing and manufacturing innovative medical devices for less-invasive treatments.
13+ YOEBachelor's degree required; 13+ years data engineering experience with 6+ years building cloud-native AWS data platforms and 4+ years building scalable data platform solutions. Expertise in AWS data services, Snowflake, Python, Terraform, Spark/Flink, and governance automation.
Old National Bank: Provides personal and business banking and wealth management services.
7+ YOEBachelor's or equivalent with 7+ years data engineering experience, 5+ years AWS, expertise with data warehouses, SQL, Python, Bash, Spark, Databricks, and experience leading teams.
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yrHybridFull Time
TargetNYSE: TGT: General merchandise retailer operating physical stores and e-commerce.
7+ YOE7+ years data engineering experience; BS/MS preferred; expertise with Hadoop/Spark, PySpark/Scala/Java, cloud platforms (AWS/GCP/Azure), APIs, streaming (Kafka/Flink/Kinesis), and data modeling.
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Vizient: Healthcare performance improvement and group purchasing organization.
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
Lead Cloud Data Engineer - Multi-Cloud Data Platforms
Irving or Chicago or Hopkins
$133k-$157k/yrHybridFull Time
U.S. BankNYSE: USB: Provider of personal, business, and institutional financial services.
6+ YOE6+ years experience building cloud-native data pipelines and products across Azure, AWS, Databricks, and Snowflake; strong Spark and SQL skills; experience with security, governance, and domain-oriented data architectures.
Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, AWS Glue, S3, Databricks, Snowflake, Apache Spark, Delta Lake, SQL, REST, SOAP, GraphQL, Kafka, MQ, AWS SQS, RabbitMQ, API Gateway, OAuth 2.0, TLS, mTLS, JWT, IAM, RBAC, Microsoft Power BI, Tableau
Databricks Platform & Data Engineer (Plano, TX, US)
Plano or Minneapolis or Chicago or Atlanta
$135k-$247k/yrOnsiteFull Time
NTT DATA: Global provider of IT and business consulting services.
12+ YOE12+ years experience with 5+ years on Databricks; deep expertise in Apache Spark, Delta Lake, Databricks platform setup, cloud (AWS/Azure/GCP), data governance, and client-facing delivery.
10+ YOE10+ years in data engineering or enterprise data architecture; deep experience with Microsoft Fabric/Azure, SQL and Python; Databricks and D365 F&O experience preferred; strong data governance and system integration skills.
3MNYSE: MMM: Manufacturers diversified industrial, safety, consumer, and electronics products.
10+ YOE5+ MgmtRequires bachelor's in CS/Engineering/Information Systems or related, 10+ years in data/software/platform engineering, 5+ years leading engineering teams, experience with cloud data solutions and tools like Snowflake, AWS, dbt, Python, SQL.
Toronto or Minneapolis or Canada or North America or Europe or Africa or Asia or Australia
$129k-$231k/yrOnsiteFull Time
Dayforce: Provides cloud-based human capital management and payroll software solutions.
4+ YOE4+ years ML/Data Science experience, 2+ years MLOps, advanced Python, SQL, Spark/PySpark, PyTorch/TensorFlow, MLflow, experience with transformer models, data cleaning/transformation, debugging, and strong communication; English required.
Toronto or Minneapolis or Canada or North America or Europe or Africa or Asia
$129k-$231k/yrOnsiteFull Time
DayforceNYSE: DAY: Cloud platform providing global human capital and payroll management.
4+ YOE4+ years ML/Data Science experience, 2+ years MLOps, advanced SQL and Spark/PySpark, Python and ML frameworks (PyTorch, TensorFlow, MLFlow), model deployment, data transformation, and strong collaboration and communication skills. English required.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOE3+ years Microsoft Fabric experience, strong skills in Azure Data Factory, Power BI, Python/PySpark, Spark/SQL, Git and CI/CD; strong communication and data warehousing knowledge.
Microsoft Fabric, OneLake, Lakehouse, Warehouse, Notebook, Azure Data Factory, Power BI, SQL, Spark, Spark SQL, Python, PySpark, Data Activator, Git, CICD, AWS, Snowflake
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Databricks, Azure Data Factory (ADF), Python (PySpark/Spark), Azure, Airflow, Kubernetes, Snowflake; AI/ML model deployment experience; bachelor’s degree or equivalent experience; authorized to work in the U.S. (no employer sponsorship).