44 spark data engineer jobs at 21 companies in New Brighton, MN

2d
Save
Mark Applied
Hide
Senior Data Engineer (Analytics)
Eden Prairie or United States
$92k-$164k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
5+ YOERequires 5+ years in data or software engineering; 3+ years with Python, SQL, Spark/PySpark, and Databricks; Azure data services, Kafka, production support, data modeling, CI/CD, and automation experience.
Python, Spark, Scala, Kafka, Azure Data Factory, Databricks, Blob Storage, AzCopy, PySpark, SQL, Azure Data Lake, Apache Kafka, CI/CD, Airflow, Docker, Kubernetes, Terraform, Power BI, Tableau, Looker, PostgreSQL, Cosmos DB, MongoDB, Snowflake
2mo
Save
Mark Applied
Hide
Data Engineer
Minneapolis, Minnesota, United States
$87k-$131k/yr HybridFull Time
Coloplast
ColoplastNasdaq Copenhagen: COLO B: Manufacturer of medical devices for intimate healthcare conditions
4+ YOEBachelor's in CS/IT/Engineering required; 4+ years data engineering experience; strong T-SQL and Python skills; experience with Microsoft Fabric, Azure, ETL/ELT pipelines, Synapse Spark, data warehousing/lakehouse, Power BI, and building production data platforms.
Microsoft Fabric, Synapse Spark, OneLake, Microsoft Azure, Microsoft Azure Data Factory, Microsoft Power BI, Fabric Semantic Models, Salesforce APIs, T-SQL, Python
1w
Save
Mark Applied
Hide
Data Engineer Principal_3003
Minneapolis, Minnesota, United States
$110k-$150k/yr HybridFull Time
Allianz
AllianzXetra: ALV: Provides global insurance products and financial asset management services
7+ YOE7+ years of hands-on data engineering experience, including enterprise platform migration or re-engineering. Requires Azure, Databricks, Spark, Python, SQL, data governance, and stakeholder communication expertise.
Azure Synapse Analytics, Spark Pool, Dedicated SQL Pool, Azure Data Lake Storage Gen2, Delta Lake, Oracle GoldenGate Replication, Azure Analysis Services, Power BI, YAML, PySpark, SQL, Azure Databricks, Delta Live Tables, Unity Catalog, Apache Spark, Spark SQL, Python, Oracle DB, SQL Server, Azure SQL DB, Salesforce, APIs, Azure DevOps, GitHub Actions, Terraform, ARM, Docker, Event Hub, Kafka, Kinesis, MLOps, Dynatrace, Tableau
2mo
Save
Mark Applied
Hide
Data Engineer Senior
Bloomington, Minnesota, United States
$52-$78/hr OnsiteFull Time
HealthPartners
HealthPartners: Integrated healthcare provider offering medical services and health insurance.
4+ YOEBachelor’s degree in a quantitative field (or Master's acceptable) plus 4+ years relevant experience. Strong programming (SQL, Python, Java, R, Spark), expert SQL, experience with relational DBs and Azure BI/analytics stack, Git, data modeling, data pipeline development, and collaboration skills.
SQL, Python, Java, R, Spark, Oracle, PostgreSQL, MySQL, Microsoft SQL Server, Azure Data Factory, Synapse, Data Explorer, Cosmos, App Insights, Microsoft Power BI, Databricks, Git, NiFi, Kafka, Flink, Sqoop, Hive, MongoDB, Jupyter notebooks, numpy, pandas, matplotlib, Microsoft PowerApps, Power Query, DAX
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
5d
Save
Mark Applied
Hide
Sr. Data Engineer
Wayzata or Minneapolis
$90k-$155k/yr OnsiteFull Time
Cargill
Cargill: Produces and distributes food, agricultural, and industrial products globally.
4+ YOEMinimum 4 years of relevant experience; typically 5+. Requires advanced Python, Java, Scala, and SQL skills plus data engineering, cloud, streaming, migration, DevOps, governance, and modern data architecture experience.
AWS, GCP, Azure, Kafka, AWS Glue, Iceberg, Parquet, Confluent Kafka, Apache Flink, Spark, Spark UI, Python, Java, Scala, SQL, dbt, Airflow, Astronomer, Snowflake, Cloudera, Hadoop, Impala, Git, Vela CI/CD, Atlan, SAP, AWS Athena, Minerva Engineering Framework (MEF)
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: General merchandise retailer operating physical stores and e-commerce.
7+ YOE7+ years data engineering experience; BS/MS preferred; expertise with Hadoop/Spark, PySpark/Scala/Java, cloud platforms (AWS/GCP/Azure), APIs, streaming (Kafka/Flink/Kinesis), and data modeling.
Hadoop, Spark, Scala, Java, PySpark, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement and group purchasing organization.
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
1mo
Save
Mark Applied
Hide
Databricks Platform & Data Engineer (Plano, TX, US)
Plano or Minneapolis or Chicago or Atlanta
$135k-$247k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
12+ YOE12+ years experience with 5+ years on Databricks; deep expertise in Apache Spark, Delta Lake, Databricks platform setup, cloud (AWS/Azure/GCP), data governance, and client-facing delivery.
Databricks, Apache Spark, Scala, Python, Delta Lake, Unity Catalog, Dataflow, Genie, Kafka, Structured Streaming, MLOps, AWS, Azure, GCP, PowerPoint
3d
Save
Mark Applied
Hide
Lead Data Architect
Golden Valley, Minnesota, United States
$110k-$194k/yr OnsiteFull Time
Choice Bank
Choice Bank: Provides regional banking, insurance, and agricultural financial services.
10+ YOE5+ MgmtBachelor's degree and 10+ years in data engineering, architecture, or platform engineering, including 5+ years with enterprise cloud data platforms; expertise in Azure, Databricks, Spark, Python, SQL, and governance.
Azure Data Services, Databricks, Apache Spark, Python, SQL, Snowflake, Microsoft Power BI, Microsoft Fabric
1mo
Save
Mark Applied
Hide
Data Architect
Minneapolis, Minnesota, United States
$165k-$190k/yr OnsiteFull Time
Niron Magnetics
Niron Magnetics: Manufactures high-performance, rare-earth-free permanent magnets.
10+ YOE10+ years in data engineering or enterprise data architecture; deep experience with Microsoft Fabric/Azure, SQL and Python; Databricks and D365 F&O experience preferred; strong data governance and system integration skills.
Microsoft Fabric, Azure, Databricks, SQL, Python, R, Spark, D365 Finance & Operations, REST, GraphQL
1mo
Save
Mark Applied
Hide
Senior Manager - Data Engineering
Maplewood, Minnesota, United States
$188k-$230k/yr OnsiteFull Time
3M
3MNYSE: MMM: Manufacturers diversified industrial, safety, consumer, and electronics products.
10+ YOE5+ MgmtRequires bachelor's in CS/Engineering/Information Systems or related, 10+ years in data/software/platform engineering, 5+ years leading engineering teams, experience with cloud data solutions and tools like Snowflake, AWS, dbt, Python, SQL.
Snowflake, Apache Iceberg, AWS, Databricks, dbt, Python, Spark, SQL, Kafka, APIs
1w
Save
Mark Applied
Hide
Staff Engineer (e-ST)
Minneapolis, Minnesota, United States
$173k/yr HybridFull Time
Thrivent
Thrivent: Member-owned fraternal benefit society offering financial and insurance services.
6+ YOEBachelor's degree in MIS, computer science, or related field plus 6 years of data engineering experience; expertise in Big Data, pipelines, Spark, Hadoop, and cloud technologies required.
Hadoop, Apache Spark, Kafka, Python, Java, Scala, Snowflake, Databricks, StreamSets, Bamboo, Informatica, IICS, DB2, AWS, Microsoft Azure, Google Cloud, OpenStack, Docker, Ansible, Chef, Lambdas, Microservices, Terraform
2w
Save
Mark Applied
Hide
Sr IT Business Intelligence Engineer
St. Louis Park, Minnesota, United States
$105k-$120k/yr RemoteFull Time
RAYUS Radiology
RAYUS Radiology: Operates a national network of diagnostic and interventional radiology centers.
7+ YOEBachelor's degree in computer science, information technology, or related field; 7 years in data warehouse, reporting, SQL, ETL, and integration; Azure, Power BI, Microsoft Fabric, Agile, and technical training required.
Microsoft SQL Server Integration Services (SSIS), Microsoft SQL Server Analysis Services (SSAS), Microsoft SQL Server Reporting Services (SSRS), Microsoft Fabric, Microsoft Azure, Power BI, Python, SQL, Spark, Data Factory, Lakehouse, Warehouse, Notebooks
1mo
Save
Mark Applied
Hide
Technology Consultant 2
Minneapolis, Minnesota, United States
$69k-$112k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Databricks, Azure Data Factory (ADF), Python (PySpark/Spark), Azure, Airflow, Kubernetes, Snowflake; AI/ML model deployment experience; bachelor’s degree or equivalent experience; authorized to work in the U.S. (no employer sponsorship).
Databricks, Databricks Machine Learning, Azure Data Factory (ADF), Python, PySpark, Spark, Azure, Airflow, Kubernetes, Snowflake, GitHub, CI/CD
4d
Save
Mark Applied
Hide
Data engineering program manager
Mounds View, Minnesota, United States
$150k-$180k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOEBachelor's degree in computer science, 6+ years of experience, and expertise with Snowflake, Databricks, cloud platforms, Python, SQL, DBT, Airflow, data governance, and AI-enabled data programs.
Snowflake, Snowpark, Databricks, Delta Lake, Unity Catalog, Spark, PySpark, AWS, Azure, GCP, Python, SQL, DBT, Airflow, ETL, ELT, API, PMP, PgMP, SAFe Program Consultant, SAFe Agilist, Snowflake certification, Databricks certification, AWS Solution Architect certification, Azure Solution Architect certification, HIPAA, GxP, FDA
1w
Save
Mark Applied
Hide
Senior Engineer (e-MG)
Minneapolis, Minnesota, United States
$140k/yr HybridFull Time
Thrivent
Thrivent: Provides financial advice, insurance, and investments to member-owners.
5+ YOEBachelor’s degree in computer science or related field plus 5 years of progressive experience. Requires 5 years with big data, databases, pipelines, IICS, Informatica PowerCenter, and Zena; 3 years with Python and Scala.
Hadoop, Spark, Spark Streaming, Kafka, Hive, Oracle, SQL Server, DB2, Snowflake, Databricks, IICS, Informatica PowerCenter, Zena, Python, Scala, CI/CD, STAR schema
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Golden Valley, Minnesota, United States
$120k-$123k/yr HybridFull Time
Tennant Company
Tennant CompanyNYSE: TNC: Designs and manufactures industrial and commercial floor cleaning equipment.
1+ YOEMaster's or equivalent in CS/Data Science/Robotics/Statistics, 1+ year related software development experience, experience with cloud (Azure/AWS), big data, deep learning, NLP, ML algorithms, and BI tools.
Azure AI Foundry, Azure HDInsight, Azure Datafactory, Azure ML, AWS SageMaker, Apache Hadoop, Spark, Kafka, HBase, Hive, Storm, Databricks, Microsoft Power BI, Tableau