HiringCafe
Join our community

71 spark engineer jobs at 35 companies in Minnesota

2mo
Save
Mark Applied
Hide
Staff Engineer
Edina, Minnesota, United States
$118k-$206k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement.
7+ YOE7+ years experience in data/platform engineering; expertise with PySpark/Spark/Python/SQL, data modeling, ontology/semantic architecture, CI/CD, governance, and Palantir Foundry preferred; strong communication and mentorship skills.
Palantir Foundry, AIP, PySpark, Spark, Python, SQL, CI/CD, FHIR, HL7, Epic, Oracle Health, EHR, ERP
Job PostingView all
2mo
Save
Mark Applied
Hide
ELECTRICAL DESIGNER/ENGINEER - FROM FIRST SPARK TO SEASONED PRO
Minneapolis or Overland Park
$60k-$150k/yr HybridFull Time
Nelson-Rudie & Associates
Nelson-Rudie & Associates: Employee-owned consulting engineering firm serving architects, owners, developers, and contractors with structural, MEP, and refrigeration design.
Associate/technical degree or equivalent experience; proficiency in Revit, AutoCAD, Bluebeam; knowledge of NEC/NFPA codes; EIT/PE licensure a plus; U.S. citizenship or valid Green Card required.
Revit, AutoCAD, Bluebeam, BIM
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Engineer
Edina, Minnesota, United States
$118k-$206k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement.
7+ YOE7+ years experience in data/platform engineering; strong expertise with data architecture, semantic/ontology design, PySpark/Spark, Python, SQL, distributed data platforms, CI/CD, and AI-assisted development; Palantir Foundry experience preferred.
Palantir Foundry, AIP, PySpark, Spark, Python, SQL, EHR, ERP, FHIR, HL7, Epic, Oracle Health, CI/CD
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Engineer (e-ST)
Minneapolis, Minnesota, United States
$173k/yr HybridFull Time
Thrivent
Thrivent: Financial services providing advice, insurance, investments, and banking.
6+ YOEBachelor's degree in MIS, computer science, or related field plus 6 years of data engineering experience; expertise in Big Data, pipelines, Spark, Hadoop, and cloud technologies required.
Hadoop, Apache Spark, Kafka, Python, Java, Scala, Snowflake, Databricks, StreamSets, Bamboo, Informatica, IICS, DB2, AWS, Microsoft Azure, Google Cloud, OpenStack, Docker, Ansible, Chef, Lambdas, Microservices, Terraform
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Platform Engineer
Ohio or New York or New Jersey or Missouri or Minnesota or Michigan or Massachusetts or Indiana or Illinois or Georgia or Florida or Colorado or California or Arizona or Pennsylvania or Wisconsin or Texas or United States
$120k-$160k/yr RemoteFull Time
Clinician Nexus
Clinician Nexus: Healthcare workforce software helping health systems manage clinical compensation, productivity, education, and student rotations.
5+ YOE5+ years experience; degree in CS/Software Engineering/Information Systems/IT or equivalent; proficiency in Python/Scala/Java/SQL, Apache Spark, Databricks, ELT/ETL, streaming, RESTful/gRPC, SDLC, testing and CI/CD tooling; strong design and mentoring skills.
Python, Scala, Java, SQL, Apache Spark, Databricks, Pytest, GitHub Actions, Poetry, Git, RESTful, gRPC
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Enterprise Data & Analytics - Remote
Rochester, Minnesota, United States
$148k-$215k/yr RemoteFull Time
Mayo Clinic (Rochester)
Mayo Clinic (Rochester): Nonprofit academic medical center providing integrated patient care, medical education, and biomedical research.
5+ YOEBachelor's (6+ years) or Associate's (8+ years) in CS/Engineering with 5+ years data engineering experience, strong Python and SQL, cloud (GCP/Azure/AWS), CI/CD, Spark/Hive/Airflow/Kafka, BigQuery, FHIR APIs, Vertex AI, Kubernetes/Docker.
Python, SQL, GCP, Azure, AWS, Jenkins, GitHub Actions, Azure Pipelines, Jira, GitHub, SharePoint, Azure Boards, Apache Spark, Hive, Airflow, Kafka, GCP Dataflow, Google BigQuery, FHIR APIs, Vertex AI, Apache Iceberg, Delta Lake, Apache Hudi, Parquet, Avro, ORC, Kubernetes, Docker
Job PostingView all
2w
Save
Mark Applied
Hide
AI Engineer III
Arkansas or Colorado or Georgia or Illinois or Iowa or Kansas or Louisiana or Minnesota or Missouri or Montana or Nebraska or New Mexico or North Dakota or Oklahoma or South Dakota or Texas or Wisconsin or Wyoming or Tulsa
$114k-$172k/yr RemoteFull Time
ONEOK
ONEOKNYSE: OKE: Publicly traded U.S. midstream transports natural gas, NGLs, refined products and crude oil for energy markets.
5+ YOEBachelor's degree and 5+ years of software engineering experience shipping production AI/ML systems. Requires Python, LLM systems, cloud platforms, APIs, production operations, and strong communication skills.
Python, R, SQL, Spark, Databricks, Snowflake, Large Language Models (LLMs), Anthropic, AWS Bedrock, OpenAI, AWS, Azure, Terraform, Software Development Lifecycle (SDLC), Continuous Integration/Continuous Deployment (CI/CD), ADO, GitHub, GitLab
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Minnesota or United States
$188k-$230k/yr RemoteFull Time
3M
3MNYSE: MMM: Global diversified science and technology manufacturing.
7+ YOEBachelor's in computer science required, 7+ years data engineering experience, expertise in AI/ML data pipelines, feature engineering, Python and SQL, distributed systems (Spark/Databricks), cloud (Azure preferred), and leadership of technical initiatives.
Python, SQL, Spark, Databricks, Microsoft Azure, Data Lake, Microsoft Data Factory, Synapse, Synapse Pipelines, Microsoft Cosmos DB, Airflow, Kafka, Event Hub
Job PostingView all
2mo
Save
Mark Applied
Hide
Forward Data Engineer
McLean or California or Colorado or Hawaii or Illinois or Maine or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or Virginia or Washington or District of Columbia or Cleveland
$130k-$265k/yr OnsiteFull Time
Accenture Federal Services
Accenture Federal ServicesNew York Stock Exchange: ACN: Technology and management consulting for U.S. federal agencies.
4+ YOE4+ years data lifecycle and ETL engineering experience; cloud and on-prem storage; Python, SQL, Spark; experience with ElasticSearch, NiFi, Palantir Foundry; Agile/Scrum experience; active TS/SCI with poly required.
Spark, Apache Iceberg, EMR, Kubernetes, Python, SQL, ElasticSearch, NiFi, Palantir Foundry, Agile, Scrum
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Engineer
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California
$188k-$277k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building personalized customer experiences.
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go and AWS; experience with LLM-driven development, APIs, high-throughput data, Kubernetes/Terraform, and cross-team technical leadership.
Java, Go, AWS, Lambda, EKS, DynamoDB, Kafka, LLMs, GitHub Copilot, Anthropic Claude, SQL, NoSQL, Redis, Spark, Kubernetes, Terraform
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Engineer, Data and AI
United States or Canada or Mexico or Alaska or Arizona or California or Colorado or Connecticut or District of Columbia or Florida or Georgia or Illinois or Iowa or Kansas or Maryland or Massachusetts or Michigan or Minnesota or Missouri or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Rhode Island or Texas or Vermont or Virginia or Washington or Wisconsin or Alberta or British Columbia or Ontario
RemoteFull Time
Change.org
Change.org: Nonprofit-owned public-benefit technology platform helping people and organizations create petitions, mobilize supporters, and engage decision-makers.
7+ YOE7+ years of software engineering experience; expertise in distributed data systems, Python, SQL, cloud-native infrastructure, AI platforms, production operations, observability, and technical leadership.
Python, SQL, Airflow, Kafka, Redshift, Glue, Vector DBs, Spark, AWS, GCP
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer (Analytics)
Eden Prairie or United States
$92k-$164k/yr RemoteFull Time
UnitedHealthcare
UnitedHealthcare: For-profit U.S. health insurer offering employer, individual, Medicare and Medicaid health benefit plans.
5+ YOERequires 5+ years in data or software engineering; 3+ years with Python, SQL, Spark/PySpark, and Databricks; Azure data services, Kafka, production support, data modeling, CI/CD, and automation experience.
Python, Spark, Scala, Kafka, Azure Data Factory, Databricks, Blob Storage, AzCopy, PySpark, SQL, Azure Data Lake, Apache Kafka, CI/CD, Airflow, Docker, Kubernetes, Terraform, Power BI, Tableau, Looker, PostgreSQL, Cosmos DB, MongoDB, Snowflake
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: An American general merchandise retailer.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer Principal_3003
Minneapolis, Minnesota, United States
$110k-$150k/yr HybridFull Time
Allianz Technology
Allianz Technology: Private Allianz Group technology provider delivering secure IT platforms, infrastructure, data, and AI services to Allianz entities worldwide.
7+ YOE7+ years of hands-on data engineering experience, including enterprise platform migration or re-engineering. Requires Azure, Databricks, Spark, Python, SQL, data governance, and stakeholder communication expertise.
Azure Synapse Analytics, Spark Pool, Dedicated SQL Pool, Azure Data Lake Storage Gen2, Delta Lake, Oracle GoldenGate Replication, Azure Analysis Services, Power BI, YAML, PySpark, SQL, Azure Databricks, Delta Live Tables, Unity Catalog, Apache Spark, Spark SQL, Python, Oracle DB, SQL Server, Azure SQL DB, Salesforce, APIs, Azure DevOps, GitHub Actions, Terraform, ARM, Docker, Event Hub, Kafka, Kinesis, MLOps, Dynatrace, Tableau
Job PostingView all
2mo
Save
Mark Applied
Hide
Databricks Platform & Data Engineer (Plano, TX, US)
Plano or Minneapolis or Chicago or Atlanta
$135k-$247k/yr OnsiteFull Time
NTT DATA
NTT DATATokyo Stock Exchange: 9613: Global digital business and IT services provider.
12+ YOE12+ years experience with 5+ years on Databricks; deep expertise in Apache Spark, Delta Lake, Databricks platform setup, cloud (AWS/Azure/GCP), data governance, and client-facing delivery.
Databricks, Apache Spark, Scala, Python, Delta Lake, Unity Catalog, Dataflow, Genie, Kafka, Structured Streaming, MLOps, AWS, Azure, GCP, PowerPoint
Job PostingView all
4d
Save
Mark Applied
Hide
Responsible AI Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$68k-$220k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services delivering 360° value.
3+ YOEBachelor's degree or equivalent experience, 3+ years developing AI and machine learning solutions, 3+ years with programming, frameworks, APIs, version control, databases, and cloud platforms; responsible AI experience preferred.
Python, R, Java, Scikit-learn, TensorFlow, PyTorch, Django, Flask, FastAPI, GitHub, Bitbucket, AWS, Azure, Google Cloud, Hadoop, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: An American general merchandise retailer.
7+ YOE7+ years data engineering experience; BS/MS preferred; expertise with Hadoop/Spark, PySpark/Scala/Java, cloud platforms (AWS/GCP/Azure), APIs, streaming (Kafka/Flink/Kinesis), and data modeling.
Hadoop, Spark, Scala, Java, PySpark, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
Minneapolis, Minnesota, United States
$87k-$131k/yr HybridFull Time
Comfort Medical
Comfort Medical: Private US direct-to-consumer supplier delivering prescribed catheter, ostomy, and bowel-management supplies to patients nationwide.
4+ YOEBachelor's in CS/IT/Engineering required; 4+ years data engineering experience; strong T-SQL and Python skills; experience with Microsoft Fabric, Azure, ETL/ELT pipelines, Synapse Spark, data warehousing/lakehouse, Power BI, and building production data platforms.
Microsoft Fabric, Synapse Spark, OneLake, Microsoft Azure, Microsoft Azure Data Factory, Microsoft Power BI, Fabric Semantic Models, Salesforce APIs, T-SQL, Python
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consulting firm.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
Job PostingView all
4d
Save
Mark Applied
Hide
Data Engineer
Kentucky or North Carolina or Indiana or Illinois or Virginia or Ohio or Florida or Georgia or Minnesota or Michigan or Texas or Wisconsin
RemoteFull Time
ProMach
ProMach: Provider of integrated packaging and processing machinery solutions.
3+ YOERequires 3–5 years of data engineering experience, Databricks, SQL, Python, Apache Spark, cloud platforms, data modeling, ETL/ELT, data warehousing, and CI/CD expertise; bachelor's degree or equivalent experience.
Databricks, Apache Spark, Delta Lake, Databricks SQL, Databricks Runtime, SQL, Python, Azure, AWS, GCP, CI/CD, SAP, Infor, Salesforce CRM, Tableau
Job PostingView all

Explore Jobs

Expand Your Job Search