HiringCafe
Join our community

52 pyspark developer jobs at 28 companies in Minnesota

2w
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
Job PostingView all
3d
Save
Mark Applied
Hide
ML Developer, Senior
Toronto or Minneapolis or United States
$128k-$228k/yr OnsiteFull Time
Dayforce
Dayforce: Cloud human capital management software for payroll, HR, and benefits.
4+ YOE4+ years ML/data science experience, 2+ years MLOps, advanced Python and ML framework skills, SQL and Spark/PySpark proficiency, strong collaboration and problem-solving.
SQL, spark, pyspark, Python, PyTorch, TensorFlow, MLFlow, Databricks, Azure SQL, Function/Logic Apps, Key Vault, Storage Accounts, Virtual Machines, Azure Monitor, Log Analytics
Job PostingView all
1mo
Save
Mark Applied
Hide
ML Developer, Senior
Toronto or Minneapolis or Canada or North America or Europe or Africa or Asia or Australia
$129k-$231k/yr OnsiteFull Time
Dayforce
Dayforce: Provides cloud-based human capital management and payroll software solutions.
4+ YOE4+ years ML/Data Science experience, 2+ years MLOps, advanced Python, SQL, Spark/PySpark, PyTorch/TensorFlow, MLflow, experience with transformer models, data cleaning/transformation, debugging, and strong communication; English required.
SQL, Spark, PySpark, Python, PyTorch, TensorFlow, MLflow, Databricks, Azure, Azure SQL, Azure Functions, Azure Logic Apps, Azure Key Vault, Azure Storage Accounts, Azure Virtual Machines, Azure Monitor, Log Analytics
Job PostingView all
3w
Save
Mark Applied
Hide
Lead Software Engineer - Remote
Minneapolis or Washington or United States
$113k-$193k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
10+ YOEBachelor's in CS/Engineering, 10+ years tech experience, 8+ years software/data engineering with Scala, Python, PySpark; experience with Databricks, orchestration, big data, LLMs/GenAI and cloud (Azure preferred).
Scala, Python, PySpark, Databricks, ADF, Airflow, Hadoop, MapReduce, HDFS, Spark, Kafka, Docker, Kubernetes, MySQL, NoSQL, GitHub, Jenkins, JUnit, Langchain, LangGraph, RAG, Vector DB, Azure Open AI, MCP Server, Agents, LangFuse, FastAPI, Flask, Node.js, React, Angular, TypeScript, HTML/CSS, UAIS, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1w
Save
Mark Applied
Hide
Database Developer (Contractor) - MNSITE-3762
Saint Paul, Minnesota, United States
RemoteFull Time, Contract
RESPEC
RESPEC: Integrated engineering, geoscience, and technology consulting services.
10+ YOE10+ years database development experience with Microsoft SQL Server/T-SQL, ETL (SSIS, Python, PySpark), data modeling, SSRS/Power BI, data migration, performance tuning, and production support.
Microsoft SQL Server, T-SQL, SSIS, Python, PySpark, SSRS, Power BI, Azure DevOps, GitHub, Jenkins, Microsoft Teams
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Engineer
Edina, Minnesota, United States
$118k-$206k/yr OnsiteFull Time
Vizient
Vizient: Provides performance improvement and supply chain services to hospitals
7+ YOE7+ years experience in data/platform engineering; strong expertise with data architecture, semantic/ontology design, PySpark/Spark, Python, SQL, distributed data platforms, CI/CD, and AI-assisted development; Palantir Foundry experience preferred.
Palantir Foundry, AIP, PySpark, Spark, Python, SQL, EHR, ERP, FHIR, HL7, Epic, Oracle Health, CI/CD
Job PostingView all
1w
Save
Mark Applied
Hide
Databricks Lead Engineer
Chicago or Milwaukee or Minneapolis
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Databricks and PySpark, end-to-end SDLC, coding, design, testing, and troubleshooting; bachelor’s degree or equivalent experience; authorized to work in the US without employer-based sponsorship.
Databricks, PySpark
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Engineer
Edina, Minnesota, United States
$118k-$206k/yr OnsiteFull Time
Vizient
Vizient: Healthcare performance improvement and group purchasing organization.
7+ YOE7+ years experience in data/platform engineering; expertise with PySpark/Spark/Python/SQL, data modeling, ontology/semantic architecture, CI/CD, governance, and Palantir Foundry preferred; strong communication and mentorship skills.
Palantir Foundry, AIP, PySpark, Spark, Python, SQL, CI/CD, FHIR, HL7, Epic, Oracle Health, EHR, ERP
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer
St Cloud, Minnesota, United States
$82k-$103k/yr HybridFull Time
Preferred Credit
Preferred Credit: Finances consumer purchases sold through direct sales channels.
3+ YOEBachelor's in CS or equivalent, 3+ years data engineering experience with minimum 1–2 years in Microsoft Fabric, PySpark/Python, strong T-SQL skills, experience building medallion architecture and ETL migrations.
Microsoft Fabric, PySpark, dbt, Power BI, T-SQL, Azure DevOps, Git, Microsoft Data Factory
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Minneapolis or Saint Paul or North America or South America
$50k-$56k/yr RemoteFull Time
Tergar International
Tergar International: Provides meditation training and Tibetan Buddhist spiritual programs.
3+ YOE3+ years data engineering experience; strong Python, PySpark, JavaScript, SQL; Linux (Bash); AWS Lambda/Glue; PostgreSQL/MySQL/Redshift; Git and CI/CD; data modeling, governance, and stakeholder collaboration skills.
Linux (Bash), Python, PySpark, JavaScript, SQL, PostgreSQL, MySQL, Amazon Redshift, AWS Lambda, Glue Jobs, Workflows, Git, CI/CD, HubSpot, HubSpot API, Microsoft Power BI, Docker, Google Tag Manager, PostHog, Terraform, ETL, ELT
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer - Remote
Virginia Beach or Alabama or Delaware or Florida or Georgia or Idaho or Indiana or Kansas or Louisiana or Maine or Maryland or Minnesota or Nebraska or Nevada or New Hampshire or North Carolina or North Dakota or Ohio or Oklahoma or Pennsylvania or South Carolina or South Dakota or Tennessee or Texas or Utah or Virginia or Washington or West Virginia or Wisconsin or Wyoming
$80k-$134k/yr RemoteFull Time
Sentara Health
Sentara Health: Operates hospitals and provides health insurance and medical services
3+ YOE3+ years relevant experience building scalable data pipelines with PySpark/Databricks, strong SQL, ETL/ELT, Delta Lake, Azure preferred, Fivetran, Git, and metadata-driven ingestion and data quality/governance practices.
PySpark, Databricks, Fivetran, Delta Lake, Azure, Git, SQL, DataHub, ACP
Job PostingView all
1w
Save
Mark Applied
Hide
Backend Engineer
California or Colorado or Georgia or Idaho or Illinois or Kansas or Massachusetts or Maryland or Michigan or Minnesota or New Jersey or New York or Ohio or Oregon or Pennsylvania or Rhode Island or Texas or Washington
$180k-$220k/yr RemoteFull Time
Unit21
Unit21: Provides an AI-powered platform for fraud and money laundering detection.
5+ YOE5+ years in data/software engineering, experience with large-scale data processing, advanced SQL, Python/OOP, cloud platforms, and infrastructure-as-code (Terraform).
Apache Spark, Databricks, Flink, Beam, Python, SQL, AWS, Azure, Google Cloud, Terraform
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer, Underwriting Technical Lead
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
10+ YOEBachelor's in STEM or equivalent; ~10 years related experience with 6+ years in data engineering; expertise with AWS (S3, Glue, Redshift, Lambda, EMR), Databricks, dbt, PySpark; AI/ML knowledge; technical leadership and mentoring experience.
AWS, S3, Glue, Redshift, Lambda, EMR, Databricks, dbt, PySpark, Azure Data Factory, Synapse Analytics, Azure Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer
Denver or Arizona or Arkansas or California or Florida or Georgia or Illinois or Indiana or Iowa or Kansas or Maryland or Massachusetts or Michigan or Minnesota or Missouri or Montana or Nevada or New Jersey or New York or North Carolina or Ohio or Oklahoma or Pennsylvania or Tennessee or Texas or Utah or Virginia or Washington or Wisconsin
$228k-$253k/yr HybridFull Time
Ibotta
IbottaNYSE: IBTA: Provides a cash-back rewards and performance marketing platform.
10+ YOE10+ years building and deploying large-scale ML systems; expertise with cloud (AWS), big-data tools, ML frameworks, and leading ML strategy and mentoring engineers.
Python, Apache Spark, Databricks, AWS, Amazon SageMaker, scikit-learn, TensorFlow, Spark ML, Apache Kafka
Job PostingView all
2mo
Save
Mark Applied
Hide
Enterprise Data Engineer
Herndon or Cleveland or California or Colorado or Hawaii or Illinois or Maine or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or Virginia or Washington or District of Columbia
$112k-$222k/yr OnsiteFull Time
Accenture Federal Services
Accenture Federal ServicesNYSE: ACN: Provides technology and consulting services to U.S. federal agencies.
3+ YOE3+ years data engineering experience; strong Python and SQL; experience with Palantir or other ETL platforms; data integration, ETL, transformation, and data quality skills; active TS/SCI with Poly required.
Python, SQL, Palantir, AWS, Azure, GCP, Apache Spark, Hadoop, Apache Airflow, Prefect
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Indiana or Kentucky or Louisiana or Massachusetts or Maine or Maryland or Michigan or Minnesota or Missouri or North Carolina or New Jersey or New York or Oregon or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Wisconsin
$130k-$150k/yr RemoteFull Time
MissionWired
MissionWired: Providing digital fundraising and data-driven marketing for nonprofit organizations.
5+ YOE5+ years professional software engineering experience; hands-on Apache Spark and distributed data pipelines; experience managing data warehouses or lakes; mentoring and guiding technical decisions; strong data modeling and production skills.
Apache Spark, AWS, GitHub Actions, Terraform, Docker
Job PostingView all
3w
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
Quality Bicycle Products
Quality Bicycle Products: Distributor of bicycle parts, accessories, and proprietary cycling brands.
8+ YOE8+ years data engineering experience, expert SQL, 5+ years ETL/ELT with Azure/Data Factory/Fabric, bachelor\u0002s degree in CS/IS/Engineering, experience with SAP integrations, Power BI/DAX, ML and modern lakehouse architectures.
Microsoft Fabric, OneLake, SAP Data Services, SQL Server, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, Azure Data Factory, Fabric Data Pipelines, Python, PySpark, SQL, T-SQL, PL/SQL, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, Databricks, Delta Sharing, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Microsoft Purview, Kafka, Event Hubs, Spark Structured Streaming, AWS, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus
Job PostingView all
3w
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
Quality Bicycle Products
Quality Bicycle Products: Distributor and manufacturer of bicycles and cycling components.
8+ YOEBachelor's degree required; 8+ years data engineering experience; expert SQL (T-SQL, PL/SQL); 5+ years building ETL/ELT with Azure Data Factory/Fabric/SAP Data Services; Power BI/DAX experience; machine learning and mentoring experience.
T-SQL, PL/SQL, SQL, SQL Server, Azure Data Factory, Fabric Data Pipelines, Microsoft Fabric, OneLake, SAP Data Services, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, eCommerce, Python, PySpark, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Kafka, Event Hubs, Spark Structured Streaming, Microsoft Purview, Databricks, Delta Sharing, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus, AWS, LangChain/LangGraph
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Platform Engineer
Ohio or New York or New Jersey or Missouri or Minnesota or Michigan or Massachusetts or Indiana or Illinois or Georgia or Florida or Colorado or California or Arizona or Pennsylvania or Wisconsin or Texas or United States
$120k-$160k/yr RemoteFull Time
SullivanCotter
SullivanCotter: Consulting and data for healthcare and nonprofit compensation strategies.
5+ YOE5+ years experience; degree in CS/Software Engineering/Information Systems/IT or equivalent; proficiency in Python/Scala/Java/SQL, Apache Spark, Databricks, ELT/ETL, streaming, RESTful/gRPC, SDLC, testing and CI/CD tooling; strong design and mentoring skills.
Python, Scala, Java, SQL, Apache Spark, Databricks, Pytest, GitHub Actions, Poetry, Git, RESTful, gRPC
Job PostingView all

Explore Jobs

Expand Your Job Search