15 pyspark data engineer jobs at 5 companies in Saint Peter, MN
1mo
Save
Mark Applied
Hide
Data Engineer - Remote
United States or Minnetonka or Minneapolis or Washington
$73k-$130k/yr RemoteFull Time
3+ YOE3+ years data engineering experience; strong SQL, Python, and PySpark skills; 1+ year with Azure/Databricks; experience with streaming, ETL, CDC, data quality and Medallion architecture.
Azure, Azure Data Factory, Databricks, Databricks Delta Live Tables, Delta Lake, Parquet, PySpark, Spark, Spark Structured Streaming, Spark Declarative Lakeflow Pipelines, Kafka, Azure Event Hubs, Great Expectations, SQL, Python
1mo
Save
Mark Applied
Hide
Associate Data Engineer
Minnetonka, Minnesota, United States
$60k-$107k/yr OnsiteFull Time
4+ YOEBachelor's degree or equivalent; 4+ years data engineering experience (3+ in dedicated role); 2+ years AWS; 3+ years Apache Airflow; expertise in MSSQL, Python (Pandas, PySpark), SQL/NoSQL, data warehousing, governance, and ML/AI solutions.
Python, SQL, Apache Airflow, MSSQL, Informatica, SSIS, Pandas, PySpark, AWS S3, AWS Glue, AWS Lambda, AWS RDS, AWS Redshift, AWS EC2, AWS Step Functions, NoSQL, Google ADK
2d
Save
Mark Applied
Hide
Data Engineer
Minnetonka or United States
$73k-$130k/yr RemoteFull Time
6+ YOE3+ MgmtBachelor's degree in computer science or information technology, or equivalent experience; 6+ years in data engineering, including senior-level work, with MSSQL, data warehousing, AWS, Python, Airflow, governance, and data quality expertise.
MSSQL, AWS, Python, Apache Airflow, SQL, NoSQL, Amazon S3, AWS Glue, AWS Lambda, Amazon RDS, Amazon Redshift, Amazon EC2, AWS Step Functions, Pandas, PySpark
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
1mo
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
8+ YOEBachelor's degree required; 8+ years data engineering experience; expert SQL (T-SQL, PL/SQL); 5+ years building ETL/ELT with Azure Data Factory/Fabric/SAP Data Services; Power BI/DAX experience; machine learning and mentoring experience.
T-SQL, PL/SQL, SQL, SQL Server, Azure Data Factory, Fabric Data Pipelines, Microsoft Fabric, OneLake, SAP Data Services, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, eCommerce, Python, PySpark, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Kafka, Event Hubs, Spark Structured Streaming, Microsoft Purview, Databricks, Delta Sharing, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus, AWS, LangChain/LangGraph
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
22h
Save
Mark Applied
Hide
Senior Cloud Data Engineer – Remote
Eden Prairie or United States
$92k-$164k/yr RemoteFull Time
6+ YOERequires 6+ years of enterprise data engineering experience, 3+ years with Azure cloud technologies, healthcare data expertise, ETL/ELT, data warehousing, CI/CD, and architectural leadership.
Azure, Snowflake, Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS Gen2), SQL Server, Python, Spark, PySpark, Microsoft Visio, Apache Airflow, GitHub, GitHub Actions, Databricks Genie, GitHub Copilot, Snowflake Cortex, LLMs, Azure OpenAI, Databricks Mosaic AI, Kafka, Spark Structured Streaming, Terraform, Docker, Kubernetes, AWS, Google Cloud
22h
Save
Mark Applied
Hide
Senior Cloud Data Engineer - Remote
Eden Prairie or United States
$92k-$164k/yr RemoteFull Time
5+ YOERequires 5+ years designing enterprise data warehouse and analytics solutions, 3+ years with Azure cloud data engineering, healthcare data modernization experience, and expertise in Azure Data Factory, Databricks, Snowflake, ADLS Gen2, SQL Server, Python, and Spark.
Azure, AWS, Snowflake, Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS Gen2), SQL Server, Python, Spark, Pyspark, SSIS, Microsoft Visio, AirFlow, GitHub, GitHub Actions, Electronic Health Record (EHR), Kafka, Spark Structure Streaming, Terraform, Docker, Kubernetes, RAG, HL7, FHIR, X12 EDI, ICD-10, CPT, HCPCS, LOINC, LLMs, Databricks Genie, GitHub Copilot, Snowflake Cortex
14h
Save
Mark Applied
Hide
Senior Cloud Data Engineer - Remote
Eden Prairie or United States
$92k-$164k/yr RemoteFull Time
5+ YOERequires 5+ years designing enterprise data solutions, 3+ years Azure cloud engineering, data warehousing, ETL/ELT, healthcare data, CI/CD, Agile, and ability to travel 10–20%.
Azure, Snowflake, Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS Gen2), Synapse Analytics, Azure SQL Database, Microsoft Fabric, SQL Server, Python, Spark, PySpark, SSIS, Microsoft Visio, Airflow, GitHub Actions, GitHub, Azure DevOps, Terraform, Docker, Kubernetes, AWS, Google Cloud, EHR, RAG, ETL/ELT, CI/CD, CDC, EMR
1mo
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
8+ YOE8+ years data engineering experience, expert SQL, 5+ years ETL/ELT with Azure/Data Factory/Fabric, bachelor\u0002s degree in CS/IS/Engineering, experience with SAP integrations, Power BI/DAX, ML and modern lakehouse architectures.
Microsoft Fabric, OneLake, SAP Data Services, SQL Server, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, Azure Data Factory, Fabric Data Pipelines, Python, PySpark, SQL, T-SQL, PL/SQL, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, Databricks, Delta Sharing, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Microsoft Purview, Kafka, Event Hubs, Spark Structured Streaming, AWS, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus
1mo
Save
Mark Applied
Hide
Staff Engineer
Edina, Minnesota, United States
$118k-$206k/yr OnsiteFull Time
7+ YOE7+ years experience in data/platform engineering; strong expertise with data architecture, semantic/ontology design, PySpark/Spark, Python, SQL, distributed data platforms, CI/CD, and AI-assisted development; Palantir Foundry experience preferred.
Palantir Foundry, AIP, PySpark, Spark, Python, SQL, EHR, ERP, FHIR, HL7, Epic, Oracle Health, CI/CD
1mo
Save
Mark Applied
Hide
Staff Engineer
Edina, Minnesota, United States
$118k-$206k/yr OnsiteFull Time
7+ YOE7+ years experience in data/platform engineering; expertise with PySpark/Spark/Python/SQL, data modeling, ontology/semantic architecture, CI/CD, governance, and Palantir Foundry preferred; strong communication and mentorship skills.
Palantir Foundry, AIP, PySpark, Spark, Python, SQL, CI/CD, FHIR, HL7, Epic, Oracle Health, EHR, ERP
2w
Save
Mark Applied
Hide
Senior Manager, Data Engineering & Analytics
Burnsville, Minnesota, United States
$170k-$215k/yr OnsiteFull Time
8+ YOE3+ MgmtBachelor's degree,8+ years in enterprise data management,3+ years people leadership,hands-on Microsoft Fabric/medallion architecture experience,SQL/Pyspark/DAX proficiency,and strong communication for cross-functional influence.
Microsoft Fabric, OneLake, Lakehouse, Databricks, Data Factory, Synapse Data Engineering, Power BI, Microsoft Purview, Epicor, SAP, SQL, Pyspark, DAX, Azure
2mo
Save
Mark Applied
Hide
AI Engineer - AI/ML
Minnetonka or Minneapolis or Washington or United States
$99k-$176k/yr HybridFull Time
5+ YOEBachelor's in CS/IT; 5+ years AI/ML experience (prompt engineering, RAG, agentic AI); 5+ years with Python, PySpark, T-SQL/SQL and big data; 2+ years statistics/data modeling; 1+ year Generative AI frameworks; CI/CD, cloud, and LLM security experience.
GPT, Gemini, LLaMA, LangChain, LangGraph, Sci-kit Learn, Pandas, Flask, Python, PySpark, T-SQL, SQL, Hadoop, Spark, HuggingFace, OpenAI APIs, AWS Bedrock, SageMaker, Bedrock, Google Vertex AI, Vertex AI, Azure, Databricks, ML Studio, Microsoft ML Studio, Microsoft Data Factory, Microsoft Data Lake, Delta Tables, Snowflake, Kafka, TensorFlow, MLFlow, Docker, GitHub, Git, GitHub Actions, Hugging Face
1mo
Save
Mark Applied
Hide
Senior Azure Databricks
Eden Prairie, Minnesota, United States
$100k-$120k/yr OnsiteFull Time
7+ YOE7+ years experience building cloud-native data platforms with Azure Databricks, PySpark, ADF, Delta Lake, Unity Catalog, Python, SQL, GitHub and CI/CD; API and Kubernetes experience; strong data governance and problem-solving skills.
Azure Databricks, PySpark, Delta Lake, Unity Catalog, Azure Data Factory (ADF), ADLS Gen2, Databricks AI/ML, Codex, Claude, Python, SQL, GitHub, CI/CD, REST, GraphQL, Kubernetes, AKS
Explore Jobs