45 pyspark data engineer jobs at 19 companies in Rogers, MN
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
7+ YOE7+ years data engineering experience; BS/MS preferred; expertise with Hadoop/Spark, PySpark/Scala/Java, cloud platforms (AWS/GCP/Azure), APIs, streaming (Kafka/Flink/Kinesis), and data modeling.
Hadoop, Spark, Scala, Java, PySpark, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
1mo
Save
Mark Applied
Hide
Data Engineer II - Databricks Platform
Hartford or Hunt Valley or Saint Paul
$127k-$209k/yr HybridFull Time
8+ YOEBachelor’s in STEM or equivalent, ~8 years related experience with additional data engineering experience, strong Databricks/PySpark/AWS skills, data governance and quality experience, stakeholder communication and leadership.
Databricks, Unity Catalog, Pyspark, AWS, Genie
1mo
Save
Mark Applied
Hide
Associate Data Engineer
Minnetonka, Minnesota, United States
$60k-$107k/yr OnsiteFull Time
4+ YOEBachelor's degree or equivalent; 4+ years data engineering experience (3+ in dedicated role); 2+ years AWS; 3+ years Apache Airflow; expertise in MSSQL, Python (Pandas, PySpark), SQL/NoSQL, data warehousing, governance, and ML/AI solutions.
Python, SQL, Apache Airflow, MSSQL, Informatica, SSIS, Pandas, PySpark, AWS S3, AWS Glue, AWS Lambda, AWS RDS, AWS Redshift, AWS EC2, AWS Step Functions, NoSQL, Google ADK
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Underwriting Technical Lead
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
10+ YOEBachelor's in STEM or equivalent; ~10 years related experience with 6+ years in data engineering; expertise with AWS (S3, Glue, Redshift, Lambda, EMR), Databricks, dbt, PySpark; AI/ML knowledge; technical leadership and mentoring experience.
AWS, S3, Glue, Redshift, Lambda, EMR, Databricks, dbt, PySpark, Azure Data Factory, Synapse Analytics, Azure Databricks
4d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
3w
Save
Mark Applied
Hide
Data Engineer
St Cloud, Minnesota, United States
$82k-$103k/yr HybridFull Time
3+ YOEBachelor's in CS or equivalent, 3+ years data engineering experience with minimum 1–2 years in Microsoft Fabric, PySpark/Python, strong T-SQL skills, experience building medallion architecture and ETL migrations.
Microsoft Fabric, PySpark, dbt, Power BI, T-SQL, Azure DevOps, Git, Microsoft Data Factory
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Chicago or Edina
$102k-$179k/yr OnsiteFull Time
Vizient: Provides performance improvement and supply chain services to hospitals
5+ YOE5+ years data engineering experience; strong Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, SQL, and CI/CD experience; Azure DevOps and Git; knowledge of metadata, governance, Unity Catalog, and enterprise data products. US work authorization required.
Azure Databricks, PySpark, Spark, Spark SQL, Delta Lake, Delta Live Tables, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Databricks notebooks, Azure DevOps, Git, CI/CD, Pulumi, Apache Iceberg, AKS, Kubernetes, SQL
1mo
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
8+ YOEBachelor's degree required; 8+ years data engineering experience; expert SQL (T-SQL, PL/SQL); 5+ years building ETL/ELT with Azure Data Factory/Fabric/SAP Data Services; Power BI/DAX experience; machine learning and mentoring experience.
T-SQL, PL/SQL, SQL, SQL Server, Azure Data Factory, Fabric Data Pipelines, Microsoft Fabric, OneLake, SAP Data Services, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, eCommerce, Python, PySpark, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Kafka, Event Hubs, Spark Structured Streaming, Microsoft Purview, Databricks, Delta Sharing, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus, AWS, LangChain/LangGraph
2mo
Save
Mark Applied
Hide
Senior Artificial Intelligence Data Engineer
Irving or Edina or Chicago
$102k-$179k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong experience with Azure Databricks, PySpark/Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Azure DevOps/Git and CI/CD; experience with metadata, governance, and enterprise-scale analytical platforms; US work authorization required.
Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, dbt, Unity Catalog, Starburst/Trino, Databricks Asset Bundles, Delta Live Tables, Spark, Databricks notebooks, Azure DevOps, Git, CI/CD, Infrastructure as Code (IaC), Pulumi, Apache Iceberg, AKS/Kubernetes, SQL
2mo
Save
Mark Applied
Hide
Lead Cloud Data Engineer - Multi-Cloud Data Platforms
Irving or Chicago or Hopkins
$133k-$157k/yr HybridFull Time
6+ YOE6+ years experience building cloud-native data pipelines and products across Azure, AWS, Databricks, and Snowflake; strong Spark and SQL skills; experience with security, governance, and domain-oriented data architectures.
Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, AWS Glue, S3, Databricks, Snowflake, Apache Spark, Delta Lake, SQL, REST, SOAP, GraphQL, Kafka, MQ, AWS SQS, RabbitMQ, API Gateway, OAuth 2.0, TLS, mTLS, JWT, IAM, RBAC, Microsoft Power BI, Tableau
1mo
Save
Mark Applied
Hide
Sr Data Engineer BI
Bloomington, Minnesota, United States
$120k-$130k/yr HybridFull Time
8+ YOE8+ years data engineering experience, expert SQL, 5+ years ETL/ELT with Azure/Data Factory/Fabric, bachelor\u0002s degree in CS/IS/Engineering, experience with SAP integrations, Power BI/DAX, ML and modern lakehouse architectures.
Microsoft Fabric, OneLake, SAP Data Services, SQL Server, SAP S/4HANA, HighJump WMS, Anaplan, Prophix, Sales Cloud, Azure Data Factory, Fabric Data Pipelines, Python, PySpark, SQL, T-SQL, PL/SQL, Power BI, DAX, Microsoft Copilot Studio, Azure AI Foundry, LangChain, LangGraph, Databricks, Delta Sharing, scikit-learn, TensorFlow, PyTorch, Azure ML, Fabric Data Science, Microsoft Purview, Kafka, Event Hubs, Spark Structured Streaming, AWS, CDS Views, BDC, DataSphere, Theobald Xtract Universal, dab Nexus
3w
Save
Mark Applied
Hide
Senior Data Quality & Active Learning AI Engineer (Plymouth)
Plymouth or Bedford
$156k-$187k/yr HybridFull Time
5+ YOE5+ years data-quality or data-engineering experience, bachelor's degree, expertise with medical imaging data, DICOM/PACS, HIPAA/GDPR, active-learning methods, Python and SQL, cloud data pipelines and validation.
Python, Structured Query Language (SQL), Amazon Web Services (AWS), Apache Spark, Ray, Digital Imaging and Communications in Medicine (DICOM), Picture Archiving and Communication System (PACS), HL7, Fast Healthcare Interoperability Resources (FHIR), OpenAI Codex, Claude Code, PyTorch, TensorFlow
1mo
Save
Mark Applied
Hide
Databricks Platform & Data Engineer (Plano, TX, US)
Plano or Minneapolis or Chicago or Atlanta
$135k-$247k/yr OnsiteFull Time
12+ YOE12+ years experience with 5+ years on Databricks; deep expertise in Apache Spark, Delta Lake, Databricks platform setup, cloud (AWS/Azure/GCP), data governance, and client-facing delivery.
Databricks, Apache Spark, Scala, Python, Delta Lake, Unity Catalog, Dataflow, Genie, Kafka, Structured Streaming, MLOps, AWS, Azure, GCP, PowerPoint
3d
Save
Mark Applied
Hide
Data Architect
Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington
$152k-$206k/yr HybridFull Time
10+ YOE3+ MgmtBachelor's or master's degree; 10+ years in data engineering or architecture and 3+ years in leadership. Requires cloud, data modeling, ETL, programming, and team leadership expertise.
Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks, Snowflake, Delta Lake, Apache Spark, Python, SQL, Java, Scala, Hadoop, Kafka, Amazon Redshift, Azure Synapse, Google BigQuery, Docker, Kubernetes
2w
Save
Mark Applied
Hide
Senior Manager, Data Engineering & Analytics
Burnsville, Minnesota, United States
$170k-$215k/yr OnsiteFull Time
8+ YOE3+ MgmtBachelor's degree,8+ years in enterprise data management,3+ years people leadership,hands-on Microsoft Fabric/medallion architecture experience,SQL/Pyspark/DAX proficiency,and strong communication for cross-functional influence.
Microsoft Fabric, OneLake, Lakehouse, Databricks, Data Factory, Synapse Data Engineering, Power BI, Microsoft Purview, Epicor, SAP, SQL, Pyspark, DAX, Azure
1d
Save
Mark Applied
Hide
Staff Engineer (e-ST)
Minneapolis, Minnesota, United States
$173k/yr HybridFull Time
6+ YOEBachelor's degree in MIS, computer science, or related field plus 6 years of data engineering experience; expertise in Big Data, pipelines, Spark, Hadoop, and cloud technologies required.
Hadoop, Apache Spark, Kafka, Python, Java, Scala, Snowflake, Databricks, StreamSets, Bamboo, Informatica, IICS, DB2, AWS, Microsoft Azure, Google Cloud, OpenStack, Docker, Ansible, Chef, Lambdas, Microservices, Terraform
1d
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$54k-$235k/yr HybridFull Time
3+ YOERequires 3+ years in data engineering, cloud platforms, and Python, PySpark, or Java; 1+ year with Palantir Foundry and AIP; bachelor's degree or equivalent experience.
Palantir Foundry, Palantir Gotham, Palantir Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Git, GitHub, GitLab, Jenkins, JavaScript
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
2w
Save
Mark Applied
Hide
ML Developer, Senior
Toronto or Minneapolis or United States
$128k-$228k/yr OnsiteFull Time
4+ YOE4+ years ML/data science experience, 2+ years MLOps, advanced Python and ML framework skills, SQL and Spark/PySpark proficiency, strong collaboration and problem-solving.
SQL, spark, pyspark, Python, PyTorch, TensorFlow, MLFlow, Databricks, Azure SQL, Function/Logic Apps, Key Vault, Storage Accounts, Virtual Machines, Azure Monitor, Log Analytics
Explore Jobs