11 pyspark data engineer jobs at 7 companies in Louisiana
1w
Save
Mark Applied
Hide
Senior Data Engineer
Florida or Montana or Michigan or Massachusetts or Rhode Island or West Virginia or Oregon or Oklahoma or Minnesota or New York or South Carolina or Kentucky or Virginia or Colorado or New Jersey or Wisconsin or Utah or Pennsylvania or Ohio or North Carolina or Nebraska or Mississippi or South Dakota or Maryland or Louisiana or Kansas or Iowa or Illinois or Tennessee or Delaware or Connecticut or California or Hawaii or Arkansas or District of Columbia or Georgia or Missouri or Arizona or Alabama or New Hampshire or Texas or Vermont or Indiana or Washington or Nevada or Idaho or New Mexico or Maine
$143k-$160k/yr RemoteFull Time
7+ YOE7+ years data engineering experience with 3+ years Databricks; strong Spark/PySpark, Delta Lake, SQL, Azure, Git and CI/CD skills; Bachelor's degree required.
Databricks, Apache Spark, Delta Lake, Unity Catalog, Workflows, SQL Warehouses, Delta Live Tables, PySpark, SQL, Azure, Git, dbt, Terraform, Azure DevOps
2mo
Save
Mark Applied
Hide
Data Engineer - Remote
Virginia Beach or Alabama or Delaware or Florida or Georgia or Idaho or Indiana or Kansas or Louisiana or Maine or Maryland or Minnesota or Nebraska or Nevada or New Hampshire or North Carolina or North Dakota or Ohio or Oklahoma or Pennsylvania or South Carolina or South Dakota or Tennessee or Texas or Utah or Virginia or Washington or West Virginia or Wisconsin or Wyoming
$80k-$134k/yr RemoteFull Time
3+ YOE3+ years relevant experience building scalable data pipelines with PySpark/Databricks, strong SQL, ETL/ELT, Delta Lake, Azure preferred, Fivetran, Git, and metadata-driven ingestion and data quality/governance practices.
PySpark, Databricks, Fivetran, Delta Lake, Azure, Git, SQL, DataHub, ACP
2mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Indiana or Kentucky or Louisiana or Massachusetts or Maine or Maryland or Michigan or Minnesota or Missouri or North Carolina or New Jersey or New York or Oregon or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Wisconsin
$130k-$150k/yr RemoteFull Time
5+ YOE5+ years professional software engineering experience; hands-on Apache Spark and distributed data pipelines; experience managing data warehouses or lakes; mentoring and guiding technical decisions; strong data modeling and production skills.
Apache Spark, AWS, GitHub Actions, Terraform, Docker
1w
Save
Mark Applied
Hide
Director, Data Engineering
Florida or Montana or Michigan or Massachusetts or Rhode Island or West Virginia or Oregon or Oklahoma or Minnesota or New York or South Carolina or Kentucky or Virginia or Colorado or New Jersey or Wisconsin or Utah or Pennsylvania or Ohio or North Carolina or Nebraska or Mississippi or South Dakota or Maryland or Louisiana or Kansas or Iowa or Illinois or Tennessee or Delaware or Connecticut or California or Hawaii or Arkansas or District of Columbia or Georgia or Missouri or Arizona or Alabama or New Hampshire or Texas or Vermont or Indiana or Washington or Nevada or Idaho or New Mexico or Maine
$195k-$210k/yr RemoteFull Time
10+ YOE5+ MgmtBachelor's degree,10+ years data engineering,5+ years leading teams,expert Databricks/Spark/Python/PySpark/SQL,Databricks platform and Unity Catalog experience,CI/CD and IaC familiarity,strong leadership and stakeholder skills.
Databricks Lakehouse Platform, Databricks, Unity Catalog, Delta Live Tables (Lakeflow), Delta Lake, Apache Spark, SQL, Python, PySpark, Databricks Workflows, Git, Azure
1mo
Save
Mark Applied
Hide
Lead Engineer, Data Platforms
Tempe or Phoenix or Alabama or Arizona or California or Colorado or Florida or Idaho or Kansas or Kentucky or Missouri or New Mexico or Nevada or Oklahoma or Oregon or Tennessee or Texas or Utah or Washington or Wyoming or Louisiana or Illinois or Indiana or North Carolina or Ohio or Michigan or New Jersey or Arkansas or Georgia
RemoteFull Time
7+ YOE7+ years data/software engineering experience (4+ years on backend or data infrastructure). Bachelor\u0002s in CS or related (or 4 years experience). Expert Python and SQL, Snowflake, Airflow, Power BI, AWS services, CI/CD, DataDog, Kafka, ETL/ELT tools, data governance, and strong communication skills.
Python, SQL, Snowflake, Snowpipe, SnowSQL, Airflow, Microsoft Power BI, AWS, IAM, VPC, Glue, S3, SFTP, Lambda, CloudWatch, SNS, Gitlab CI/CD, DataDog, Kafka, Workato, ADF, Matillion, DBT, Databricks, Fivetran, pyspark
2mo
Save
Mark Applied
Hide
Data Engineer - Archimedes
St. Louis or Brentwood or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming or United States
HybridFull Time
5+ YOEDesign, build, and operate cloud-native lake house platforms using Azure Databricks, Delta Lake, ADLS Gen2; 5+ years data engineering experience; Bachelor's in CS/IS/Data Engineering required; CI/CD, data governance, and HIPAA compliance experience.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Microsoft Synapse Analytics, Azure Data Factory, Azure Functions, Azure Key Vault, Azure Monitor, Apache Spark, PySpark, SQL, Python, GitHub Actions, Azure DevOps, Jenkins, AWS Glue, AWS Lambda, EventBridge, Event Hub, Event Grid, Service Bus, REST APIs, GraphQL, Apache Airflow, MLflow, Databricks ML, Azure Machine Learning, CloudWatch, ELK Stack, Git, Terraform, Bash, PowerShell, AWS S3, AWS RDS, AWS Redshift
1w
Save
Mark Applied
Hide
Enterprise Data Architect
New Orleans, Louisiana, United States
OnsiteFull Time
7+ YOEBachelor's degree and 7 years in data architecture, data engineering, or advanced analytics in healthcare. Requires SQL, ETL, data modeling, cloud platforms, healthcare data standards, and strong stakeholder communication.
Erwin, SQL, Power BI, Tableau, Azure, AWS, GCP, Snowflake, Databricks, Azure Data Factory, dbt, PySpark, HL7, FHIR, X12, EHR, HIPAA, HITECH
1mo
Save
Mark Applied
Hide
Digital Medicine Data Architect
New Orleans, Louisiana, United States
OnsiteFull Time
7+ YOEBachelor's in CS/IS/Data Science required,7+ years data architecture/engineering in healthcare,expertise in SQL,data modeling,HL7/FHIR,cloud platforms and modern data platforms;CDMP/AWS/Azure/CHDA preferred.
Erwin, HL7, FHIR, X12, SQL, Power BI, Tableau, Azure, AWS, GCP, Snowflake, Databricks, Azure Data Factory, dbt, PySpark
5d
Save
Mark Applied
Hide
Software Engineer II
New Orleans or United States
$95k-$106k/yr RemoteFull Time
1+ YOEMaster’s degree in computer science, technology management, or related field; 1+ year software engineering experience; experience with data pipelines, SQL, CI/CD, GitHub, REST APIs, and Jira.
Apache Spark, Python, Java, Scala, SQL, Amazon Web Services (AWS), GitHub, REST APIs, Jira, Microsoft SQL Server, Amazon Simple Notification Service (SNS), Amazon Kinesis Data Streams, Amazon Kinesis Data Analytics, CI/CD
2mo
Save
Mark Applied
Hide
Sr. Software Engineer II - (DSM Methodology Team)
Czech Republic or Brazil or Stockholm or London or New York City or New Orleans or Singapore or Tokyo or Sydney
RemoteFull Time
10+ YOE10+ years backend engineering experience; strong Java core skills; expertise in algorithms, data structures, high-volume systems, event-driven and API integrations; familiarity with Spark, Kafka, Docker, SQL/NoSQL and cloud technologies.
Java, Python, PySpark, Scala, C/C++, Haskell, Elixir, Go, Ruby, Spark, Delta Lake, Parquet, Kafka, Avro, Docker, SQL, NoSQL, Pandas, Spring, AWS, GCP