29 pyspark data engineer jobs at 19 companies in Erwin, NC
6d
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent experience; experience with PySpark, AWS Redshift, AWS Glue and Gen AI; ability to work across SDLC, support production systems; US work authorization required; relocation/travel possible.
PySpark, AWS Redshift, Gen AI, AWS Glue
2w
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
2w
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh, North Carolina, United States
$100k-$120k/yr OnsiteFull Time
8+ YOE8+ years data engineering experience with Snowflake, Qlik Replicate, DBT Cloud, Astronomer Airflow, Python/Pyspark, GitLab and CI/CD; experience with CDC, schema evolution, and data governance.
Qlik Replicate, Snowflake, Snowpipe, Tasks, Streams, Dynamic Tables, DBT Cloud, Astronomer Airflow, Python, Pyspark, GitLab, Azure DevOps, Protegrity, Oracle, SQL Server, DB2
1d
Save
Mark Applied
Hide
Data Engineer II
Cary, North Carolina, United States
$90k-$110k/yr HybridFull Time
3+ YOEBachelor's or master's degree or equivalent experience; 3–5 years in data engineering or related work; Python, PySpark, Spark SQL, SQL, Azure Data Factory, Databricks, and Delta Lake experience.
Azure Data Factory, Databricks, PySpark, Spark SQL, SQL, Python, Delta Lake, Lakehouse, pytest, Git, Azure DevOps, CI/CD, Attacama, GenAI
1w
Save
Mark Applied
Hide
Lead Data Engineer
Raleigh, North Carolina, United States
HybridFull Time
8+ YOE8+ years experience designing and delivering data pipelines and analytics on cloud platforms; expert SQL, Python, PySpark; AWS and big data tech experience; strong communication and leadership skills.
SQL, Python, PySpark, Scala, Bash, Hadoop, Spark, Kafka, RAG, Embedding, Agents, LLMs, AWS, Data Science Studio, Alteryx, Jupyter, Tableau, PowerBI, Gitlab, EMR, Glue, Athena, Batch, Lambda, Cloudwatch, DynamoDB, EC2, Cloudformation, IAM, EDS, Hive, Teradata, Linux, Jira
1w
Save
Mark Applied
Hide
Principal Data Engineer - Remote
Raleigh or Minneapolis or Washington or United States
$113k-$193k/yr RemoteFull Time
10+ YOE10+ years data engineering experience, 5+ years cloud (Azure/GCP/AWS), hands-on Databricks with Python/PySpark and SQL, AI-driven data solutions, enterprise scalability/security/governance experience.
Databricks, Python, PySpark, SQL, Power BI, Tableau, Azure, GCP, AWS
1mo
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
4w
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
1d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1w
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh or United States
$158k-$180k/yr RemoteFull Time
3+ YOE3+ years experience (Master's+3 or Bachelor's+5) building pipelines between Snowflake and Databricks using PySpark and dbt, Airflow orchestration, Databricks administration, and end-to-end ML development.
Snowflake, Databricks, PySpark, dbt, Apache Airflow, Amazon S3, OpenShift, MLflow, TextBlob, gensim, fastText, XGBoost, Scikit-learn, Keras, Git, Tekton, buildah, skopeo, Kubernetes, SonarQube, Qualys, pip-audit, Splunk
1d
Save
Mark Applied
Hide
Data Engineer (Remote)
Morrisville, North Carolina, United States
$116k-$173k/yr RemoteFull Time
5+ YOEBachelor's degree in a technical field and 5+ years of data engineering experience, or 3+ years with a master's or PhD. Requires Python, SQL, ETL, Azure data services, distributed computing, data modeling, Git, and CI/CD.
Python, SQL, Microsoft Azure, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, AWS, GCP, Apache Airflow, dbt, Apache Spark, Parquet, Delta Lake, Git, CI/CD, R, Docker, Kubernetes, Azure Kubernetes Service, EHR, ICD, CPT4, LOINC, SNOMED CT, OMOP CDM
2mo
Save
Mark Applied
Hide
Manager, Data Engineer (Remote)
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yr RemoteFull Time
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Python, SQL, PySpark, Apache Spark, Databricks, Snowflake, Azure, Data warehousing, ETL, CI/CD
3w
Save
Mark Applied
Hide
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY
Durham, North Carolina, United States
RemoteFull Time
2+ YOE2+ years data engineering experience with Azure/Databricks, strong SQL and PySpark, bachelor’s degree in MIS/CS/Engineering or equivalent, experience with Delta Lake, ADF, ADLS Gen2, governance and CI/CD.
Azure Data Factory, Azure Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables, ADLS Gen2, Azure DevOps, Git, Unity Catalog, Microsoft Purview, Power BI, SQL, Python
1mo
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
3w
Save
Mark Applied
Hide
Senior Software Engineer/Developer
Durham, North Carolina, United States
OnsiteFull Time
3+ YOEExperience developing PL/SQL and cloud-based data solutions using AWS, Python, Scala, Spark, and Snowflake; bachelor’s degree plus 3 years (or master’s plus 1 year) in related field required; strong data engineering and ETL skills.
PL/SQL, AWS, DMS, SNS, SQS, Lambda, AWS Glue, Python, Scala, Snowflake, Apache Spark, Tableau, Splunk, DataDog, DynamoDB, S3, Oracle RDS, PostgreSQL, REST, Kanban, SCRUM, CI/CD
2mo
Save
Mark Applied
Hide
Cloud Data Architect (Full-time Remote, NC Based)
Morrisville, North Carolina, United States
$116k-$148k/yr HybridFull Time
5+ YOEBachelor's degree in computer science or related field; 5+ years as a Cloud Data Architect; Azure data lake/warehouse, Databricks Data Engineer Professional; Azure Security Engineer (AZ-500) preferred; healthcare data experience preferred.
Azure, Azure Data Services, ADLS Gen2, Data Factory, Synapse, Databricks, PySpark, SQL, Git, CI/CD
1w
Save
Mark Applied
Hide
Associate
Cary, North Carolina, United States
$116k-$140k/yr OnsiteFull Time
3+ YOEBachelor's degree in computer engineering or related field,3 years experience with Apache Spark,cloud data architectures,Kafka,Airflow,CI/CD and relational databases; strong data pipeline and distributed systems skills.
Apache Spark, Spark SQL, Spark Streaming, Apache Kafka, REST API, HDFS, Hive, YARN, AWS, GCP, Azure, Airflow, Control-M, Git, Jenkins, Terraform, PostgreSQL, Oracle, MySQL, Parquet, JSON, XML
6d
Save
Mark Applied
Hide
Biostatistician
Fort Bragg or San Diego or Fort Campbell or Hurlburt Field or Joint Base Lewis-McChord or North America or Australia or Europe or Asia or Africa or South America
$63k-$86k/yr OnsiteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
5+ YOEMaster's or doctoral degree and 5+ years in quantitative or related science, including 3+ years of research. Requires Python or R, advanced SQL, data engineering, analytics, visualization, and Secret or Top Secret clearance.
SQL Server, Databricks, Apache Spark, PySpark, Power BI, Microsoft Power Apps, Microsoft Power Automate, Python, R, HTML, CSS, JavaScript, React, Django, ASP.NET Core, Microsoft Word, Microsoft Excel, Microsoft Access, DAX, NLP, Large Language Models (LLMs)
2mo
Save
Mark Applied
Hide
Software Engineering Senior Advisor- Hybrid
Raleigh, North Carolina, United States
HybridFull Time
5+ YOEBachelor's in CS/EE or related +5 years (or Master's +3 years). Hands-on experience with Python, Java, PL/SQL, APIs, Spark/Databricks, Airflow, Kafka, AWS services, Tableau, Informatica PowerCenter, SQL, CI/CD, data governance, security and mentoring.
Python, Java, PL/SQL, APIs, Airflow, Kafka, Databricks, Tableau, PySpark, Spark, Delta Lake, Notebooks, Informatica PowerCenter, Oracle(SQL), CI/CD, API Gateway, Lambda, EC2, S3, IAM, CloudWatch, Glue, Athena
Explore Jobs