24 pyspark data engineer jobs at 16 companies in Kenly, NC
1w
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent experience; experience with PySpark, AWS Redshift, AWS Glue and Gen AI; ability to work across SDLC, support production systems; US work authorization required; relocation/travel possible.
PySpark, AWS Redshift, Gen AI, AWS Glue
2w
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh, North Carolina, United States
$100k-$120k/yr OnsiteFull Time
8+ YOE8+ years data engineering experience with Snowflake, Qlik Replicate, DBT Cloud, Astronomer Airflow, Python/Pyspark, GitLab and CI/CD; experience with CDC, schema evolution, and data governance.
Qlik Replicate, Snowflake, Snowpipe, Tasks, Streams, Dynamic Tables, DBT Cloud, Astronomer Airflow, Python, Pyspark, GitLab, Azure DevOps, Protegrity, Oracle, SQL Server, DB2
3d
Save
Mark Applied
Hide
Data Engineer II
Cary, North Carolina, United States
$90k-$110k/yr HybridFull Time
3+ YOEBachelor's or master's degree or equivalent experience; 3–5 years in data engineering or related work; Python, PySpark, Spark SQL, SQL, Azure Data Factory, Databricks, and Delta Lake experience.
Azure Data Factory, Databricks, PySpark, Spark SQL, SQL, Python, Delta Lake, Lakehouse, pytest, Git, Azure DevOps, CI/CD, Attacama, GenAI
1w
Save
Mark Applied
Hide
Lead Data Engineer
Raleigh, North Carolina, United States
HybridFull Time
8+ YOE8+ years experience designing and delivering data pipelines and analytics on cloud platforms; expert SQL, Python, PySpark; AWS and big data tech experience; strong communication and leadership skills.
SQL, Python, PySpark, Scala, Bash, Hadoop, Spark, Kafka, RAG, Embedding, Agents, LLMs, AWS, Data Science Studio, Alteryx, Jupyter, Tableau, PowerBI, Gitlab, EMR, Glue, Athena, Batch, Lambda, Cloudwatch, DynamoDB, EC2, Cloudformation, IAM, EDS, Hive, Teradata, Linux, Jira
1w
Save
Mark Applied
Hide
Principal Data Engineer - Remote
Raleigh or Minneapolis or Washington or United States
$113k-$193k/yr RemoteFull Time
10+ YOE10+ years data engineering experience, 5+ years cloud (Azure/GCP/AWS), hands-on Databricks with Python/PySpark and SQL, AI-driven data solutions, enterprise scalability/security/governance experience.
Databricks, Python, PySpark, SQL, Power BI, Tableau, Azure, GCP, AWS
1mo
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
1w
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh or United States
$158k-$180k/yr RemoteFull Time
3+ YOE3+ years experience (Master's+3 or Bachelor's+5) building pipelines between Snowflake and Databricks using PySpark and dbt, Airflow orchestration, Databricks administration, and end-to-end ML development.
Snowflake, Databricks, PySpark, dbt, Apache Airflow, Amazon S3, OpenShift, MLflow, TextBlob, gensim, fastText, XGBoost, Scikit-learn, Keras, Git, Tekton, buildah, skopeo, Kubernetes, SonarQube, Qualys, pip-audit, Splunk
3d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
2mo
Save
Mark Applied
Hide
Manager, Data Engineer (Remote)
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yr RemoteFull Time
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Python, SQL, PySpark, Apache Spark, Databricks, Snowflake, Azure, Data warehousing, ETL, CI/CD
2d
Save
Mark Applied
Hide
Analytics Engineer
Chicago or Atlanta or Tampa or Houston or Raleigh or Charlotte or Charleston or Southlake
$92k-$130k/yr OnsiteFull Time
3+ YOERequires 3+ years in analytics or data, advanced SQL, Python, data modeling, Databricks, BI tools, experiment design, and AI coding-tool experience; quantitative education or equivalent experience preferred.
SQL, Python, Databricks, AI coding assistants, Claude Code, Cursor, Codex, dbt, Apache Spark, Delta Lake, Unity Catalog, Microsoft Power BI, Tableau, Qlik, Streamlit, Power Platform, Azure, Azure Data Lake Storage (ADLS), Azure Machine Learning (Azure ML), Azure Synapse, PostgreSQL, Git, CI/CD, Great Expectations, Monte Carlo, MCP, RAG, LLMs, GPS, Podium
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
2mo
Save
Mark Applied
Hide
Cloud Data Architect (Full-time Remote, NC Based)
Morrisville, North Carolina, United States
$116k-$148k/yr HybridFull Time
5+ YOEBachelor's degree in computer science or related field; 5+ years as a Cloud Data Architect; Azure data lake/warehouse, Databricks Data Engineer Professional; Azure Security Engineer (AZ-500) preferred; healthcare data experience preferred.
Azure, Azure Data Services, ADLS Gen2, Data Factory, Synapse, Databricks, PySpark, SQL, Git, CI/CD
2d
Save
Mark Applied
Hide
Principal Analyst, Operations and Health Systems Research
Cambridge or Research Triangle Park
$141k-$188k/yr HybridFull Time
5+ YOERequires 5+ years in pharma, biotech, technology, or healthcare, with expertise in data science, machine learning, operations research, data engineering, Python/R, clinical data, modeling, and software development practices.
Electronic Health Records (EHR), Python, R, NumPy, pandas, SciPy, statsmodels, scikit-learn, Google OR-Tools, TensorFlow, PyTorch, PySpark, tidyverse, sparklyr, mlr, tidymodels
1w
Save
Mark Applied
Hide
Associate
Cary, North Carolina, United States
$116k-$140k/yr OnsiteFull Time
3+ YOEBachelor's degree in computer engineering or related field,3 years experience with Apache Spark,cloud data architectures,Kafka,Airflow,CI/CD and relational databases; strong data pipeline and distributed systems skills.
Apache Spark, Spark SQL, Spark Streaming, Apache Kafka, REST API, HDFS, Hive, YARN, AWS, GCP, Azure, Airflow, Control-M, Git, Jenkins, Terraform, PostgreSQL, Oracle, MySQL, Parquet, JSON, XML
2mo
Save
Mark Applied
Hide
Software Engineering Senior Advisor- Hybrid
Raleigh, North Carolina, United States
HybridFull Time
5+ YOEBachelor's in CS/EE or related +5 years (or Master's +3 years). Hands-on experience with Python, Java, PL/SQL, APIs, Spark/Databricks, Airflow, Kafka, AWS services, Tableau, Informatica PowerCenter, SQL, CI/CD, data governance, security and mentoring.
Python, Java, PL/SQL, APIs, Airflow, Kafka, Databricks, Tableau, PySpark, Spark, Delta Lake, Notebooks, Informatica PowerCenter, Oracle(SQL), CI/CD, API Gateway, Lambda, EC2, S3, IAM, CloudWatch, Glue, Athena
Explore Jobs