37 pyspark developer jobs at 19 companies in Clayton, NC
1w
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Experience with PySpark and AWS Redshift; Databricks/Glue/Gen AI preferred. Bachelor's degree or equivalent (or relevant experience in lieu); ability to work US projects without employer sponsorship; relocation/travel possible.
PySpark, AWS Redshift, Databricks, Glue, Gen AI, AWS
1mo
Save
Mark Applied
Hide
Databricks Engineer
Raleigh, North Carolina, United States
$100k-$140k/yr OnsiteFull Time
4+ YOEExperience with Databricks, Apache Spark/PySpark, SQL, ETL/ELT development, data modeling, Python or Scala, Azure, production support, and CI/CD for data pipelines.
Databricks, Apache Spark, PySpark, SQL, Python, Scala, Delta Lake, CI/CD, Microsoft Azure
1d
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$54k-$235k/yr HybridFull Time
3+ YOERequires 3+ years in data engineering, cloud platforms, and Python, PySpark, or Java; 1+ year with Palantir Foundry and AIP; bachelor's degree or equivalent experience.
Palantir Foundry, Palantir Gotham, Palantir Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Git, GitHub, GitLab, Jenkins, JavaScript
4w
Save
Mark Applied
Hide
Senior Software Engineer/Developer
Durham, North Carolina, United States
OnsiteFull Time
3+ YOEBachelor's degree plus 3 years or master's degree plus 1 year of experience developing data and software solutions with Oracle PL/SQL, AWS, Python, Scala, and Snowflake.
Oracle RDBMS, PL/SQL, Continuous Integration and Continuous Deployment (CI/CD), AWS, AWS DMS, Amazon SNS, Amazon SQS, AWS Lambda, AWS Glue, Python, Scala, Snowflake, ETL, Apache Spark, Tableau, Kanban, SCRUM, DynamoDB, Spark SQL, DataFrames, Amazon S3, Oracle RDS, PostgreSQL, Splunk, DataDog, REST APIs, SQL, NoSQL
3mo
Save
Mark Applied
Hide
AI/ML Engineer (Hybrid)
Raleigh or San Jose or Austin or Richardson
$137k-$201k/yr HybridFull Time
7+ YOE7+ years CS, 2+ years ML for cloud operations, strong cloud skills (AWS/GCP/Azure/OCI), Python, PySpark, ML libraries, AWS Glue, Athena, Snowflake, Airflow.
Python, PySpark, PyTorch, TensorFlow, Scikit-Learn, AWS Glue, AWS Athena, Snowflake, Apache Airflow, Angular, Flask, Jira, Git, GitHub Actions, Jenkins, Golang, Bash
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1w
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh or United States
$158k-$180k/yr RemoteFull Time
3+ YOE3+ years experience (Master's+3 or Bachelor's+5) building pipelines between Snowflake and Databricks using PySpark and dbt, Airflow orchestration, Databricks administration, and end-to-end ML development.
Snowflake, Databricks, PySpark, dbt, Apache Airflow, Amazon S3, OpenShift, MLflow, TextBlob, gensim, fastText, XGBoost, Scikit-learn, Keras, Git, Tekton, buildah, skopeo, Kubernetes, SonarQube, Qualys, pip-audit, Splunk
1w
Save
Mark Applied
Hide
Senior Software Engineer
Raleigh, North Carolina, United States
HybridFull Time
4+ YOERequires a bachelor's degree and 4 years of software development experience, or high school diploma/GED and 8 years. Expertise in AWS, Snowflake, dbt, Python, SQL, Airflow, React, databases, containers, APIs, and DevOps.
Amazon Web Services (AWS), Amazon EC2, Amazon S3, AWS Lambda, Amazon RDS, Snowflake, dbt, Python, SQL, Apache Airflow, React, PostgreSQL, Microsoft SQL Server, JSONB, Docker, Amazon ECS, Amazon EKS, GitLab, Jenkins, Git, Azure DevOps, Apache Spark, Astronomer, Apache Kafka, Amazon Kinesis, Apache Flink, Qlik Replicate
2w
Save
Mark Applied
Hide
Lead Data Engineer
Raleigh, North Carolina, United States
HybridFull Time
8+ YOE8+ years experience designing and delivering data pipelines and analytics on cloud platforms; expert SQL, Python, PySpark; AWS and big data tech experience; strong communication and leadership skills.
SQL, Python, PySpark, Scala, Bash, Hadoop, Spark, Kafka, RAG, Embedding, Agents, LLMs, AWS, Data Science Studio, Alteryx, Jupyter, Tableau, PowerBI, Gitlab, EMR, Glue, Athena, Batch, Lambda, Cloudwatch, DynamoDB, EC2, Cloudformation, IAM, EDS, Hive, Teradata, Linux, Jira
3d
Save
Mark Applied
Hide
Data Engineer II
Cary, North Carolina, United States
$90k-$110k/yr HybridFull Time
3+ YOEBachelor's or master's degree or equivalent experience; 3–5 years in data engineering or related work; Python, PySpark, Spark SQL, SQL, Azure Data Factory, Databricks, and Delta Lake experience.
Azure Data Factory, Databricks, PySpark, Spark SQL, SQL, Python, Delta Lake, Lakehouse, pytest, Git, Azure DevOps, CI/CD, Attacama, GenAI
1w
Save
Mark Applied
Hide
Principal Data Engineer - Remote
Raleigh or Minneapolis or Washington or United States
$113k-$193k/yr RemoteFull Time
10+ YOE10+ years data engineering experience, 5+ years cloud (Azure/GCP/AWS), hands-on Databricks with Python/PySpark and SQL, AI-driven data solutions, enterprise scalability/security/governance experience.
Databricks, Python, PySpark, SQL, Power BI, Tableau, Azure, GCP, AWS
1mo
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
1mo
Save
Mark Applied
Hide
Senior Software Engineer/Developer
Durham, North Carolina, United States
OnsiteFull Time
3+ YOEExperience developing PL/SQL and cloud-based data solutions using AWS, Python, Scala, Spark, and Snowflake; bachelor’s degree plus 3 years (or master’s plus 1 year) in related field required; strong data engineering and ETL skills.
PL/SQL, AWS, DMS, SNS, SQS, Lambda, AWS Glue, Python, Scala, Snowflake, Apache Spark, Tableau, Splunk, DataDog, DynamoDB, S3, Oracle RDS, PostgreSQL, REST, Kanban, SCRUM, CI/CD
3w
Save
Mark Applied
Hide
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY
Durham, North Carolina, United States
RemoteFull Time
2+ YOE2+ years data engineering experience with Azure/Databricks, strong SQL and PySpark, bachelor’s degree in MIS/CS/Engineering or equivalent, experience with Delta Lake, ADF, ADLS Gen2, governance and CI/CD.
Azure Data Factory, Azure Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables, ADLS Gen2, Azure DevOps, Git, Unity Catalog, Microsoft Purview, Power BI, SQL, Python
2w
Save
Mark Applied
Hide
Sr. Open Source Software Engineer - Apache Cassandra
Morrisville or United States or San Jose or Waltham or Cork or Netherlands or Seattle or Raleigh or San Jose
$220k-$265k/yr RemoteFull Time
12+ YOERequires 12+ years of software engineering experience, Apache Cassandra committer status, expert Java skills, distributed-systems expertise, open-source governance experience, and strong technical communication.
Apache Cassandra, Java, Apache Cassandra Sidecar, Apache Spark, GoCQL, Apache Cassandra Drivers, Apache Jira, GitHub, Zstandard (ZSTD)
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
3d
Save
Mark Applied
Hide
Analytics Engineer
Chicago or Atlanta or Tampa or Houston or Raleigh or Charlotte or Charleston or Southlake
$92k-$130k/yr OnsiteFull Time
3+ YOERequires 3+ years in analytics or data, advanced SQL, Python, data modeling, Databricks, BI tools, experiment design, and AI coding-tool experience; quantitative education or equivalent experience preferred.
SQL, Python, Databricks, AI coding assistants, Claude Code, Cursor, Codex, dbt, Apache Spark, Delta Lake, Unity Catalog, Microsoft Power BI, Tableau, Qlik, Streamlit, Power Platform, Azure, Azure Data Lake Storage (ADLS), Azure Machine Learning (Azure ML), Azure Synapse, PostgreSQL, Git, CI/CD, Great Expectations, Monte Carlo, MCP, RAG, LLMs, GPS, Podium
4d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1mo
Save
Mark Applied
Hide
Data Engineer - East Region
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York City or Philadelphia or Raleigh or Tampa or Washington
$100k-$122k/yr OnsiteFull Time
4+ YOERequires 4+ years designing, building, and optimizing production data engineering solutions, with modern data technologies, cloud platforms, data warehouses, and programming skills.
Amazon Web Services, Microsoft Azure, Google Cloud Platform, Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
2mo
Save
Mark Applied
Hide
Manager, Data Engineer (Remote)
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yr RemoteFull Time
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Python, SQL, PySpark, Apache Spark, Databricks, Snowflake, Azure, Data warehousing, ETL, CI/CD
Explore Jobs