13 pyspark data engineer jobs at 9 companies in Ramseur, NC
4d
Save
Mark Applied
Hide
Data Engineer II
Cary, North Carolina, United States
$90k-$110k/yr HybridFull Time
3+ YOEBachelor's or master's degree or equivalent experience; 3–5 years in data engineering or related work; Python, PySpark, Spark SQL, SQL, Azure Data Factory, Databricks, and Delta Lake experience.
Azure Data Factory, Databricks, PySpark, Spark SQL, SQL, Python, Delta Lake, Lakehouse, pytest, Git, Azure DevOps, CI/CD, Attacama, GenAI
1mo
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
4d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
3w
Save
Mark Applied
Hide
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY
Durham, North Carolina, United States
RemoteFull Time
2+ YOE2+ years data engineering experience with Azure/Databricks, strong SQL and PySpark, bachelor’s degree in MIS/CS/Engineering or equivalent, experience with Delta Lake, ADF, ADLS Gen2, governance and CI/CD.
Azure Data Factory, Azure Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables, ADLS Gen2, Azure DevOps, Git, Unity Catalog, Microsoft Purview, Power BI, SQL, Python
1mo
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
1mo
Save
Mark Applied
Hide
Senior Software Engineer/Developer
Durham, North Carolina, United States
OnsiteFull Time
3+ YOEExperience developing PL/SQL and cloud-based data solutions using AWS, Python, Scala, Spark, and Snowflake; bachelor’s degree plus 3 years (or master’s plus 1 year) in related field required; strong data engineering and ETL skills.
PL/SQL, AWS, DMS, SNS, SQS, Lambda, AWS Glue, Python, Scala, Snowflake, Apache Spark, Tableau, Splunk, DataDog, DynamoDB, S3, Oracle RDS, PostgreSQL, REST, Kanban, SCRUM, CI/CD
2mo
Save
Mark Applied
Hide
Cloud Data Architect (Full-time Remote, NC Based)
Morrisville, North Carolina, United States
$116k-$148k/yr HybridFull Time
5+ YOEBachelor's degree in computer science or related field; 5+ years as a Cloud Data Architect; Azure data lake/warehouse, Databricks Data Engineer Professional; Azure Security Engineer (AZ-500) preferred; healthcare data experience preferred.
Azure, Azure Data Services, ADLS Gen2, Data Factory, Synapse, Databricks, PySpark, SQL, Git, CI/CD
2w
Save
Mark Applied
Hide
Senior Software Engineer/Developer
Durham, North Carolina, United States
OnsiteFull Time
1+ YOEBachelor's degree plus 3 years, or master's degree plus 1 year, in data integration, modeling, pipelines, and analytics using AWS, SQL, Teradata, and Informatica; expertise with Python and listed data tools required.
Amazon Web Services (AWS), Extract, Transform and Load (ETL), Extract, Load and Transform (ELT), Structured Query Language (SQL), Continuous Integration and Continuous Delivery (CI/CD), Tableau, Oracle Business Intelligence Enterprise Edition (OBIEE), Teradata, Informatica, Python, Lambda, EMR, S3, EC2, Linux, Shell scripting, Control-M, Star, Snowflake, Data Vault, PySpark, Oracle, PLSQL, Stash, GitHub, Jenkins, uDeploy, ICEDQ, Gherkin
1mo
Save
Mark Applied
Hide
Senior Software Engineer/Developer
Durham, North Carolina, United States
OnsiteFull Time
3+ YOEBachelor's degree plus 3 years or master's degree plus 1 year of experience developing data and software solutions with Oracle PL/SQL, AWS, Python, Scala, and Snowflake.
Oracle RDBMS, PL/SQL, Continuous Integration and Continuous Deployment (CI/CD), AWS, AWS DMS, Amazon SNS, Amazon SQS, AWS Lambda, AWS Glue, Python, Scala, Snowflake, ETL, Apache Spark, Tableau, Kanban, SCRUM, DynamoDB, Spark SQL, DataFrames, Amazon S3, Oracle RDS, PostgreSQL, Splunk, DataDog, REST APIs, SQL, NoSQL
3d
Save
Mark Applied
Hide
Principal Analyst, Operations and Health Systems Research
Cambridge or Research Triangle Park
$141k-$188k/yr HybridFull Time
5+ YOERequires 5+ years in pharma, biotech, technology, or healthcare, with expertise in data science, machine learning, operations research, data engineering, Python/R, clinical data, modeling, and software development practices.
Electronic Health Records (EHR), Python, R, NumPy, pandas, SciPy, statsmodels, scikit-learn, Google OR-Tools, TensorFlow, PyTorch, PySpark, tidyverse, sparklyr, mlr, tidymodels
1w
Save
Mark Applied
Hide
Associate
Cary, North Carolina, United States
$116k-$140k/yr OnsiteFull Time
3+ YOEBachelor's degree in computer engineering or related field,3 years experience with Apache Spark,cloud data architectures,Kafka,Airflow,CI/CD and relational databases; strong data pipeline and distributed systems skills.
Apache Spark, Spark SQL, Spark Streaming, Apache Kafka, REST API, HDFS, Hive, YARN, AWS, GCP, Azure, Airflow, Control-M, Git, Jenkins, Terraform, PostgreSQL, Oracle, MySQL, Parquet, JSON, XML
2w
Save
Mark Applied
Hide
Software Engineering/Development
Durham, North Carolina, United States
OnsiteFull Time
3+ YOEExperience building data pipelines and analytics solutions using AWS, SQL, Teradata, Informatica, Python, and related tools; BS/MS in CS or related field with relevant years of experience; strong data modeling and CI/CD skills.
Amazon Web Services (AWS), Lambda, EMR, S3, EC2, SQL, PLSQL, Teradata, Informatica, Python, Linux, Shell, Control-M, Snowflake, PySpark, Oracle, Stash, GitHub, Jenkins, uDeploy, ICEDQ, Gherkin, Tableau, Oracle Business Intelligence Enterprise Edition (OBIEE)