48 spark data engineer jobs at 28 companies in Erwin, NC
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Raleigh or United States
$216k/yr RemoteFull Time
10+ YOE10+ years data engineering experience, strong Python, lakehouse and processing engine expertise (Delta Lake/Iceberg/Hudi, Spark/Databricks/Trino/Snowflake), expert AWS (S3, IAM, Glue, EMR, Lambda), Terraform, data modeling, governance, and leadership/mentoring skills.
Python, Delta Lake, Iceberg, Hudi, Spark, Databricks, Trino, Snowflake, AWS, S3, IAM, Glue, EMR, Lambda, Terraform, Claude, Cursor
1mo
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
3w
Save
Mark Applied
Hide
U.S. Data Engineer
Research Triangle Park, North Carolina, United States
OnsiteFull Time
5+ YOEDesign and build ETL/ELT pipelines using SQL, Python and Spark; 5+ years related experience; project/technical leadership; Bachelor’s degree or equivalent; strong debugging and data quality skills.
SQL, Python, Spark, ADF, Databricks, dbt, Airflow, Azure
1mo
Save
Mark Applied
Hide
Data Engineer Senior Principal (Hybrid)
Fort Bragg, North Carolina, United States
$145k-$196k/yr HybridFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
10+ YOEU.S. citizen with current DoW Secret clearance, 10+ years related experience, Master’s in computer science preferred, expertise in AWS/Azure, SQL, Python, big data (Presto/Trino, Hive, Spark, Flink), data lake/warehouse architecture, ETL/ELT, workflow engines (Airflow, AWS Step Functions, Prefect), Kubernetes, Linux/Unix/Windows.
Amazon Web Services (AWS), Microsoft Azure, SQL, S3, Python, Presto, Trino, Hive, Spark, Flink, Airflow, AWS Step Functions, Prefect, Kubernetes, Linux, Unix, Windows, Power BI, Splunk, ELK, TAK
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh, North Carolina, United States
$92k-$164k/yr RemoteFull Time
6+ YOEBachelor's degree or equivalent; 6+ years analytics engineering or data engineering; 5+ years cloud experience; 5+ years programming (Python/Java); 4+ years Databricks/ETL; 4+ years data modeling and advanced SQL; 1+ year AI-driven analytics.
Databricks, Spark, SQL, Python, Power BI, Tableau, Airflow, Azure Data Factory, ETL, Notebooks
3w
Save
Mark Applied
Hide
Senior Data Engineer
Cary, North Carolina, United States
$115k-$135k/yr HybridFull Time
5+ YOEBachelor's in Computer Science or related, 5+ years data engineering, Azure Data Factory, Azure Functions, Databricks, Cosmos DB, Synapse, SQL and Scala experience, Agile Scrum knowledge.
Hadoop, Azure Data Factory, Azure Functions, Databricks, Azure Cosmos DB, Azure Synapse, SQL, Scala, HDFS, YARN, Spark, Hive, HBase, Kafka, Shell, Python, Solr, JANUS, NiFi, Event Hub, CI/CD
2w
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh or North Carolina or Arizona or Texas or Florida
RemoteFull Time
4+ YOEBachelor's+4 years or HS+8 years in data engineering or related; advanced experience with cloud data platforms, Snowflake, ETL/ELT, dbt, Python, SQL; strong analytical and communication skills.
AWS, Azure, GCP, Snowflake, Spark, Python, SQL, dbt, Apache Airflow, Astronomer, DataStage, SAP BODS, SSIS, Informatica, Kafka, Amazon Kinesis, Apache Flink, Qlik Replicate, Snow pipe Streaming, Tableau, Power BI
1w
Save
Mark Applied
Hide
Lead Data Engineer
Raleigh, North Carolina, United States
HybridFull Time
8+ YOE8+ years experience designing and delivering data pipelines and analytics on cloud platforms; expert SQL, Python, PySpark; AWS and big data tech experience; strong communication and leadership skills.
SQL, Python, PySpark, Scala, Bash, Hadoop, Spark, Kafka, RAG, Embedding, Agents, LLMs, AWS, Data Science Studio, Alteryx, Jupyter, Tableau, PowerBI, Gitlab, EMR, Glue, Athena, Batch, Lambda, Cloudwatch, DynamoDB, EC2, Cloudformation, IAM, EDS, Hive, Teradata, Linux, Jira
1mo
Save
Mark Applied
Hide
Data Engineer Senior Principal (Hybrid)
Fort Bragg, North Carolina, United States
$145k-$196k/yr HybridFull Time
10+ YOE10+ years experience designing cloud-based data architectures; strong SQL, Python, AWS/Azure, big data, ETL/ELT and workflow engine experience; current DoW Secret clearance and U.S. citizenship required; Master’s degree in CS or related.
Amazon Web Services (AWS), Microsoft Azure, SQL, S3, Python, Presto, Trino, Hive, Spark, Flink, Airflow, AWS Step Functions, Prefect, Linux, UNIX, Windows, Kubernetes, PowerBI, Splunk, ELK, TAK
1w
Save
Mark Applied
Hide
Data Engineer
Research Triangle Park, North Carolina, United States
HybridFull Time
3+ YOE3+ years software development experience, strong Python and SQL proficiency, cloud platform experience (AWS/GCP/Azure), familiarity with GitLab/GitHub Actions, strong problem-solving and communication skills.
Python, SQL, AWS, GCP, Azure, GitLab, GitHub Actions, Langchain, LangGraph, Spark, Dask
1w
Save
Mark Applied
Hide
Data Engineer
Research Triangle Park, North Carolina, United States
HybridFull Time
3+ YOEBachelor's degree or equivalent experience,3+ years software development/data engineering experience,healthcare or clinical data background,cloud (AWS/GCP/Azure) experience,proficiency with R,Python,SQL,and Git/GitLab.
R, Python, SQL, Git, GitLab, GitHub Actions, CI/CD, AWS, GCP, Azure, Langchain, LangGraph, Spark, Dask, UNIX, Linux
2w
Save
Mark Applied
Hide
Data Warehouse Contractor
Raleigh or Cupertino or Austin
$60-$70/hr OnsiteContract
6+ YOE6+ years data engineering experience with hands-on SQL, Spark, and Scala; building and maintaining production data pipelines; experience with lakehouse technologies (Iceberg, Trino, Superset); US work authorization required.
SQL, Spark, Scala, Iceberg, Trino, Superset
5d
Save
Mark Applied
Hide
Data Scientist
Fayetteville or Fort Bragg
$99k-$225k/yr OnsiteFull Time
5+ YOE5+ years in data science or ML engineering, experience with Python, ML/DL frameworks, model development/tuning, and working with intelligence or special operations data.
Python, Scikit-Learn, TensorFlow, PyTorch, XGBoost, Jupyter Notebook, Pandas, NumPy, Git, R, SQL, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Plotly, Seaborn, ggplot2
5d
Save
Mark Applied
Hide
Data Scientist
Fayetteville, North Carolina, United States
$99k-$225k/yr HybridFull Time
5+ YOE5+ years in data science or ML engineering; TS/SCI clearance; Bachelor's in data/computer science; experience with Python, ML frameworks, LLM tuning, computer vision, EMR not required for role.
Python, ETL, Scikit-Learn, TensorFlow, PyTorch, XGBoost, Jupyter Notebook, Pandas, NumPy, Git, LLMs, R, SQL, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Plotly, Seaborn, ggplot2
1w
Save
Mark Applied
Hide
Manager, Platform Data Architecture
Morrisville or United States
$110k-$150k/yr RemoteFull Time
8+ YOE2+ Mgmt8+ years data architecture/engineering experience, 2+ years managing technical teams, Bachelor’s in CS/IS/Engineering, expertise in modern data stack, data governance, and regulated industries experience preferred.
DBT, Python, Talend, Snowflake, Databricks, SQL, Spark, Hadoop, Kafka, AWS, Azure, GCP
1mo
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
1mo
Save
Mark Applied
Hide
Kite Data & Integration Lead - Sales & Digital
Raleigh or Foster City
$146k-$219k/yr HybridFull Time
6+ YOEBachelor's +8 years or Master's +6 years experience; product ownership for AI/data products; experience with data engineering, model lifecycle, production monitoring, and commercial analytics integrations.
Python, SQL, TypeScript, JavaScript, Go, Rust, GitHub Actions, Docker, Databricks, Spark, Airflow, Tableau, Genie Spaces, Claude Code, GitHub Copilot, Cursor, Cortex AI, Model Context Protocol (MCP), IQVIA, Veeva CRM, MMIT, Model N, Salesforce, Microsoft 365, ServiceNow
1mo
Save
Mark Applied
Hide
Databricks Developer
Raleigh, North Carolina, United States
$100k-$140k/yr OnsiteFull Time
4+ YOEBachelor in computer science,4+ years experience; expertise with Databricks,Spark/PySpark,Delta Lake,AI/ML,cloud platforms,SQL and Python; strong communication and problem-solving.
Databricks, Spark, PySpark, Delta Lake, Agent Bricks, Unity Catalog, AWS, Azure, GCP, Microsoft Power BI, Tableau, SQL, Python
3w
Save
Mark Applied
Hide
Technical Solutions Engineer - Pre
Dallas or Mountain View or Raleigh or San Bruno
$104k-$156k/yr HybridFull Time
6+ YOEBA/BS or equivalent,6+ years in healthcare technology/data engineering/solutions engineering,cloud and coding proficiency,healthcare data standards experience,customer-facing implementation skills.
Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure, Python, Golang, Terraform, YAML, SQL, Epic, Cerner, Allscripts, FHIR, HL7, CCD/C-CDA, ICD, SNOMED, LOINC, BigQuery, Snowflake, Databricks, Spark
1mo
Save
Mark Applied
Hide
Senior Delivery Consultant - Data , Professional Services, AWSI HCLS
Boston or Jersey City or Arlington or New York or Denver or Chicago or Mountain View or Raleigh
$154k-$239k/yr HybridFull Time
5+ YOE5+ years cloud architecture and data engineering experience; bachelor's degree or 7+ years experience; hands-on production data pipeline and platform implementation; experience with modern data platform patterns and ontologies; familiarity with HCLS compliance.
Amazon SageMaker Lakehouse, SageMaker Unified Studio, Amazon S3 Tables, Amazon Redshift, AWS Context, Amazon Bedrock Knowledge Bases, Apache Iceberg, Spark, Databricks, Snowflake, Kafka, AWS Glue Data Catalog, Collibra, Alation
Explore Jobs