69 spark engineer jobs at 37 companies in Smithfield, NC

1w
Save
Mark Applied
Hide
Technical Solutions Engineer - Pre
Dallas or Mountain View or Raleigh or San Bruno
$104k-$156k/yr HybridFull Time
Verily
Verily: Developing data-driven technologies for clinical research and precision health.
6+ YOEBA/BS or equivalent,6+ years in healthcare technology/data engineering/solutions engineering,cloud and coding proficiency,healthcare data standards experience,customer-facing implementation skills.
Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure, Python, Golang, Terraform, YAML, SQL, Epic, Cerner, Allscripts, FHIR, HL7, CCD/C-CDA, ICD, SNOMED, LOINC, BigQuery, Snowflake, Databricks, Spark
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Raleigh or United States
$216k/yr RemoteFull Time
Teamworks
Teamworks: Software platform streamlining operations and performance for sports organizations.
10+ YOE10+ years data engineering experience, strong Python, lakehouse and processing engine expertise (Delta Lake/Iceberg/Hudi, Spark/Databricks/Trino/Snowflake), expert AWS (S3, IAM, Glue, EMR, Lambda), Terraform, data modeling, governance, and leadership/mentoring skills.
Python, Delta Lake, Iceberg, Hudi, Spark, Databricks, Trino, Snowflake, AWS, S3, IAM, Glue, EMR, Lambda, Terraform, Claude, Cursor
2w
Save
Mark Applied
Hide
Principal Data Engineer - Semantic Layer
Cary or Tampa or New York City or Bridgewater
$130k-$189k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
10+ YOE10+ years in data engineering/architecture with 3+ years in semantic layer/ontology engineering; expertise with OWL/RDF/SPARQL, cloud data platforms, SQL/NoSQL, Python, and Spark; Bachelor's degree required.
OWL, RDF, SPARQL, Stardog, Timbr.ai, AtScale, dbt Semantic Layer, Databricks, Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, Delta Lake, Power BI, Cognos Analytics, JDBC, ODBC, MDX, DAX, REST, GraphQL, Collibra, SQL, NoSQL, Python, Spark, Cypher, HermiT, Pellet, RDFox, Apache Jena, GraphDB, Amazon Neptune
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Durham, North Carolina, United States
OnsiteFull Time
Fidelity Investments
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
3+ YOEBachelor's in CS/Engineering/IT/IS + 5 years, or Master’s + 3 years; expertise in data warehouse/BI, cloud (AWS, Snowflake), ETL, CI/CD, Python/Spark, Oracle/PLSQL, Informatica, control-m and observability tools.
Jenkins, Stash, Concourse, Artifactory, Oracle SQL, PL/SQL, Snowflake, Amazon Web Services (AWS), Python, Spark, Informatica, Informatica Data Quality IDQ, Address doctor, Docker Container, Hive, Impala, Kafka, Scala, Spark SQL, Alation, Collibra, JUnit, JMeter, Datadog, Control-M, Jenkinscore, Terracore, Bitbucket, GitHub
2w
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
Peter Millar
Peter MillarSIX Swiss Exchange: CFR: Designs and sells luxury lifestyle apparel and performance sportswear.
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
3w
Save
Mark Applied
Hide
Principal Data Engineer - Remote
Raleigh or Minneapolis or Washington or United States
$113k-$193k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
8+ YOE8+ years in analytics/data engineering, 6+ years Databricks (Spark, SQL, Python) experience, 5+ years cloud (Azure/GCP/AWS), 4+ years Power BI (DAX/Power Query), and experience delivering enterprise analytics and AI solutions.
Databricks, Spark, SQL, Python, Microsoft Power BI, DAX, Power Query, Azure, GCP, AWS, AI
1w
Save
Mark Applied
Hide
U.S. Data Engineer
Research Triangle Park, North Carolina, United States
OnsiteFull Time
Grifols
GrifolsMadrid Stock Exchange: GRF: Develops plasma-derived medicines and clinical diagnostic solutions.
5+ YOEDesign and build ETL/ELT pipelines using SQL, Python and Spark; 5+ years related experience; project/technical leadership; Bachelor’s degree or equivalent; strong debugging and data quality skills.
SQL, Python, Spark, ADF, Databricks, dbt, Airflow, Azure
2w
Save
Mark Applied
Hide
Databricks Developer
Raleigh, North Carolina, United States
$100k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
4+ YOEBachelor in computer science,4+ years experience; expertise with Databricks,Spark/PySpark,Delta Lake,AI/ML,cloud platforms,SQL and Python; strong communication and problem-solving.
Databricks, Spark, PySpark, Delta Lake, Agent Bricks, Unity Catalog, AWS, Azure, GCP, Microsoft Power BI, Tableau, SQL, Python
1mo
Save
Mark Applied
Hide
Data Engineer Senior Principal (Hybrid)
Fort Bragg, North Carolina, United States
$145k-$196k/yr HybridFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
10+ YOEU.S. citizen with current DoW Secret clearance, 10+ years related experience, Master’s in computer science preferred, expertise in AWS/Azure, SQL, Python, big data (Presto/Trino, Hive, Spark, Flink), data lake/warehouse architecture, ETL/ELT, workflow engines (Airflow, AWS Step Functions, Prefect), Kubernetes, Linux/Unix/Windows.
Amazon Web Services (AWS), Microsoft Azure, SQL, S3, Python, Presto, Trino, Hive, Spark, Flink, Airflow, AWS Step Functions, Prefect, Kubernetes, Linux, Unix, Windows, Power BI, Splunk, ELK, TAK
3mo
Save
Mark Applied
Hide
Databricks Engineer
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, Auto Loader, Airflow, dbt, Great Expectations, Collibra, Apache Spark, Presto, Amazon EMR, Amazon Redshift, Snowflake, Google BigQuery, SQL, Stored Procedures, Java, Python, PySpark, Databricks Asset Bundles, Terraform, NoSQL Databases, Container Management Systems, GitHub Copilot, Codex, Claude, Cursor, Windsurf
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Discovery Recommendations
Cary, North Carolina, United States
OnsiteFull Time
Epic Games
Epic Games: Develops video games and licenses the Unreal game engine.
3-5+ years in production recommendation or ranking systems; Python, PyTorch, Spark; cloud experience; NLP/vision familiarity; strong problem solving.
Python, PyTorch, Spark, AWS, Databricks, Ray, Transformers, TorchRec
2mo
Save
Mark Applied
Hide
Machine Learning Engineer
Raleigh, North Carolina, United States
OnsiteFull Time
Vadum
Vadum: Develops advanced electronic warfare and defense research solutions.
5+ YOEBachelor’s in CS/CE or related field; 5+ years; government security clearance or ability to obtain; Python, C/C++, MATLAB; PyTorch/TF/Scikit-Learn; Windows/Linux; Docker/Jenkins/Git/Gerrit/Hibernate/Kubernetes; Kafka/Spark/Hadoop; strong communication and problem-solving.
Python, C/C++, MATLAB, PyTorch, TensorFlow, Scikit-Learn, Docker, Jenkins, Git, Gerrit, Hibernate, Kubernetes, Kafka, Spark, Hadoop, Windows, Linux
3mo
Save
Mark Applied
Hide
Data Engineer
Cary, North Carolina, United States
$90k-$150k/yr HybridFull Time
GEI Consultants
GEI Consultants: Provides multi-disciplinary engineering and environmental consulting services.
4+ YOE4+ years data engineering; Python/SQL; Azure data services; data governance; CI/CD; Databricks a plus.
Python, SQL, PySpark, Spark, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Azure AI Search, Cosmos DB, Databricks, Delta Lake, Unity Catalog, Terraform, Azure DevOps, Power BI
21h
Save
Mark Applied
Hide
Senior Data Engineer
Raleigh or North Carolina or Arizona or Texas or Florida
RemoteFull Time
First Citizens Bank
First Citizens BankNasdaq: FCNCA: Provides full-service consumer, commercial, and wealth management banking.
4+ YOEBachelor's+4 years or HS+8 years in data engineering or related; advanced experience with cloud data platforms, Snowflake, ETL/ELT, dbt, Python, SQL; strong analytical and communication skills.
AWS, Azure, GCP, Snowflake, Spark, Python, SQL, dbt, Apache Airflow, Astronomer, DataStage, SAP BODS, SSIS, Informatica, Kafka, Amazon Kinesis, Apache Flink, Qlik Replicate, Snow pipe Streaming, Tableau, Power BI
1w
Save
Mark Applied
Hide
Senior Software Engineer
United States or Raleigh
RemoteFull Time
DomainTools
DomainTools: Provides DNS-based threat intelligence and domain investigation solutions.
5+ YOE5+ years professional development experience (Python, GoLang, Rust), 3+ years cloud (AWS, Docker, Kubernetes) and web-scale data engineering, Kafka, Linux/Unix, strong communication and cross-team coordination.
Python, GoLang, Rust, AWS, Docker, Kubernetes, OpenSearch, Postgres, CockroachDB, Spark, Kafka, Linux/Unix, ElasticSearch, NATS, Apache Airflow, Bash, Scala, C, Hive
2w
Save
Mark Applied
Hide
Principal Software Engineer
Fulton or Research Triangle Park
$223k-$295k/yr HybridFull Time
Cisco
CiscoNASDAQ: CSCO: Develops and sells networking hardware and cybersecurity software.
15+ YOECharter vision and architecture for search and analytics, mentor senior engineers, design data platform and orchestration solutions; requires extensive systems design experience and hands-on AWS,C++,Go,SQL expertise.
AWS, C++, Go, SQL, Spark, Splunk
2d
Save
Mark Applied
Hide
Forward Deployed Engineer
Lafayette or Bloomfield or Raleigh
$72k-$141k/yr HybridFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
7+ YOE7+ years software engineering experience; cloud (AWS/Azure/GCP), computer vision & deep learning, Python, ML model training/deployment, PoC→MVP scaling, MLOps, and enterprise architecture collaboration.
AWS, Azure, GCP, Amazon Web Services Cloud, Google Cloud Platform, PyTorch, TensorFlow, OpenCV, Python, CUDA, Docker, Kubernetes, Spark, Databricks, MLflow, Kubeflow, SageMaker, SageMaker Pipelines, Azure ML, Vertex AI
1mo
Save
Mark Applied
Hide
Data Engineer - Bilingual Mandarin required
Cary or United States
$90k-$130k/yr HybridFull Time
CWILL
CWILL: Unified AI-driven commerce platform for Shopify DTC brands.
1+ YOE1+ years data engineering experience with strong SQL, Python or Java, data ingestion/pipeline and data warehouse skills; ability to work with modern pipeline and warehouse tools; US work authorization required.
SQL, Python, Java, Git, SeaTunnel, Kafka, Flink, Spark, Doris, ClickHouse, Snowflake, BigQuery, Redshift, Databricks, PostgreSQL, DolphinScheduler, StreamPark, Airflow, Dagster, Prefect, dbt, DataHub, Superset, AWS, GCP, Azure, Docker, CI/CD, Terraform, Kubernetes, LLMs
1mo
Save
Mark Applied
Hide
Data Engineer Senior Principal (Hybrid)
Fort Bragg, North Carolina, United States
$145k-$196k/yr HybridFull Time
GDIT
GDITNYSE: GD: Delivers IT and mission services to government agencies.
10+ YOE10+ years experience designing cloud-based data architectures; strong SQL, Python, AWS/Azure, big data, ETL/ELT and workflow engine experience; current DoW Secret clearance and U.S. citizenship required; Master’s degree in CS or related.
Amazon Web Services (AWS), Microsoft Azure, SQL, S3, Python, Presto, Trino, Hive, Spark, Flink, Airflow, AWS Step Functions, Prefect, Linux, UNIX, Windows, Kubernetes, PowerBI, Splunk, ELK, TAK
3mo
Save
Mark Applied
Hide
Senior Algorithm Developer - PySpark / SQL (Durham, NC, US)
Durham, North Carolina, United States
OnsiteFull Time
ACA Group
ACA Group: Regulatory compliance and risk management solutions for financial services.
5+ YOE3+ years PySpark/Python in production; 5+ years SQL; Spark ecosystem; AWS; CI/CD; Git/JIRA; agile teams.
PySpark, Python, SQL, Apache Spark, AWS, Git, JIRA, CI/CD, Iceberg, EMR, S3, CloudWatch