54 spark data engineer jobs at 28 companies in Smithfield, NC

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Raleigh or United States
$216k/yr RemoteFull Time
Teamworks
Teamworks: Software platform streamlining operations and performance for sports organizations.
10+ YOE10+ years data engineering experience, strong Python, lakehouse and processing engine expertise (Delta Lake/Iceberg/Hudi, Spark/Databricks/Trino/Snowflake), expert AWS (S3, IAM, Glue, EMR, Lambda), Terraform, data modeling, governance, and leadership/mentoring skills.
Python, Delta Lake, Iceberg, Hudi, Spark, Databricks, Trino, Snowflake, AWS, S3, IAM, Glue, EMR, Lambda, Terraform, Claude, Cursor
3w
Save
Mark Applied
Hide
Principal Data Engineer
Durham, North Carolina, United States
OnsiteFull Time
Fidelity Investments
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
3+ YOEBachelor's in CS/Engineering/IT/IS + 5 years, or Master’s + 3 years; expertise in data warehouse/BI, cloud (AWS, Snowflake), ETL, CI/CD, Python/Spark, Oracle/PLSQL, Informatica, control-m and observability tools.
Jenkins, Stash, Concourse, Artifactory, Oracle SQL, PL/SQL, Snowflake, Amazon Web Services (AWS), Python, Spark, Informatica, Informatica Data Quality IDQ, Address doctor, Docker Container, Hive, Impala, Kafka, Scala, Spark SQL, Alation, Collibra, JUnit, JMeter, Datadog, Control-M, Jenkinscore, Terracore, Bitbucket, GitHub
1w
Save
Mark Applied
Hide
Principal Data Engineer - Semantic Layer
Cary or Tampa or New York City or Bridgewater
$130k-$189k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
10+ YOE10+ years in data engineering/architecture with 3+ years in semantic layer/ontology engineering; expertise with OWL/RDF/SPARQL, cloud data platforms, SQL/NoSQL, Python, and Spark; Bachelor's degree required.
OWL, RDF, SPARQL, Stardog, Timbr.ai, AtScale, dbt Semantic Layer, Databricks, Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, Delta Lake, Power BI, Cognos Analytics, JDBC, ODBC, MDX, DAX, REST, GraphQL, Collibra, SQL, NoSQL, Python, Spark, Cypher, HermiT, Pellet, RDFox, Apache Jena, GraphDB, Amazon Neptune
3mo
Save
Mark Applied
Hide
Data Engineer
Cary, North Carolina, United States
$90k-$150k/yr HybridFull Time
GEI Consultants
GEI Consultants: Provides multi-disciplinary engineering and environmental consulting services.
4+ YOE4+ years data engineering; Python/SQL; Azure data services; data governance; CI/CD; Databricks a plus.
Python, SQL, PySpark, Spark, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Azure AI Search, Cosmos DB, Databricks, Delta Lake, Unity Catalog, Terraform, Azure DevOps, Power BI
1w
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
Peter Millar
Peter MillarSIX Swiss Exchange: CFR: Designs and sells luxury lifestyle apparel and performance sportswear.
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
3d
Save
Mark Applied
Hide
U.S. Data Engineer
Research Triangle Park, North Carolina, United States
OnsiteFull Time
Grifols
GrifolsMadrid Stock Exchange: GRF: Develops plasma-derived medicines and clinical diagnostic solutions.
5+ YOEDesign and build ETL/ELT pipelines using SQL, Python and Spark; 5+ years related experience; project/technical leadership; Bachelor’s degree or equivalent; strong debugging and data quality skills.
SQL, Python, Spark, ADF, Databricks, dbt, Airflow, Azure
2w
Save
Mark Applied
Hide
Principal Data Engineer - Remote
Raleigh or Minneapolis or Washington or United States
$113k-$193k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
8+ YOE8+ years in analytics/data engineering, 6+ years Databricks (Spark, SQL, Python) experience, 5+ years cloud (Azure/GCP/AWS), 4+ years Power BI (DAX/Power Query), and experience delivering enterprise analytics and AI solutions.
Databricks, Spark, SQL, Python, Microsoft Power BI, DAX, Power Query, Azure, GCP, AWS, AI
4w
Save
Mark Applied
Hide
Data Engineer Senior Principal (Hybrid)
Fort Bragg, North Carolina, United States
$145k-$196k/yr HybridFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
10+ YOEU.S. citizen with current DoW Secret clearance, 10+ years related experience, Master’s in computer science preferred, expertise in AWS/Azure, SQL, Python, big data (Presto/Trino, Hive, Spark, Flink), data lake/warehouse architecture, ETL/ELT, workflow engines (Airflow, AWS Step Functions, Prefect), Kubernetes, Linux/Unix/Windows.
Amazon Web Services (AWS), Microsoft Azure, SQL, S3, Python, Presto, Trino, Hive, Spark, Flink, Airflow, AWS Step Functions, Prefect, Kubernetes, Linux, Unix, Windows, Power BI, Splunk, ELK, TAK
1mo
Save
Mark Applied
Hide
Data Engineer - Bilingual Mandarin required
Cary or United States
$90k-$130k/yr HybridFull Time
CWILL
CWILL: Unified AI-driven commerce platform for Shopify DTC brands.
1+ YOE1+ years data engineering experience with strong SQL, Python or Java, data ingestion/pipeline and data warehouse skills; ability to work with modern pipeline and warehouse tools; US work authorization required.
SQL, Python, Java, Git, SeaTunnel, Kafka, Flink, Spark, Doris, ClickHouse, Snowflake, BigQuery, Redshift, Databricks, PostgreSQL, DolphinScheduler, StreamPark, Airflow, Dagster, Prefect, dbt, DataHub, Superset, AWS, GCP, Azure, Docker, CI/CD, Terraform, Kubernetes, LLMs
4w
Save
Mark Applied
Hide
Data Engineer Senior Principal (Hybrid)
Fort Bragg, North Carolina, United States
$145k-$196k/yr HybridFull Time
GDIT
GDITNYSE: GD: Delivers IT and mission services to government agencies.
10+ YOE10+ years experience designing cloud-based data architectures; strong SQL, Python, AWS/Azure, big data, ETL/ELT and workflow engine experience; current DoW Secret clearance and U.S. citizenship required; Master’s degree in CS or related.
Amazon Web Services (AWS), Microsoft Azure, SQL, S3, Python, Presto, Trino, Hive, Spark, Flink, Airflow, AWS Step Functions, Prefect, Linux, UNIX, Windows, Kubernetes, PowerBI, Splunk, ELK, TAK
3mo
Save
Mark Applied
Hide
Analytics Engineer
Bethesda or Chapel Hill
RemoteFull Time
HelioCampus
HelioCampus: Data analytics and performance management platform for higher education.
2+ YOE2–4 years in analytics engineering or data engineering; bachelor’s or master’s in CS, data analytics, information systems, or related; Python, SQL, Scala, or Java; relational and/or NoSQL DBs; ETL/ELT pipelines; Spark/Hadoop; BI tools (Tableau, Power BI, Looker); strong problem solving and communication; collaborative.
Python, SQL, Scala, Java, Spark, Hadoop, Tableau, Power BI, Looker, dbt
2mo
Save
Mark Applied
Hide
Manager, Data Science
Raleigh, North Carolina, United States
HybridFull Time
McGough
McGough: General contractor providing construction management and facility development services.
6+ YOEBachelor’s in Data Science/Statistics/Mathematics/Engineering; 6–10+ years in data science; proven modeling experience; strong Python; leadership; Git; strong business communication.
Python, Git, SQL, Pandas, Scikit-learn, TensorFlow, Spark
2mo
Save
Mark Applied
Hide
Databricks Engineer
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, Auto Loader, Airflow, dbt, Great Expectations, Collibra, Apache Spark, Presto, Amazon EMR, Amazon Redshift, Snowflake, Google BigQuery, SQL, Stored Procedures, Java, Python, PySpark, Databricks Asset Bundles, Terraform, NoSQL Databases, Container Management Systems, GitHub Copilot, Codex, Claude, Cursor, Windsurf
3w
Save
Mark Applied
Hide
Sr. Data Platform Architect
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yr HybridFull Time
Nutanix
NutanixNASDAQ: NTNX: Sells cloud software and hyperconverged infrastructure for enterprises.
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
SQL, Apache Spark, ETL/ELT, Kubernetes, Trino, Dremio, Informatica, CI/CD
1w
Save
Mark Applied
Hide
Databricks Lead
Raleigh, North Carolina, United States
$100k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years data engineering experience, 3–5 years with Databricks/Spark, strong SQL, ETL, data modeling, performance tuning, Python/Scala proficiency, and strong communication skills.
Databricks, Apache Spark, PySpark, SQL, Python, Scala, Azure, Power BI, Delta Lake, MLflow, Model Serving, LLM, RAG
3w
Save
Mark Applied
Hide
Kite Data & Integration Lead - Sales & Digital
Raleigh or Foster City
$146k-$219k/yr HybridFull Time
Gilead Sciences
Gilead SciencesNASDAQ: GILD: Develops and sells medicines for life-threatening infectious diseases.
6+ YOEBachelor's +8 years or Master's +6 years experience; product ownership for AI/data products; experience with data engineering, model lifecycle, production monitoring, and commercial analytics integrations.
Python, SQL, TypeScript, JavaScript, Go, Rust, GitHub Actions, Docker, Databricks, Spark, Airflow, Tableau, Genie Spaces, Claude Code, GitHub Copilot, Cursor, Cortex AI, Model Context Protocol (MCP), IQVIA, Veeva CRM, MMIT, Model N, Salesforce, Microsoft 365, ServiceNow
1d
Save
Mark Applied
Hide
Technical Solutions Engineer - Pre
Dallas or Mountain View or Raleigh or San Bruno
$104k-$156k/yr HybridFull Time
Verily
Verily: Developing data-driven technologies for clinical research and precision health.
6+ YOEBA/BS or equivalent,6+ years in healthcare technology/data engineering/solutions engineering,cloud and coding proficiency,healthcare data standards experience,customer-facing implementation skills.
Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure, Python, Golang, Terraform, YAML, SQL, Epic, Cerner, Allscripts, FHIR, HL7, CCD/C-CDA, ICD, SNOMED, LOINC, BigQuery, Snowflake, Databricks, Spark
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Discovery Recommendations
Cary, North Carolina, United States
OnsiteFull Time
Epic Games
Epic Games: Develops video games and licenses the Unreal game engine.
3-5+ years in production recommendation or ranking systems; Python, PyTorch, Spark; cloud experience; NLP/vision familiarity; strong problem solving.
Python, PyTorch, Spark, AWS, Databricks, Ray, Transformers, TorchRec
2w
Save
Mark Applied
Hide
Senior Delivery Consultant - Data , Professional Services, AWSI HCLS
Boston or Jersey City or Arlington or New York or Denver or Chicago or Mountain View or Raleigh
$154k-$239k/yr HybridFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
5+ YOE5+ years cloud architecture and data engineering experience; bachelor's degree or 7+ years experience; hands-on production data pipeline and platform implementation; experience with modern data platform patterns and ontologies; familiarity with HCLS compliance.
Amazon SageMaker Lakehouse, SageMaker Unified Studio, Amazon S3 Tables, Amazon Redshift, AWS Context, Amazon Bedrock Knowledge Bases, Apache Iceberg, Spark, Databricks, Snowflake, Kafka, AWS Glue Data Catalog, Collibra, Alation
1w
Save
Mark Applied
Hide
Technology Consultant 2
Bentonville or Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Hands-on GCP, BigQuery, GCS, Apache Spark, Scala/Python, Airflow, and advanced SQL skills; experience implementing CI/CD; bachelor’s degree or equivalent experience; U.S. work authorization required.
GCP, BigQuery, Google Cloud Storage (GCS), Scala, Python, Apache Spark, Apache Airflow, SQL, CI/CD, Power BI