54 spark data engineer jobs at 28 companies in Smithfield, NC
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
3+ YOEBachelor's in CS/Engineering/IT/IS + 5 years, or Master’s + 3 years; expertise in data warehouse/BI, cloud (AWS, Snowflake), ETL, CI/CD, Python/Spark, Oracle/PLSQL, Informatica, control-m and observability tools.
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
10+ YOE10+ years in data engineering/architecture with 3+ years in semantic layer/ontology engineering; expertise with OWL/RDF/SPARQL, cloud data platforms, SQL/NoSQL, Python, and Spark; Bachelor's degree required.
GEI Consultants: Provides multi-disciplinary engineering and environmental consulting services.
4+ YOE4+ years data engineering; Python/SQL; Azure data services; data governance; CI/CD; Databricks a plus.
Python, SQL, PySpark, Spark, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Azure AI Search, Cosmos DB, Databricks, Delta Lake, Unity Catalog, Terraform, Azure DevOps, Power BI
Peter MillarSIX Swiss Exchange: CFR: Designs and sells luxury lifestyle apparel and performance sportswear.
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
5+ YOEDesign and build ETL/ELT pipelines using SQL, Python and Spark; 5+ years related experience; project/technical leadership; Bachelor’s degree or equivalent; strong debugging and data quality skills.
Raleigh or Minneapolis or Washington or United States
$113k-$193k/yrRemoteFull Time
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
8+ YOE8+ years in analytics/data engineering, 6+ years Databricks (Spark, SQL, Python) experience, 5+ years cloud (Azure/GCP/AWS), 4+ years Power BI (DAX/Power Query), and experience delivering enterprise analytics and AI solutions.
Databricks, Spark, SQL, Python, Microsoft Power BI, DAX, Power Query, Azure, GCP, AWS, AI
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
10+ YOEU.S. citizen with current DoW Secret clearance, 10+ years related experience, Master’s in computer science preferred, expertise in AWS/Azure, SQL, Python, big data (Presto/Trino, Hive, Spark, Flink), data lake/warehouse architecture, ETL/ELT, workflow engines (Airflow, AWS Step Functions, Prefect), Kubernetes, Linux/Unix/Windows.
Amazon Web Services (AWS), Microsoft Azure, SQL, S3, Python, Presto, Trino, Hive, Spark, Flink, Airflow, AWS Step Functions, Prefect, Kubernetes, Linux, Unix, Windows, Power BI, Splunk, ELK, TAK
CWILL: Unified AI-driven commerce platform for Shopify DTC brands.
1+ YOE1+ years data engineering experience with strong SQL, Python or Java, data ingestion/pipeline and data warehouse skills; ability to work with modern pipeline and warehouse tools; US work authorization required.
GDITNYSE: GD: Delivers IT and mission services to government agencies.
10+ YOE10+ years experience designing cloud-based data architectures; strong SQL, Python, AWS/Azure, big data, ETL/ELT and workflow engine experience; current DoW Secret clearance and U.S. citizenship required; Master’s degree in CS or related.
Amazon Web Services (AWS), Microsoft Azure, SQL, S3, Python, Presto, Trino, Hive, Spark, Flink, Airflow, AWS Step Functions, Prefect, Linux, UNIX, Windows, Kubernetes, PowerBI, Splunk, ELK, TAK
HelioCampus: Data analytics and performance management platform for higher education.
2+ YOE2–4 years in analytics engineering or data engineering; bachelor’s or master’s in CS, data analytics, information systems, or related; Python, SQL, Scala, or Java; relational and/or NoSQL DBs; ETL/ELT pipelines; Spark/Hadoop; BI tools (Tableau, Power BI, Looker); strong problem solving and communication; collaborative.
McGough: General contractor providing construction management and facility development services.
6+ YOEBachelor’s in Data Science/Statistics/Mathematics/Engineering; 6–10+ years in data science; proven modeling experience; strong Python; leadership; Git; strong business communication.
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yrOnsiteFull Time
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
San Jose or Durham or Mexico City or Bengaluru or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$179k-$299k/yrHybridFull Time
NutanixNASDAQ: NTNX: Sells cloud software and hyperconverged infrastructure for enterprises.
12+ YOE12+ years in data architecture/engineering with 5+ years on large-scale data platforms; expertise in SQL, Apache Spark, Kubernetes, Trino, Dremio, Informatica, CI/CD, security controls, and cloud platforms; Bachelor's required, advanced degree preferred.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years data engineering experience, 3–5 years with Databricks/Spark, strong SQL, ETL, data modeling, performance tuning, Python/Scala proficiency, and strong communication skills.
Databricks, Apache Spark, PySpark, SQL, Python, Scala, Azure, Power BI, Delta Lake, MLflow, Model Serving, LLM, RAG
Gilead SciencesNASDAQ: GILD: Develops and sells medicines for life-threatening infectious diseases.
6+ YOEBachelor's +8 years or Master's +6 years experience; product ownership for AI/data products; experience with data engineering, model lifecycle, production monitoring, and commercial analytics integrations.
Python, SQL, TypeScript, JavaScript, Go, Rust, GitHub Actions, Docker, Databricks, Spark, Airflow, Tableau, Genie Spaces, Claude Code, GitHub Copilot, Cursor, Cortex AI, Model Context Protocol (MCP), IQVIA, Veeva CRM, MMIT, Model N, Salesforce, Microsoft 365, ServiceNow
Verily: Developing data-driven technologies for clinical research and precision health.
6+ YOEBA/BS or equivalent,6+ years in healthcare technology/data engineering/solutions engineering,cloud and coding proficiency,healthcare data standards experience,customer-facing implementation skills.
Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure, Python, Golang, Terraform, YAML, SQL, Epic, Cerner, Allscripts, FHIR, HL7, CCD/C-CDA, ICD, SNOMED, LOINC, BigQuery, Snowflake, Databricks, Spark
Senior Delivery Consultant - Data , Professional Services, AWSI HCLS
Boston or Jersey City or Arlington or New York or Denver or Chicago or Mountain View or Raleigh
$154k-$239k/yrHybridFull Time
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
5+ YOE5+ years cloud architecture and data engineering experience; bachelor's degree or 7+ years experience; hands-on production data pipeline and platform implementation; experience with modern data platform patterns and ontologies; familiarity with HCLS compliance.