92 spark data engineer jobs at 60 companies in Duluth, GA
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
AXIS CapitalNew York Stock Exchange: AXS: Global provider of specialty lines insurance and reinsurance.
5+ YOE5+ years data engineering; 3+ years Databricks/Delta Lake; strong Azure data platform; Spark/PySpark/SQL; Medallion/Lakehouse; data governance; security/CI/CD/IaC; MLOps; communication.
Azure Databricks, Delta Lake, ADF, Azure Synapse, Event Hubs, Azure Functions, Azure Data Lake Storage Gen2, Azure Key Vault, DevOps, Spark, PySpark, SQL, MLflow, Unity Catalog, Bicep, Terraform, ARM templates, Copilot, GenAI, Power BI
FanDuelNYSE: FLUT: Offers online sports betting and daily fantasy sports services.
3+ YOE3+ years in data or software engineering with strong SQL, Python/Java/Scala, Databricks, Airflow, dbt, Spark, Kafka, and cloud (AWS/GCP/Azure) experience.
4+ YOEBachelor's degree,4+ years data engineering experience,expertise in Python,SQL,Scala,Spark,Databricks and Azure,experience with data platform architecture,AI/GenAI pipelines,mentoring and governance.
Beazer HomesNYSE: BZH: Designs and builds energy-efficient single-family homes.
8+ YOESenior data engineer with strong T-SQL and Python skills, ETL/ELT tooling (SSIS, Azure Data Factory), big data (Spark, Hadoop, Kafka), cloud experience (AWS, Microsoft Azure, GCP), and 6–8+ years of experience or equivalent education.
ETL/ELT, T-SQL, Python, SSIS, Microsoft Azure Data Factory, Spark, Hadoop, Kafka, AWS, Microsoft Azure, GCP, SQL, NoSQL
BeyondTrust: Provides identity security and privileged access management software.
4+ YOEMaster’s in Information Systems or related field; 4 years data engineering experience; extensive AWS, Spark, SQL, Python; 3 years Snowflake + AWS Athena; 1 year Hadoop/Hive/Presto.
HNTB: Infrastructure design and engineering for transportation and public works
4+ YOEExperience building production data pipelines with SQL and Python, cloud data services, big data tech (Spark, Hadoop, Kafka), orchestration (Airflow, Luigi), and data quality tools (dbt, Great Expectations).
SQL, Python, Spark, Hadoop, Kafka, Airflow, Luigi, dbt, Great Expectations, Tableau, Microsoft Power BI, AWS, Microsoft Azure, GCP
Washington or Arlington or Austin or Atlanta or United States
RemoteFull Time
VetsEZ: Digital transformation and healthcare IT services for government agencies.
4+ YOEBachelor's degree, 4+ years data engineering experience; proficiency with Python, Spark, SQL, ETL, Azure Synapse, Azure Data Factory, Power BI, GitHub, and Jira; experience with federal healthcare/VA programs and ability to obtain Public Trust.
Azure Synapse, Azure Data Factory, Power BI, Python, Spark, SQL, GitHub, Microsoft Word, Microsoft Excel, Microsoft PowerPoint, Microsoft Visio, Jira, CX Insights, Lighthouse APIs, Medallia, Azure
4+ YOE4+ years data engineering experience, expertise in Python/SQL/Scala and distributed systems (Spark, Delta Lake), Databricks and Azure, experience with containerization, CI/CD, data governance and AI/GenAI pipelines.
Databricks, Delta Lake, Unity Catalog, Databricks Workflows, Databricks Mosaic AI, Python, SQL, Scala, Apache Spark, Azure Cloud, Azure Monitor, Log Analytics, Docker, Kubernetes, CI/CD, Pinecone, Weaviate, Azure AI Search, Kafka, Event Hubs, Spark Structured Streaming, LangChain, Terraform, ARM templates, Bicep, Power BI, Feature Store
Santa Barbara or Atlanta or Chicago or Agoura Hills
HybridFull Time
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
3+ YOE3+ years data engineering experience with Python, SQL, cloud data platforms (Databricks,AWS,Snowflake,Google Cloud); familiarity with AI/automation tools and modern lakehouse architectures.
Python, PySpark, SQL, Spark, Claude Code, Codex, GitHub Copilot, Databricks Genie, Databricks, AWS, Snowflake, Google Cloud, SFTP, APIs
Santa Barbara or Atlanta or Chicago or Agoura Hills
HybridFull Time
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
3+ YOE3–5 years in data/analytics engineering, strong SQL and Python, experience with Databricks/AWS/Snowflake/Google Cloud, familiarity with AI-assisted development and data ingestion frameworks.
Databricks, AWS, Snowflake, Google Cloud, GitHub Copilot, Claude Code, Codex, Databricks Genie, Python, PySpark, SQL, Spark, SFTP, APIs, CI/CD
Scientific Games: Provides technology and games for government-regulated lottery programs
7+ YOE7+ years data engineering experience; strong SQL and data modeling; experience with batch/streaming ingestion, ETL/ELT, orchestration, data contracts, lineage, observability, cloud platforms, and cross-functional collaboration.
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
3+ YOE3+ years data warehouse development, 3+ years cloud-based aggregated data analysis, 2+ years building/maintaining scalable data stores; SQL and Python proficiency; ETL/ELT and data pipeline experience; Bachelor's degree; ability to obtain Public Trust/Suitability.
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
3+ YOEBachelor's degree and 3+ years in data warehouse development, cloud-based data analysis, and scalable data store development; strong SQL and Python skills; ability to obtain Public Trust clearance.
Alpharetta or Birmingham or Chicago or Dallas or Jacksonville or Downers Grove or St. Louis or Richardson or Virginia or Connecticut or Ohio or Pennsylvania or Maryland or Rhode Island
$99k-$165k/yrHybridFull Time
KemperNYSE: KMPR: Provides specialized auto, life, and health insurance services.
8+ YOE8+ years data engineering experience with 2+ years in senior/lead/architect capacity; deep Snowflake and AWS expertise; Data Vault 2.0, ETL/ELT, SQL, Python, Informatica experience; bachelor’s degree or equivalent.
Snowflake, AWS, Python, Spark, Informatica PowerCenter, Informatica IDMC, AWS Glue, Data Vault 2.0, Control M, Pentaho, SQL, Snowpark, GitHub Actions, GitLab CI, Azure DevOps, Terraform, CloudFormation, Great Expectations, Monte Carlo, Datafold, Soda, Alation, Collibra, Kafka, Kinesis, MSK, Guidewire PolicyCenter, Guidewire ClaimCenter, Guidewire BillingCenter, Datadog, CloudWatch
PrizePicks: Operates a daily fantasy sports and player prediction platform.
Bachelor's degree or equivalent experience; proficiency in Python and SQL; experience with cloud (GCP/AWS/Azure), data pipelines, orchestration tools, and modern data tooling; strong communication and ownership mindset.
PBK: Provides architectural and engineering design for specialized facilities.
5+ YOE5+ years building and operating production data pipelines and integrations; strong SQL (PostgreSQL) and Python; experience with Azure and Microsoft Fabric, APIs/integrations, ETL/ELT, data governance, CI/CD, and stakeholder communication.
Salesforce, Deltek Vantagepoint, Autodesk, Autodesk Forma, Azure, Microsoft Fabric, Microsoft Fabric Data Pipelines, Microsoft Fabric notebooks, REST, JSON, SOAP, webhooks, Azure Data Factory, Azure Logic Apps, Azure Functions, Spark notebooks, Spark, dbt, Event Grid, Service Bus, Kafka, PostgreSQL, Python, GitHub Enterprise, Azure DevOps, Microsoft 365, MuleSoft, Databricks, Databricks Workflows/Jobs, Snowflake, Airflow, Microsoft Power BI