HiringCafe
Join our community

68 spark data engineer jobs at 50 companies in Brookhaven, GA

2mo
Save
Mark Applied
Hide
MID-LEVEL DATA ENGINEER-Python, AWS, Spark (Hybrid)
Bloomington or Richardson or Tempe or Dunwoody
HybridFull Time
State Farm
State Farm: Provider of auto, home, life, and health insurance.
2+ YOE2-4 years as a Data Engineer; proficiency in Python, Spark SQL/PySpark, R, Java, Bash; hands-on AWS (ETL tools, Lambda, Step Functions, S3, DynamoDB, Kinesis, Redshift, SageMaker); Spark/Databricks; IaC (OpenTofu); CI/CD with Airflow.
Python, Apache Spark, PySpark, R, Java, Bash, AWS, Glue, EMR Serverless, Lambda, Step Functions, EventBridge, S3, DynamoDB, Kinesis Firehose, Redshift, Iceberg, SageMaker, Databricks, OpenTofu, Terraform, Airflow, SQL, Athena
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Atlanta or New York City
$116k-$145k/yr HybridFull Time
FanDuel
FanDuelNYSE: FLUT: Offers online sports betting and daily fantasy sports services.
3+ YOE3+ years in data or software engineering with strong SQL, Python/Java/Scala, Databricks, Airflow, dbt, Spark, Kafka, and cloud (AWS/GCP/Azure) experience.
Python, SQL, Spark, Databricks, Airflow, dbt, Kafka, Java, Scala, AWS, GCP, Azure
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Atlanta, Georgia, United States
OnsiteFull Time
Cargill
Cargill: Produces and distributes food, agricultural, and industrial products globally.
2+ YOEMinimum 2 years relevant experience; design, build, and maintain data systems and pipelines; proficiency with cloud platforms, streaming and batch ingestion, Spark, SQL, Python/Java/Scala, DevOps, and data governance.
AWS, GCP, Azure, Kafka, AWS Glue, Iceberg, Parquet, Flink, Spark, Spark UI, SQL, dbt, Airflow, Python, Java, Scala, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer Sr
Atlanta, Georgia, United States
OnsiteFull Time
Beazer Homes
Beazer HomesNYSE: BZH: Designs and builds energy-efficient single-family homes.
8+ YOESenior data engineer with strong T-SQL and Python skills, ETL/ELT tooling (SSIS, Azure Data Factory), big data (Spark, Hadoop, Kafka), cloud experience (AWS, Microsoft Azure, GCP), and 6–8+ years of experience or equivalent education.
ETL/ELT, T-SQL, Python, SSIS, Microsoft Azure Data Factory, Spark, Hadoop, Kafka, AWS, Microsoft Azure, GCP, SQL, NoSQL
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr Data Engineer
Johns Creek, Georgia, United States
HybridFull Time
BeyondTrust
BeyondTrust: Provides identity security and privileged access management software.
4+ YOEMaster’s in Information Systems or related field; 4 years data engineering experience; extensive AWS, Spark, SQL, Python; 3 years Snowflake + AWS Athena; 1 year Hadoop/Hive/Presto.
AWS Lambda, AWS DynamoDB, AWS Neptune, Datadog, CloudWatch, Spark, Hadoop, Hive, Presto, YARN, Snowflake, AWS Athena, Python, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer III
Atlanta, Georgia, United States
OnsiteFull Time
HNTB
HNTB: Infrastructure design and engineering for transportation and public works
4+ YOEExperience building production data pipelines with SQL and Python, cloud data services, big data tech (Spark, Hadoop, Kafka), orchestration (Airflow, Luigi), and data quality tools (dbt, Great Expectations).
SQL, Python, Spark, Hadoop, Kafka, Airflow, Luigi, dbt, Great Expectations, Tableau, Microsoft Power BI, AWS, Microsoft Azure, GCP
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer (Remote Opportunity)
Washington or Arlington or Austin or Atlanta or United States
RemoteFull Time
VetsEZ
VetsEZ: Digital transformation and healthcare IT services for government agencies.
4+ YOEBachelor's degree, 4+ years data engineering experience; proficiency with Python, Spark, SQL, ETL, Azure Synapse, Azure Data Factory, Power BI, GitHub, and Jira; experience with federal healthcare/VA programs and ability to obtain Public Trust.
Azure Synapse, Azure Data Factory, Power BI, Python, Spark, SQL, GitHub, Microsoft Word, Microsoft Excel, Microsoft PowerPoint, Microsoft Visio, Jira, CX Insights, Lighthouse APIs, Medallia, Azure
Job PostingView all
2mo
Save
Mark Applied
Hide
Azure Data Engineer (Telecommunications)
Frisco or Bellevue or Atlanta
OnsiteContract
Appex Innovation
Appex Innovation: Provides AI-driven software solutions for healthcare revenue and management.
4+ YOESQL advanced + transformation + optimization; Python (PySpark) data processing; Databricks/Spark; Delta Lake; dbt; Azure + Snowflake; 4+ years in data engineering.
Azure, Snowflake, Databricks, Python, PySpark, SQL, dbt, Delta Lake, Git, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Washington
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
3+ YOE3+ years data warehouse development, 3+ years cloud-based aggregated data analysis, 2+ years building/maintaining scalable data stores; SQL and Python proficiency; ETL/ELT and data pipeline experience; Bachelor's degree; ability to obtain Public Trust/Suitability.
SQL, Python, AWS Glue, AWS Athena, Postgres, Cloudera, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake, UNIX, Linux, Shell scripting
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Washington
$78k-$176k/yr HybridFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
3+ YOEBachelor's degree and 3+ years in data warehouse development, cloud-based data analysis, and scalable data store development; strong SQL and Python skills; ability to obtain Public Trust clearance.
SQL, Python, AWS Glue, AWS Athena, Postgres, Cloudera, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake, UNIX, Linux, Shell scripting
Job PostingView all
1d
Save
Mark Applied
Hide
Data Engineer
Cartersville, Georgia, United States
OnsiteFull Time
Qcells
Qcells: Provider of solar modules, energy storage, and EPC services.
2+ YOESupport manufacturing data pipelines: extract, integrate, maintain ETL scripts, develop visualizations, troubleshoot data quality; bachelor's in quantitative field and 2+ years relevant experience.
Oracle, Microsoft SQL, MySQL, Spotfire, Tableau, Power BI, Hadoop, Spark, Kafka, AWS, Azure, GCP
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Atlanta, Georgia, United States
HybridFull Time
Honeywell
HoneywellNASDAQ: HON: Manufactures aerospace products, building technologies, and industrial control systems.
8+ YOE8+ years data engineering; 2+ years in lead role; medallion lakehouse; Spark/PySpark on Azure Databricks; real-time IoT pipelines; Kafka/Event Hub; cloud data lakes/warehouses; GenAI pipelines; MLOps; CI/CD with GitHub Actions.
Azure Databricks, PySpark, Apache Spark Streaming, Apache Kafka, Azure Event Hub, LangChain, LangGraph, GitHub Actions, CI/CD, Docker, Kubernetes
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Platform Engineer
Atlanta or Orlando or United States
RemoteFull Time
Worth AI
Worth AI: Automating business underwriting and onboarding for financial institutions.
Expertise with graph databases and entity resolution, API and schema design, building scalable data pipelines on AWS, proficiency in Python/Java/Go/Rust, experience with Spark/Flink, Kafka/Kinesis, Airflow, and DevOps tools (Docker, Kubernetes, Terraform).
Neo4j, AWS Neptune, TigerGraph, Cypher, Gremlin, Senzing, Quantexa, GraphQL, REST, Python, Java, Go, Rust, AWS, Spark, Flink, Kafka, Kinesis, Airflow, Snowflake, Redshift, BigQuery, Databricks, CI/CD, Docker, Kubernetes, Terraform
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Cybersecurity Data Engineer
Columbus or Frisco or Berkeley Heights or Alpharetta or New Jersey or New York or United States
$109k-$182k/yr OnsiteFull Time
Fiserv
FiservNew York Stock Exchange: FI: Provides financial technology and payment processing services to institutions.
10+ YOE10+ years IT experience (5+ years Big Data), 5+ years building data transformation/pipeline processes, SQL and BigQuery proficiency, experience with Talend/Cribl/Spark/Kafka/PostgreSQL/AlloyDB, bachelor’s in CS/IT or equivalent military experience, and valid unrestricted U.S. work authorization.
Talend, BigQuery, SQL, Cribl, Spark, IBM Streams, Kafka, PostgreSQL, AlloyDB, NoSQL
Job PostingView all
3w
Save
Mark Applied
Hide
Data Platform Engineer
Hyderabad or Ghent or Atlanta or London
HybridFull Time
Itineris
Itineris: Develops software solutions for energy and water utility companies.
5+ YOE5+ years in data infrastructure/platform engineering. Deep Apache Spark, lakehouse (Iceberg/Delta), storage design, CDC/replication, SQL. Proficient Python, containerized apps (Docker/Kubernetes), observability and IaC/GitOps experience.
Apache Iceberg, Polaris, Apache Spark, Delta, Kafka, Event Hubs, IoT Hub, SQL, Python, Docker, Kubernetes, Argo CD, Helm, Bicep, Cosmos DB, MongoDB, GitOps, Microsoft Dynamics 365
Job PostingView all
3w
Save
Mark Applied
Hide
Data Quality Engineer
Alpharetta or Birmingham or Chicago or Downers Grove or Jacksonville or Connecticut or New Jersey or Ohio or Pennsylvania or Rhode Island or Virginia
$99k-$165k/yr HybridFull Time
Kemper
KemperNYSE: KMPR: Provides specialized auto, life, and health insurance services.
6+ YOE6+ years data engineering/testing experience; Bachelor's in CS/Info Systems or equivalent; expertise with SQL, Informatica/IICS/IDMC, Snowflake, Oracle, AWS, Python; strong data validation, reconciliation, and test automation skills.
SQL, Informatica, IICS, IDMC, Snowflake, Python, Oracle, AWS, XML, JSON, Power BI, PowerShell, Git, Spark, Kafka, Airflow, DBT, CI/CD, Infrastructure as Code
Job PostingView all
1w
Save
Mark Applied
Hide
Lead Data Engineer
Atlanta, Georgia, United States
HybridFull Time
Koch Inc.
Koch Inc.: Operates global manufacturing, refining, and industrial technology businesses.
Senior technical leader with experience designing, building, and operating large-scale data platforms, proficiency with IaC, Git and CI/CD, and experience with Databricks and enterprise data lakes.
Python, SQL, Spark, Delta Lake, Hudi, Iceberg, Terraform, Git, CI/CD, Airflow, Step Functions, Databricks Declarative Pipelines, Databricks, Lambda, Glue, EventBridge, ECS, Kafka
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Team Lead)
Atlanta, Georgia, United States
HybridFull Time
Neighborly Software
Neighborly Software: Cloud-based platform for administering government-funded community programs.
4+ YOE4+ years data engineering experience with data warehouse technologies (Snowflake, Azure Synapse or Redshift), SQL, Python, ETL/ELT, data pipeline development, BI tools (Power BI/Tableau), and strong communication skills.
Snowflake, Azure Data Factory, Azure-SQL, SnowSQL, Snowpipe, Kafka, Databricks, Kafka Connect, Python, C#, SQL, Power BI, Tableau, Azure Synapse, AWS Redshift, Spark, Logic Apps, Power Apps, Azure DevOps, JIRA, Confluence
Job PostingView all
3d
Save
Mark Applied
Hide
Sr Data Engineer I - Global Commercial Services
Atlanta, Georgia, United States
$123k-$215k/yr HybridFull Time
American Express
American ExpressNYSE: AXP: Global financial services and credit card payment network.
10+ YOE10+ years mainframe experience (Cobol, DB2, JCL, VSAM, etc.), 5+ years Scala/Python/Spark/PL-SQL, experience with Oracle/MS SQL/MaprDB/BigQuery, bachelor’s in CS or engineering.
Cobol, DB2, VSAM, DB2 Utilities, JCL, SORT, TSO, DASD, Expeditor, File-Aid, Control-M, Topaz-ISPW, XLR, scala, python, spark, PL-SQL, Oracle, MS SQL, MaprDB, BigQuery, Google Cloud, Jira, Rally, Microsoft Copilot, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
AI Data Engineer
Palo Alto or Atlanta or Washington
$160k-$200k/yr HybridFull Time
Quantifind
Quantifind: AI-driven platform for financial risk and fraud detection.
4+ YOEUS citizen with 4+ years' experience, technical education, strong Python and AWS skills, experience with large-scale ETL, Spark/PySpark, PostgreSQL/RDS, Neo4j, and hands-on AI coding tools; must be able to meet in person.
Claude Code, GPT/Codex, Cursor, Windsurf, PostgreSQL, RDS, Python, Spark/PySpark, Scala, AWS, Neo4j
Job PostingView all

Explore Jobs

Expand Your Job Search