96 spark data engineer jobs at 53 companies in Lilburn, GA
3mo
Save
Mark Applied
Hide
MID-LEVEL DATA ENGINEER-Python, AWS, Spark (Hybrid)
Bloomington or Richardson or Tempe or Dunwoody
HybridFull Time
2+ YOE2-4 years as a Data Engineer; proficiency in Python, Spark SQL/PySpark, R, Java, Bash; hands-on AWS (ETL tools, Lambda, Step Functions, S3, DynamoDB, Kinesis, Redshift, SageMaker); Spark/Databricks; IaC (OpenTofu); CI/CD with Airflow.
Python, Apache Spark, PySpark, R, Java, Bash, AWS, Glue, EMR Serverless, Lambda, Step Functions, EventBridge, S3, DynamoDB, Kinesis Firehose, Redshift, Iceberg, SageMaker, Databricks, OpenTofu, Terraform, Airflow, SQL, Athena
3w
Save
Mark Applied
Hide
Data Engineer
Atlanta or New York City
$116k-$145k/yr HybridFull Time
3+ YOE3+ years in data or software engineering with strong SQL, Python/Java/Scala, Databricks, Airflow, dbt, Spark, Kafka, and cloud (AWS/GCP/Azure) experience.
Python, SQL, Spark, Databricks, Airflow, dbt, Kafka, Java, Scala, AWS, GCP, Azure
2mo
Save
Mark Applied
Hide
Sr Data Engineer
Johns Creek, Georgia, United States
HybridFull Time
4+ YOEMaster's degree in Information Systems or related field and 4 years of data engineering experience, including AWS, Spark, data lakes, warehousing, modeling, SQL, and Python.
AWS, AWS Lambda, AWS DynamoDB, AWS Neptune, Datadog, AWS CloudWatch, Spark, Ganglia, Log4J, Spark UI, Snowflake, AWS Athena, Hadoop, Hive, Presto, YARN, SQL, Python
3d
Save
Mark Applied
Hide
Data Engineer Lead
San Antonio or Beavercreek or Houston or Charlotte or Huntsville or Atlanta
$92k-$153k/yr OnsiteFull Time
7+ YOEBachelor's degree in a technical field, 7+ years of data or software engineering experience, technical leadership, Python, SQL, Spark/PySpark, cloud platforms, data pipelines, ETL/ELT, CI/CD, Docker, and Kubernetes.
Python, SQL, Spark, PySpark, AWS, Azure, Databricks, Snowflake, Docker, Kubernetes, Terraform, CloudFormation, Bicep, ARM, Kafka, Event Hub, Kinesis, Splunk, Datadog, CloudWatch, Kibana, Elasticsearch
1w
Save
Mark Applied
Hide
Data Engineer/Scientist
Atlanta, Georgia, United States
$80k-$176k/yr HybridFull Time
3+ YOERequires 3 years of data engineering and analysis experience, with Python, SQL, Spark, Databricks, AWS, machine learning, statistical testing, feature engineering, data modeling, and strong communication skills.
Databricks, Python, SQL, Spark, AWS, Tableau, Amazon S3, AWS Glue, AWS Lambda, Amazon Athena, AWS Step Functions, Pandas, NumPy, scikit-learn, Matplotlib, Seaborn, Plotly, Delta Lake
1mo
Save
Mark Applied
Hide
Data Engineer Sr
Atlanta, Georgia, United States
OnsiteFull Time
8+ YOESenior data engineer with strong T-SQL and Python skills, ETL/ELT tooling (SSIS, Azure Data Factory), big data (Spark, Hadoop, Kafka), cloud experience (AWS, Microsoft Azure, GCP), and 6–8+ years of experience or equivalent education.
ETL/ELT, T-SQL, Python, SSIS, Microsoft Azure Data Factory, Spark, Hadoop, Kafka, AWS, Microsoft Azure, GCP, SQL, NoSQL
2mo
Save
Mark Applied
Hide
Sr Data Engineer
Johns Creek, Georgia, United States
HybridFull Time
4+ YOEMaster’s in Information Systems or related field; 4 years data engineering experience; extensive AWS, Spark, SQL, Python; 3 years Snowflake + AWS Athena; 1 year Hadoop/Hive/Presto.
AWS Lambda, AWS DynamoDB, AWS Neptune, Datadog, CloudWatch, Spark, Hadoop, Hive, Presto, YARN, Snowflake, AWS Athena, Python, SQL
4d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1mo
Save
Mark Applied
Hide
Data Engineer (Remote Opportunity)
Washington or Arlington or Austin or Atlanta or United States
RemoteFull Time
4+ YOEBachelor's degree, 4+ years data engineering experience; proficiency with Python, Spark, SQL, ETL, Azure Synapse, Azure Data Factory, Power BI, GitHub, and Jira; experience with federal healthcare/VA programs and ability to obtain Public Trust.
Azure Synapse, Azure Data Factory, Power BI, Python, Spark, SQL, GitHub, Microsoft Word, Microsoft Excel, Microsoft PowerPoint, Microsoft Visio, Jira, CX Insights, Lighthouse APIs, Medallia, Azure
18h
Save
Mark Applied
Hide
Associate Data Engineer, AWS Hybrid
Atlanta, Georgia, United States
$91k-$119k/yr HybridFull Time
5+ YOERequires 5+ years in Big Data engineering, processing, and analytics; proficiency with Hadoop, Spark, Kafka, Flink, Hive, cloud platforms, programming, ETL, data modeling, SQL, and distributed computing.
Hadoop, Spark, Kafka, Flink, Hive, AWS, GCP, Azure, Java, Scala, Python, SQL, Docker, Kubernetes
1d
Save
Mark Applied
Hide
Associate Data Engineer, AWS Hybrid
Atlanta, Georgia, United States
$91k-$119k/yr HybridFull Time
5+ YOERequires 5+ years in Big Data engineering, proficiency with Hadoop, Spark, Kafka, Flink, Hive, cloud platforms, Java, Scala, Python, SQL, data modeling, ETL, and distributed computing.
Hadoop, Spark, Kafka, Flink, Hive, AWS, GCP, Azure, Java, Scala, Python, SQL, NoSQL, Docker, Kubernetes
3d
Save
Mark Applied
Hide
Data Engineer - Databricks
Chicago or Indianapolis or Fort Wayne or Columbus or Lansing or Denver or Dallas or Atlanta
RemoteFull Time
2+ YOEBachelor's degree or equivalent, 2+ years of production data engineering experience, Databricks, PySpark, Spark SQL, Delta Lake, SQL, cloud data services, data modeling, and strong client communication skills.
Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables (DLT), Auto Loader, Structured Streaming, Databricks Workflows, Airflow, Azure Data Factory, Unity Catalog, MLflow, Photon, Git, Azure DevOps, GitHub Actions, GitLab, Terraform, dbt, Kafka, Event Hubs, Power BI, Tableau, Docker, Kubernetes, SQL Server, Postgres, Oracle, Snowflake, Azure, AWS, GCP
4d
Save
Mark Applied
Hide
Data Engineer
Atlanta or Washington
$87k-$198k/yr OnsiteFull Time
3+ YOEBachelor’s degree and 3+ years with PySpark, SQL, and Azure Databricks; data engineering, analytics, technical collaboration, public health data, and Public Trust eligibility required.
PySpark, SQL, Azure Databricks, R, Scala, Java, AWS, Azure, GCP, Spark, Databricks, Hadoop, Hive, EMR, Kafka, Redshift, MySQL, Snowflake, FHIR, EHR, ETL, ELT
2mo
Save
Mark Applied
Hide
Azure Data Engineer (Telecommunications)
Frisco or Bellevue or Atlanta
OnsiteContract
4+ YOESQL advanced + transformation + optimization; Python (PySpark) data processing; Databricks/Spark; Delta Lake; dbt; Azure + Snowflake; 4+ years in data engineering.
Azure, Snowflake, Databricks, Python, PySpark, SQL, dbt, Delta Lake, Git, CI/CD
3d
Save
Mark Applied
Hide
Data Engineer
Atlanta, Georgia, United States
$87k-$198k/yr HybridFull Time
3+ YOEBachelor's degree and 3+ years of PySpark, SQL, and Azure Databricks experience; requires data engineering, analytics, cross-functional collaboration, and ability to obtain Public Trust eligibility.
PySpark, SQL, Azure Databricks, R, Scala, Java, AWS, Azure, GCP, Spark, Databricks, Hadoop, Hive, EMR, Kafka, Redshift, MySQL, Snowflake, FHIR, EHR, ETL, ELT
1w
Save
Mark Applied
Hide
Data Engineer
Atlanta, Georgia, United States
OnsiteFull Time
2+ YOEMinimum 2 years relevant experience; design, build and maintain streaming and batch data pipelines; familiarity with cloud platforms, data architectures, ingestion, governance, modeling, and DevOps; strong SQL and programming skills.
Kafka, AWS Glue, Iceberg, Parquet, Flink, Spark, Spark UI, dbt, Airflow, Python, Java, Scala, SQL, AWS, GCP, Azure
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Atlanta, Georgia, United States
HybridFull Time
8+ YOE8+ years data engineering; 2+ years in lead role; medallion lakehouse; Spark/PySpark on Azure Databricks; real-time IoT pipelines; Kafka/Event Hub; cloud data lakes/warehouses; GenAI pipelines; MLOps; CI/CD with GitHub Actions.
Azure Databricks, PySpark, Apache Spark Streaming, Apache Kafka, Azure Event Hub, LangChain, LangGraph, GitHub Actions, CI/CD, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Data Platform Engineer
Atlanta or Orlando or United States
RemoteFull Time
Expertise with graph databases and entity resolution, API and schema design, building scalable data pipelines on AWS, proficiency in Python/Java/Go/Rust, experience with Spark/Flink, Kafka/Kinesis, Airflow, and DevOps tools (Docker, Kubernetes, Terraform).
Neo4j, AWS Neptune, TigerGraph, Cypher, Gremlin, Senzing, Quantexa, GraphQL, REST, Python, Java, Go, Rust, AWS, Spark, Flink, Kafka, Kinesis, Airflow, Snowflake, Redshift, BigQuery, Databricks, CI/CD, Docker, Kubernetes, Terraform
2d
Save
Mark Applied
Hide
Senior Data Engineer
Atlanta, Georgia, United States
$154k/yr RemoteFull Time
5+ YOEBachelor's degree in computer science, computer engineering, information technology, or related field and 5 years of software development or related experience; cloud, big data, database, scripting, and scheduling expertise required.
Spark, HDFS, Sqoop, Hive, Impala, Oozie, Flume, Kafka, StreamSets, DMXSynch Sort, Splunk, Python, NumPy, pandas, Matplotlib, scikit-learn, Denodo, R, AWS, Microsoft Azure, Databricks, Snowflake, Teradata, Oracle, DB2, SQL Server, Unix Shell Scripting, PL/SQL, Control-M, CIS Task Scheduler, IBM Tivoli Workstation
1mo
Save
Mark Applied
Hide
Senior Cybersecurity Data Engineer
Columbus or Frisco or Berkeley Heights or Alpharetta or New Jersey or New York or United States
$109k-$182k/yr OnsiteFull Time
10+ YOE10+ years IT experience (5+ years Big Data), 5+ years building data transformation/pipeline processes, SQL and BigQuery proficiency, experience with Talend/Cribl/Spark/Kafka/PostgreSQL/AlloyDB, bachelor’s in CS/IT or equivalent military experience, and valid unrestricted U.S. work authorization.
Talend, BigQuery, SQL, Cribl, Spark, IBM Streams, Kafka, PostgreSQL, AlloyDB, NoSQL
Explore Jobs