HiringCafe
Join our community

16 spark engineer jobs at 15 companies in South Carolina

1w
Save
Mark Applied
Hide
Senior Data Engineer
California or Colorado or Connecticut or Florida or Georgia or Kentucky or Massachusetts or Michigan or New York or New Jersey or North Carolina or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Washington or Peachtree Corners
RemoteFull Time
Digital Envoy
Digital Envoy: Private U.S. technology providing IP geolocation, VPN intelligence, and online authentication data to businesses.
7+ YOERequires 7+ years of data engineering experience, 4+ years with Spark, strong Python and advanced SQL skills, Airflow familiarity, AWS data engineering experience, communication skills, and a bachelor's degree in a technical field.
Spark, Python, SQL, AWS EMR, Airflow, Tableau, PostGIS, Amazon S3, Amazon Athena, Scala, Snowflake
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
K&L Gates
K&L Gates: Global law firm providing corporate, regulatory, litigation, and policy services to companies, public entities, institutions, and individuals.
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Colorado Springs or Fort Carson or Charleston or Denver or San Diego
$110k-$180k/yr OnsiteFull Time
The Marlin Alliance
The Marlin Alliance: Woman-owned digital transformation and business consulting firm serving government, military, and commercial clients.
U.S. citizen with active Top Secret clearance; strong Python and ML experience; experience with distributed systems, cloud-native development, containerization, GIS, and DevOps; able to work aboard Navy vessels.
Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, AWS Lambda, Dask, Spark, AWS S3, RDS, EFS, SNS, SQS, AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, ArcGIS, PostGIS, Docker, Kubernetes, Python, Git, Java, C++, Go, Rust, GitHub Actions, GitLab CI, Jenkins, TensorFlow, PyTorch, scikit-learn, AWS, Azure
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Development Ops Engineer
Fort Mill, South Carolina, United States
$99k-$136k/yr OnsiteFull Time
Sunbelt Rentals
Sunbelt RentalsNew York Stock Exchange (NYSE) and London Stock Exchange (LSE): SUNB: Provider of equipment rental and onsite solutions for industry.
3+ YOEBachelor's in CS or related plus 3+ years DevOps experience. Experience with CI/CD, Kubernetes, cloud (Azure/AWS/GCP), automation (Terraform/Ansible/Chef), containers, databases, monitoring, and one or more programming languages.
Kubernetes, Kafka, Spark, HDFS, Azure, AWS, GCP, Jenkins, Terraform, Artifactory, Maven, Cloudformation, Chef, Puppet, Ansible, Salt Stack, Shell scripting, Docker, Apache, Nginx, Tomcat, HAProxy, Atlassian suite, GIT, Open Shift, OpenShift, uDeploy, Selenium, SQL Server, MongoDB, MYSQL, Cassandra, Couchbase, Oracle, Dynatrace, Sumo Logic, ELK, Splunk, C++, Microsoft .Net/C#, Ruby, Python, Go, Java, JavaScript/Node.JS, React
Job PostingView all
1mo
Save
Mark Applied
Hide
MarTech LiveRamp Clean Room engineer (Habu) - Onsite Charlotte, NC
Atlanta or Chicago or Columbia or New York City or Charlotte
$100k-$130k/yr HybridFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Global leader in consulting, digital transformation, and engineering services.
5+ YOE5–7 years in data engineering/marketing technology, 2+ years with LiveRamp/Habu clean room, strong SQL, Python/Spark, cloud pipeline experience, and familiarity with privacy-safe aggregation and identity resolution.
LiveRamp Clean Room (Habu), InfoSum, AWS Clean Rooms, Google Ads Data Hub, SQL, Python, Spark, GCP, AWS, Azure
Job PostingView all
3d
Save
Mark Applied
Hide
Senior Machine Learning Engineer
United States or Alabama or Arkansas or Delaware or Florida or Georgia or Illinois or Iowa or Indiana or Kansas or Kentucky or Louisiana or Massachusetts or Maine or Michigan or Minnesota or Missouri or Mississippi or North Carolina or Nebraska or New Hampshire or Ohio or Oklahoma or Pennsylvania or Rhode Island or South Carolina or South Dakota or Tennessee or Texas or Vermont or Virginia or Wisconsin or West Virginia
RemoteFull Time
Revecore
Revecore: Private U.S. revenue cycle management firm helping hospitals recover underpayments, denials, and complex claims revenue.
Bachelor's degree in a data-centric field, machine learning or data science experience, production model deployment experience, and strong Python and scikit-learn skills. NLP, Spark, and cloud ML experience are advantageous.
Python, scikit-learn, TensorFlow, PyTorch, Natural Language Processing (NLP), Hugging Face, Spark, AWS, GCP, Azure
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Archimedes
Archimedes: Privately held specialty drug management serving employers, health plans, and health systems.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
Job PostingView all
3w
Save
Mark Applied
Hide
Director, Data Engineering
Florida or Montana or Michigan or Massachusetts or Rhode Island or West Virginia or Oregon or Oklahoma or Minnesota or New York or South Carolina or Kentucky or Virginia or Colorado or New Jersey or Wisconsin or Utah or Pennsylvania or Ohio or North Carolina or Nebraska or Mississippi or South Dakota or Maryland or Louisiana or Kansas or Iowa or Illinois or Tennessee or Delaware or Connecticut or California or Hawaii or Arkansas or District of Columbia or Georgia or Missouri or Arizona or Alabama or New Hampshire or Texas or Vermont or Indiana or Washington or Nevada or Idaho or New Mexico or Maine
$195k-$210k/yr RemoteFull Time
AmeriLife
AmeriLife: National leader in developing, marketing and distributing insurance solutions.
10+ YOE5+ MgmtBachelor's degree,10+ years data engineering,5+ years leading teams,expert Databricks/Spark/Python/PySpark/SQL,Databricks platform and Unity Catalog experience,CI/CD and IaC familiarity,strong leadership and stakeholder skills.
Databricks Lakehouse Platform, Databricks, Unity Catalog, Delta Live Tables (Lakeflow), Delta Lake, Apache Spark, SQL, Python, PySpark, Databricks Workflows, Git, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineering Lead
Charleston, South Carolina, United States
OnsiteFull Time
DXC Technology
DXC TechnologyNYSE: DXC: Global provider of IT services, consulting, and business process outsourcing.
10+ YOE3+ Mgmt10+ years in data engineering or architecture,3+ years leading teams,BS in CS/IS/Engineering/Data Science required,experience with cloud data platforms,SQL,Python,Spark,Databricks/Snowflake,strong leadership and governance skills.
SQL, Python, Spark, Scala, ETL, ELT, Azure, AWS, Google Cloud, Databricks, Snowflake, Synapse, Redshift, BigQuery, API, CI/CD, DataOps, Infrastructure-as-Code
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or Florida or South Carolina or Pennsylvania or Arizona or Iowa or Indiana or Nebraska or Texas or Alabama or Georgia or North Carolina or Tennessee or Michigan or Alaska or Hawaii or Puerto Rico
$125k-$150k/yr RemoteFull Time
Akumin
Akumin: Nationwide provider of outpatient radiology and oncology services.
5+ YOEBachelor's in data-related field, 5+ years in data management/ETL/ELT/data warehousing, strong SQL/T-SQL, Python or JavaScript, experience with dbt/Fivetran and cloud platforms (GCP/AWS/Azure), data modeling and governance, regulated-domain experience.
SQL, T-SQL, Python, JavaScript, Fivetran, dbt, GCP, AWS, Azure, BigQuery, S3, Snowflake, Kafka, Hadoop, Spark, Docker, Kubernetes, FHIR, EHR, DICOM, ICD, CPT
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer (OpAI)
Fort Carson or Colorado Springs or Charleston or Denver or San Diego
$110k-$180k/yr OnsiteFull Time
The Marlin Alliance
The Marlin Alliance: Woman-owned digital transformation and business consulting firm serving government, military, and commercial clients.
10+ YOEU.S. citizen with active TS clearance, 10+ years relevant experience, strong Python/Go/Rust/SQL skills, experience with data pipelines, event streaming, cloud-native data services, GIS, and secure DoD environments.
CSV, JSON, XML, Parquet, ORC, Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, AWS Lambda, Dask, Spark, AWS S3, RDS, EFS, SNS, SQS, AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, ArcGIS, PostGIS, Docker, Kubernetes, Elasticsearch, Redis, PostgreSQL, Python, Go, Rust, Pandas, R, SQL
Job PostingView all
3d
Save
Mark Applied
Hide
Data Engineer, AI Support
Richburg, South Carolina, United States
HybridFull Time
Insurance Institute for Business & Home Safety
Insurance Institute for Business & Home Safety: Independent nonprofit scientific research and communications organization serving property insurers and helping owners reduce natural-hazard losses.
Bachelor’s degree in a quantitative field, ETL pipeline experience, strong Python, SQL/NoSQL, AI/ML dataset preparation, data quality, workflow orchestration, Linux, and technical communication skills.
Python, SQL, NoSQL, Linux, Bash, Weights & Biases, Langfuse, GitHub Actions, GitLab CI, Terraform, Azure, AWS, Google Cloud, Airflow, Prefect, Dagster, Spark, Label Studio, Prodigy
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Software Engineer in Test (Sr. SDET)
Seattle or Illinois or Washington or Idaho or Oregon or Florida or Ohio or South Carolina or Texas or North Carolina
$97k-$162k/yr HybridFull Time
PEMCO Mutual Insurance
PEMCO Mutual Insurance: Seattle-based mutual personal-lines insurer serving Washington and Oregon residents with auto, home, renters, boat, and pet coverage.
5+ YOEBachelor's degree or equivalent experience; 5+ years in quality engineering or test automation; 3+ years testing data platforms and property and casualty insurance domains; advanced SQL and programming experience required.
Databricks, Snowflake, Spark, Hadoop, Hive, Amazon EMR, BigQuery, SQL Server, Delta Lake, GitHub Actions, Azure DevOps, Jenkins, Python, PySpark, Java, Scala, JavaScript, TypeScript, GitHub Copilot, SQL, API
Job PostingView all
1mo
Save
Mark Applied
Hide
Platform Delivery & Reliability Engineer (Remote) - 29337
Colorado Springs or Columbia or San Antonio or Boise or Greenville or Augusta
$120k-$195k/yr RemoteFull Time
Mission Technologies
Mission TechnologiesNYSE: HII: Defense technology division delivering integrated all-domain solutions to defense, federal, and commercial customers.
7+ YOEMust obtain U.S. security clearance; 7+ years' relevant experience (varies by degree); deep Kubernetes, IaC, cloud, CI/CD, scripting, SRE practices, troubleshooting and delivery experience across distributed systems.
Kubernetes, Terraform, AWS, Azure, GCP, GitLab CI, Go, Python, Bash, Spark, Trino, Presto, Kafka, NiFi, Iceberg, Delta, Hudi, YouTrack, Nexus
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Architect
Alabama or Arizona or California or Colorado or Connecticut or Florida or Georgia or Illinois or Iowa or Kentucky or Maryland or Massachusetts or Michigan or Minnesota or Missouri or New Jersey or New York or North Carolina or Ohio or Pennsylvania or South Carolina or Tennessee or Texas or Utah
$100k-$200k/yr RemoteFull Time
RegEd
RegEd: Private RegTech software provider serving financial-services firms with compliance, credentialing, education, licensing, and registration solutions.
10+ YOEBachelor's in CS/Data Science,10+ years data engineering/development experience,expertise in data modeling,warehousing,and integrations,experience with Databricks,Azure/AWS,Big Data and governance tools.
Databricks, Azure Data Lake Storage Gen2, Unity Catalog, Azure Data Factory, Microsoft Purview, Hadoop, Spark, AWS, Azure, Phyton, R, SQL
Job PostingView all
2mo
Save
Mark Applied
Hide
Manager III, Software Development - Content Data Platform
Austin or Bozeman or Denver or Minneapolis or Missoula or Portland or Salt Lake City or Seattle or Charlotte or Kalispell or Boise or Charleston or Dallas or Fort Worth or Phoenix or Richmond or Spokane or Vermont
$150k-$188k/yr RemoteFull Time
onX
onX: Private outdoor-navigation software serving hunters, hikers, anglers, skiers, climbers, and off-roaders.
5+ Mgmt5+ years managing software engineers; experience building data platform/infrastructure and migration off legacy systems; hiring and team development skills; experience with data quality, SLOs, and operational reliability; US work authorization required; ability to travel.
GCP, Managed Spark, BigQuery, BigLake, Pub/Sub, Managed Airflow, Apache Iceberg, Spark, PySpark, DuckDB, dbt, Airflow, GDAL, PostGIS, Apache Sedona, DuckDB spatial extensions, Knowledge Graph, AI-assisted tools
Job PostingView all

Explore Jobs

Expand Your Job Search