36 spark data engineer jobs at 17 companies in Ballwin, MO

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
2mo
Save
Mark Applied
Hide
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yr OnsiteFull Time
Absolute Business Solutions Corp
Absolute Business Solutions Corp: Provides technology and intelligence services to the US government.
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
Apache Spark, PySpark, Scala, Delta Lake, Parquet, Structured Streaming, Kubernetes, Docker, S3, AWS, GCP, Azure, Git, Jenkins, Python, Bash, Terraform, Iceberg
1w
Save
Mark Applied
Hide
Data Engineer
Carmel or St. Louis
HybridFull Time
CleanSlate Technology Group
CleanSlate Technology Group: Provides cloud-native software development and IT modernization services.
2+ YOE2+ years building data engineering or data platform solutions; experience with Python/Java/Scala, SQL, Spark/Databricks/Snowflake/Redshift/Azure Fabric/AWS Glue/Azure Data Factory, and AWS or Azure; strong collaboration and communication skills.
Python, Java, Scala, SQL, Spark, Databricks, Snowflake, Redshift, Azure Fabric, AWS Glue, Azure Data Factory, AWS, Azure, CI/CD, infrastructure-as-code, Claude Code, Cursor, Kiro, NoSQL
1d
Save
Mark Applied
Hide
Data Engineer
St Louis, Missouri, United States
HybridFull Time
Build-A-Bear
Build-A-BearNYSE: BBW: Sells customizable stuffed animals and provides interactive retail experiences.
5+ YOE5+ years data engineering experience, bachelor’s in CS/IS/data engineering, skilled in SQL, Python, Spark, cloud data platforms (Microsoft Azure), ETL/ELT design, API integrations, and data modeling.
SQL, Python, Spark, Microsoft Azure, Data Factory, Synapse, Databricks, Data Lake, Power PI, Tableau, Looker, Microsoft Dynamics 365, Salesforce
2w
Save
Mark Applied
Hide
Staff Data Engineer
Beavercreek or Dayton or St. Louis or United States
OnsiteFull Time
Awetomaton
Awetomaton: Develops software for satellite intelligence and geospatial data analysis.
5+ YOEBS degree, 5+ years experience, DoD Top Secret clearance required, proficiency with Python, SQL, Spark, orchestration tools (Airflow, Dagster, Argo Workflow), data modeling, cloud-native deployment, and strong communication skills.
Python, SQL, Spark, Airflow, Dagster, Argo Workflow, Kubernetes
2mo
Save
Mark Applied
Hide
Data Engineer
O'Fallon, Illinois, United States
OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
2+ YOE2+ years in programming (C++, Java, Python); experience with scalable data stores, ETL/ELT, and processing structured/unstructured data; secret clearance; bachelor’s degree.
C++, Java, Python, SQL, Scala, Spark, Databricks, Hadoop, Kafka, Unix/Linux, AWS, Azure, Snowflake, MongoDB, Cassandra
1mo
Save
Mark Applied
Hide
Data Engineer
O'Fallon, Illinois, United States
OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
2+ YOE2+ years in programming (C++, Java, or Python); experience with scalable data stores and ETL/ELT; data integration and processing; TS/SCI with polygraph; Bachelor's degree.
Python, Java, C++, SQL, Spark, Hadoop, Kafka, Snowflake, AWS, Azure, Databricks, Hive, ETL, Big Data
1mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Navitus Health Solutions
Navitus Health Solutions: Transparent pharmacy benefit management and specialty pharmacy provider.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
1mo
Save
Mark Applied
Hide
Data Engineer Software Developer
Scott AFB, Illinois, United States
$99k-$106k/yr OnsiteFull Time
I2X Technologies
I2X Technologies: Provides mission-critical engineering, cybersecurity, and IT services to government agencies.
4+ YOEUS citizen with active Secret clearance, Bachelor's in CS/Engineering, 4+ years experience building data pipelines, proficiency with Kafka/Elastic/AWS/OpenShift, Python/Java/SQL, Linux, CI/CD, and ability to work onsite at Scott AFB.
Confluent Kafka, Elastic Stack, AWS, Red Hat OpenShift, Kubernetes, Kafka, Elastic, Logstash, Kibana, React, JavaScript, HTML, AWS Redshift, S3, Hadoop, Snowflake, Python, Java, SQL, shell scripting, Elasticsearch, Spark, NiFi, Databricks, ELK Stack, Azure, GCP, AWS GovCloud, Ansible, Puppet, Chef, Prometheus, Grafana, Git, Bitbucket, Atlassian JIRA, Confluence, CI/CD
2w
Save
Mark Applied
Hide
Data Engineer AMC Level Two
Scott Air Force Base, Illinois, United States
$80k-$100k/yr HybridFull Time
Small Business Consulting Corporation
Small Business Consulting Corporation: Defense consulting firm specializing in military technology integration and procurement.
3+ YOEUS citizen able to obtain a U.S. security clearance; Bachelor\u0002s in a related field; 3+ years in data engineering/data science; strong Python and SQL skills; experience with cloud platforms and big data tools.
Python, SQL, R, AWS, Microsoft Azure, GCP, Spark, Databricks, Hadoop
2w
Save
Mark Applied
Hide
Data Engineer 3 (Mid-Level, Data Product Implementation and Architecture)
Scott Air Force Base, Illinois, United States
OnsiteFull Time
UNCOMN
UNCOMN: A technology delivering secure data integration and systems solutions for public and private sector clients.
5+ YOEActive Secret clearance required, 5+ years in data engineering or systems integration, experience building secure APIs, data pipelines, orchestration, and enterprise security controls; proficiency with three or more listed technologies.
RESTful APIs, Python, Java, SQL, Spark, Databricks, Palantir Foundry, API gateways, Microservices, AWS, Azure, Google Cloud Platform (GCP)
2w
Save
Mark Applied
Hide
Financial Data Engineer
Clayton, Missouri, United States
HybridFull Time
Equifax
EquifaxNew York Stock Exchange: EFX: Provides consumer credit reporting and data analytics services globally.
5+ YOEBachelor's in a quantitative field; 5+ years building, loading, transforming and analyzing data; 5+ years with GCP; scripting/coding experience; proficiency with Python, SQL, BigQuery, Airflow/Cloud Composer; ETL and data modeling experience.
GCP, Python, Airflow, Cloud Composer, Jenkins, Astronomer, Spark, BigQuery, SQL, ETL, Tableau, Looker, Spotfire, ML, AI, RPA
1mo
Save
Mark Applied
Hide
IT Principal Data Engineering
Saint Ann, Missouri, United States
$96k-$160k/yr OnsiteFull Time
Save A Lot
Save A Lot: Operates discount grocery stores and provides wholesale food distribution.
7+ YOE7+ years experience or bachelor’s in CS/engineering/math; proven data engineering and ML platform experience with Databricks/Snowflake/Spark, cloud (AWS/Azure/GCP), Python/SQL, ML frameworks and MLOps; strong architecture and stakeholder skills.
Databricks, Snowflake, Spark, APIs, FTP, BigQuery, Teradata, Azure Synapse, AWS, Azure, GCP, Python, SQL, Power BI, scikit-learn, XGBoost, PyTorch, TensorFlow, MLflow
3w
Save
Mark Applied
Hide
Senior Principal, Data Engineering
Arlington or O'Fallon
$212k-$390k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Design, build, and operate enterprise-scale cloud-native data platforms across AWS and Azure; hands-on Spark/PySpark and Python experience; Infrastructure-as-Code and CI/CD; strong cloud security and data governance expertise.
AWS S3, Amazon EC2, AWS Lambda, AWS Glue, Amazon Redshift, Amazon EMR, Amazon Athena, AWS Lake Formation, Databricks, Azure Data Factory, Azure Synapse, Azure Fabric, Azure Data Lake, Terraform, CloudFormation, Bicep/ARM, Azure DevOps, GitLab CI/CD, Spark, PySpark, Python, Bash, PowerShell, Docker, Kubernetes, ECS, AKS, CloudWatch, Azure Monitor, ELK, Grafana
2mo
Save
Mark Applied
Hide
Data Platform Architect
Florissant, Missouri, United States
OnsiteFull Time
Augustine Institute
Augustine Institute: Provides Catholic theological education and media for faith formation.
7+ YOE7+ years in data engineering/architecture; experience designing lakehouse/data warehouse architectures at scale; Databricks, Spark, Delta Lake; ETL/ELT with dbt/Airflow; data governance; legacy modernization; BI tools; AI/ML data patterns
Databricks, Apache Spark, Delta Lake, dbt, Airflow
1mo
Save
Mark Applied
Hide
Senior Developer
Scott Air Force Base or St. Louis
OnsiteFull Time
D&G Solutions
D&G Solutions: A small business that provides data and technology solutions in support of defense and government customers, emphasizing people-first culture and mission focus.
5+ YOEBachelor's in CS/data field, 5+ years in data engineering or software development, active Secret clearance with TS/SCI eligibility, strong SQL and Python, experience with Spark, Kafka, cloud platforms, and data integration.
SQL, Python, Apache Spark, Kafka, Databricks, Palantir Ontology, Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform, Maven Smart Systems, RESTful web services
1w
Save
Mark Applied
Hide
Staff Software Engineer, Data
Creve Coeur or Chicago or Seattle or United States
$117k-$171k/yr HybridFull Time
Bayer
BayerFrankfurt Stock Exchange: BAYN: Global provider of healthcare medicines and agricultural products.
8+ YOE8+ years in software/data engineering, BS in CS or equivalent, expertise in backend languages (Python, Java), cloud-native and distributed systems, event-driven architectures, CI/CD, and building large-scale data platforms.
Kafka, Kinesis, Pub/Sub, SQS, SNS, JMS, Spark, Flink, Dataflow, Dataproc, Docker, GitLab Pipelines, GitHub Actions, AWS, GCP, Python, Java
2d
Save
Mark Applied
Hide
Dashboard Developer, Mid-Level
Scott Air Force Base, Illinois, United States
$68k-$92k/yr OnsiteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
2+ YOE2+ years data science/analytics experience, BA/BS, active Secret clearance, skills in Databricks, SQL, Spark, Python, BI tools, ETL, and analytical modeling.
Databricks, SQL, Spark, Qlik, Tableau, Microsoft Power BI, Python, SAS
1w
Save
Mark Applied
Hide
Staff Software Engineer, Data
Chicago or Creve Coeur or Seattle or United States
$117k-$171k/yr OnsiteFull Time
Bayer
BayerFrankfurt Stock Exchange: BAYN: Global enterprise focused on healthcare and nutrition.
8+ YOEBS in CS or equivalent, 8+ years software/data engineering, expertise in distributed systems, cloud (AWS/GCP), streaming and messaging, containerization and CI/CD, mentoring and system design.
Python, Java, AWS, GCP, Kafka, Kinesis, Pub/Sub, SQS, SNS, Spark, Flink, Dataflow, Dataproc, Docker, GitLab Pipelines, GitHub Actions, JMS
2d
Save
Mark Applied
Hide
Dashboard Developer, Mid-Level
Scott Air Force Base, Illinois, United States
$68k-$92k/yr OnsiteFull Time
GDIT
GDITNYSE: GD: Delivers IT and mission services to government agencies.
2+ YOE2+ years data science/analytics experience, expertise with Databricks, SQL, Spark, BI tools (Qlik, Tableau, Power BI), Python; BA/BS required; active Secret clearance preferred or ability to obtain.
Databricks, SQL, Spark, Qlik, Tableau, Power BI, Python, SAS
1mo
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
NISC
NISC: Develops enterprise software for energy and telecommunications cooperatives.
5+ YOE5+ years software development experience preferred; full-stack and data engineering experience; Databricks, Delta Lake, Spark, big data, AWS services, Java/Scala, Docker/Kubernetes, CI/CD, and strong analytical skills.
Databricks, Delta Lake, Apache Spark, Hadoop, Kafka, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, SQL, MDM