HiringCafe
Join our community

41 spark engineer jobs at 20 companies in O'Fallon, MO

3mo
Save
Mark Applied
Hide
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yr OnsiteFull Time
Absolute Business Solutions Corp
Absolute Business Solutions Corp: Provides technology and intelligence services to the US government.
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
Apache Spark, PySpark, Scala, Delta Lake, Parquet, Structured Streaming, Kubernetes, Docker, S3, AWS, GCP, Azure, Git, Jenkins, Python, Bash, Terraform, Iceberg
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Developer- Databricks
Scott Air Force Base, Illinois, United States
OnsiteFull Time
D&G Solutions
D&G Solutions: A mission-focused service provider delivering data and technical solutions in support of defense customers.
5+ YOEBachelor's in CS or related,5+ years data engineering experience,proficient in SQL and Python,experience with Spark/Kafka,cloud platforms,and active Secret clearance with TS/SCI eligibility.
SQL, Python, Apache Spark, Kafka, Databricks, Palantir Ontology, AWS, Microsoft Azure, Google Cloud Platform, REST, Maven Smart Systems
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer
St Louis, Missouri, United States
HybridFull Time
Build-A-Bear
Build-A-BearNYSE: BBW: Sells customizable stuffed animals and provides interactive retail experiences.
5+ YOE5+ years data engineering experience, bachelor’s in CS/IS/data engineering, skilled in SQL, Python, Spark, cloud data platforms (Microsoft Azure), ETL/ELT design, API integrations, and data modeling.
SQL, Python, Spark, Microsoft Azure, Data Factory, Synapse, Databricks, Data Lake, Power PI, Tableau, Looker, Microsoft Dynamics 365, Salesforce
Job PostingView all
4w
Save
Mark Applied
Hide
Data Engineer
Carmel or St. Louis
HybridFull Time
CleanSlate Technology Group
CleanSlate Technology Group: Provides cloud-native software development and IT modernization services.
2+ YOE2+ years building data engineering or data platform solutions; experience with Python/Java/Scala, SQL, Spark/Databricks/Snowflake/Redshift/Azure Fabric/AWS Glue/Azure Data Factory, and AWS or Azure; strong collaboration and communication skills.
Python, Java, Scala, SQL, Spark, Databricks, Snowflake, Redshift, Azure Fabric, AWS Glue, Azure Data Factory, AWS, Azure, CI/CD, infrastructure-as-code, Claude Code, Cursor, Kiro, NoSQL
Job PostingView all
2w
Save
Mark Applied
Hide
Lead - Data / AI Native Engineer
St. Louis or O'Fallon
$150k-$155k/yr OnsiteFull Time
Tech Mahindra
Tech MahindraNational Stock Exchange of India: TECHM: Global provider of information technology and business process services.
8+ YOE3+ Mgmt8+ years data engineering experience, 3+ years leading teams, expertise with Spark/PySpark, cloud-native analytics on AWS and Databricks, ETL/ELT and scalable data platforms.
Spark, PySpark, GitHub Copilot, Claude Code CLI, AWS, Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Beavercreek or Dayton or St. Louis or United States
OnsiteFull Time
Awetomaton
Awetomaton: Develops software for satellite intelligence and geospatial data analysis.
5+ YOEBS degree, 5+ years experience, DoD Top Secret clearance required, proficiency with Python, SQL, Spark, orchestration tools (Airflow, Dagster, Argo Workflow), data modeling, cloud-native deployment, and strong communication skills.
Python, SQL, Spark, Airflow, Dagster, Argo Workflow, Kubernetes
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead QA Automation Engineer
Chesterfield or United States
$107k-$159k/yr RemoteFull Time
Reinsurance Group of America
Reinsurance Group of AmericaNYSE: RGA: Provides global life and health reinsurance and risk solutions
8+ YOE8+ years big data experience, 4+ years data analysis; BA/BS required (MA/MS preferred); lead QA and automation experience; expertise in data testing (ETL, pipelines, data lake), SQL, CI/CD, data security; experience with test automation frameworks and big data platforms preferred.
Playwright, Selenium, Cypress, SQL, Hive, Spark, NoSQL, Azure, AWS, Snowflake, Databricks, REST, JSON, CI/CD, ETL
Job PostingView all
2w
Save
Mark Applied
Hide
Dashboard Developer, Mid-Level
Scott Air Force Base, Illinois, United States
$68k-$92k/yr OnsiteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
2+ YOE2+ years data science/analytics experience, BA/BS, active Secret clearance, skills in Databricks, SQL, Spark, Python, BI tools, ETL, and analytical modeling.
Databricks, SQL, Spark, Qlik, Tableau, Microsoft Power BI, Python, SAS
Job PostingView all
2w
Save
Mark Applied
Hide
Dashboard Developer, Mid-Level
Scott Air Force Base, Illinois, United States
$68k-$92k/yr OnsiteFull Time
GDIT
GDITNYSE: GD: Delivers IT and mission services to government agencies.
2+ YOE2+ years data science/analytics experience, expertise with Databricks, SQL, Spark, BI tools (Qlik, Tableau, Power BI), Python; BA/BS required; active Secret clearance preferred or ability to obtain.
Databricks, SQL, Spark, Qlik, Tableau, Power BI, Python, SAS
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Navitus Health Solutions
Navitus Health Solutions: Transparent pharmacy benefit management and specialty pharmacy provider.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer Software Developer
Scott AFB, Illinois, United States
$99k-$106k/yr OnsiteFull Time
I2X Technologies
I2X Technologies: Provides mission-critical engineering, cybersecurity, and IT services to government agencies.
4+ YOEUS citizen with active Secret clearance, Bachelor's in CS/Engineering, 4+ years experience building data pipelines, proficiency with Kafka/Elastic/AWS/OpenShift, Python/Java/SQL, Linux, CI/CD, and ability to work onsite at Scott AFB.
Confluent Kafka, Elastic Stack, AWS, Red Hat OpenShift, Kubernetes, Kafka, Elastic, Logstash, Kibana, React, JavaScript, HTML, AWS Redshift, S3, Hadoop, Snowflake, Python, Java, SQL, shell scripting, Elasticsearch, Spark, NiFi, Databricks, ELK Stack, Azure, GCP, AWS GovCloud, Ansible, Puppet, Chef, Prometheus, Grafana, Git, Bitbucket, Atlassian JIRA, Confluence, CI/CD
Job PostingView all
2w
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
NISC
NISC: Provides enterprise software solutions for utility and broadband cooperatives.
5+ YOE5+ years software development experience; proficiency with Databricks, Delta Lake, Spark, AWS, Java or Scala, data pipelines, and cloud-based full‑stack development.
Databricks, Delta Lake, Spark, Kafka, AWS, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, MDM, SQL, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
NISC
NISC: Develops enterprise software for energy and telecommunications cooperatives.
5+ YOE5+ years software development experience preferred; full-stack and data engineering experience; Databricks, Delta Lake, Spark, big data, AWS services, Java/Scala, Docker/Kubernetes, CI/CD, and strong analytical skills.
Databricks, Delta Lake, Apache Spark, Hadoop, Kafka, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, SQL, MDM
Job PostingView all
1d
Save
Mark Applied
Hide
Data Engineer
O'Fallon, Illinois, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
2+ YOE2+ years experience; proficiency with Python and scalable data stores; experience building ETL/ELT pipelines, parsing structured and unstructured data; ability to script data conversions; Secret clearance and bachelor's degree required.
Python, C++, Java, Linux, SQL, Scala, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake, UNIX, Shell
Job PostingView all
1d
Save
Mark Applied
Hide
Data Engineer
O'Fallon, Illinois, United States
$62k-$141k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
2+ YOE2+ years experience with Python and scalable data stores, ETL/ELT workflows, processing structured/unstructured data, scripting, and working in cross-functional teams; Secret clearance and Bachelor's degree required.
Python, C++, Java, Linux, SQL, Scala, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake, UNIX, Shell
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer 3 (Mid-Level, Enterprise Standards)
Scott Air Force Base, Illinois, United States
OnsiteFull Time
UNCOMN
UNCOMN: A technology and services firm delivering secure data, integration, and analytics solutions for public and private sector missions.
5+ YOEActive Secret clearance, 5+ years in data engineering/systems integration, experience developing enterprise data integration and governance, proficiency with multiple data tools (e.g., SQL, Python, Databricks), and ability to work on-site at Scott AFB.
SQL, Python, Spark, Databricks, Palantir Foundry/MSS, Advana, Qlik, Kibana, Tableau, Microsoft Power BI, Collibra, AWS Glue, Unity Catalog, REST APIs
Job PostingView all
1mo
Save
Mark Applied
Hide
Financial Data Engineer
Clayton, Missouri, United States
HybridFull Time
Equifax
EquifaxNew York Stock Exchange: EFX: Provides consumer credit reporting and data analytics services globally.
5+ YOEBachelor's in a quantitative field; 5+ years building, loading, transforming and analyzing data; 5+ years with GCP; scripting/coding experience; proficiency with Python, SQL, BigQuery, Airflow/Cloud Composer; ETL and data modeling experience.
GCP, Python, Airflow, Cloud Composer, Jenkins, Astronomer, Spark, BigQuery, SQL, ETL, Tableau, Looker, Spotfire, ML, AI, RPA
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Principal, Data Engineering
Arlington or O'Fallon
$212k-$390k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Design, build, and operate enterprise-scale cloud-native data platforms across AWS and Azure; hands-on Spark/PySpark and Python experience; Infrastructure-as-Code and CI/CD; strong cloud security and data governance expertise.
AWS S3, Amazon EC2, AWS Lambda, AWS Glue, Amazon Redshift, Amazon EMR, Amazon Athena, AWS Lake Formation, Databricks, Azure Data Factory, Azure Synapse, Azure Fabric, Azure Data Lake, Terraform, CloudFormation, Bicep/ARM, Azure DevOps, GitLab CI/CD, Spark, PySpark, Python, Bash, PowerShell, Docker, Kubernetes, ECS, AKS, CloudWatch, Azure Monitor, ELK, Grafana
Job PostingView all
1mo
Save
Mark Applied
Hide
SDC Java Software Developer---Senior---St. Louis (St. Louis, MO, US, 63105)
St. Louis, Missouri, United States
$67k-$137k/yr HybridFull Time
EY
EY: Global firm providing audit, tax, and professional consulting services.
3+ YOEBachelor's in CS or related, minimum 3 years software development experience; back-end Java/Python/Node.js, REST, NoSQL, microservices, cloud (AWS/Azure); front-end React/Angular; API design, Git and CI/CD, TDD/BDD, agile.
Java, Python, Node.js, REST, NoSQL, Microservices, Serverless, AWS, Azure, React, Angular, Git, CI/CD, Akka, Scala, Kafka, RabbitMQ, ElasticSearch, AngularJS, ReactJS, Hadoop, Spark, Flume, Mongo, Cassandra, IaaS, PaaS, API Management, TDD, BDD
Job PostingView all
5d
Save
Mark Applied
Hide
Databricks Solutions Architect
Saint Louis, Missouri, United States
$82k-$178k/yr OnsiteFull Time
Perficient
Perficient: Provides digital transformation and AI consulting for global enterprises.
10+ YOE10+ years in data management and cloud, 3+ years Databricks, 4+ years Spark/Hadoop/Kafka, 5+ years ETL/ELT architecture, Databricks project experience, bachelor\u0002s degree in CS/Engineering/IS.
Databricks, Databricks Unity Catalog, Databricks CI/CD, Spark, Hadoop, Kafka, Git, Terraform, Azure, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Event Hub, Azure DevOps, AWS, Amazon S3, AWS Lambda, AWS Glue, GCP, Delta Live Tables, Lakeflow, Lakebridge, ML/AI
Job PostingView all

Explore Jobs

Expand Your Job Search