26 spark data engineer jobs at 17 companies in O'Fallon, IL

3mo
Save
Mark Applied
Hide
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yr OnsiteFull Time
Absolute Business Solutions Corp
Absolute Business Solutions Corp: Provides technology and intelligence services to the US government.
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
Apache Spark, PySpark, Scala, Delta Lake, Parquet, Structured Streaming, Kubernetes, Docker, S3, AWS, GCP, Azure, Git, Jenkins, Python, Bash, Terraform, Iceberg
3w
Save
Mark Applied
Hide
Data Engineer
Carmel or St. Louis
HybridFull Time
CleanSlate Technology Group
CleanSlate Technology Group: Provides cloud-native software development and IT modernization services.
2+ YOE2+ years building data engineering or data platform solutions; experience with Python/Java/Scala, SQL, Spark/Databricks/Snowflake/Redshift/Azure Fabric/AWS Glue/Azure Data Factory, and AWS or Azure; strong collaboration and communication skills.
Python, Java, Scala, SQL, Spark, Databricks, Snowflake, Redshift, Azure Fabric, AWS Glue, Azure Data Factory, AWS, Azure, CI/CD, infrastructure-as-code, Claude Code, Cursor, Kiro, NoSQL
6d
Save
Mark Applied
Hide
Data Engineer - TRANSCOM
Scott Air Force Base, Illinois, United States
$130k-$155k/yr OnsiteFull Time
Agile Defense
Agile Defense: Provides IT modernization and cybersecurity for federal government agencies.
3+ YOETop Secret clearance required, 3+ years data/software engineering experience, experience with Python, SQL, Spark/Databricks, Palantir Foundry, ML model development and deployment; bachelor’s preferred.
Palantir's MSS Workshop, Slate, Palantir Foundry, Python, SQL, Spark, Databricks, PySpark, scikit-learn, TensorFlow, XGBoost, AWS, Azure
2w
Save
Mark Applied
Hide
Data Engineer
St Louis, Missouri, United States
HybridFull Time
Build-A-Bear
Build-A-BearNYSE: BBW: Sells customizable stuffed animals and provides interactive retail experiences.
5+ YOE5+ years data engineering experience, bachelor’s in CS/IS/data engineering, skilled in SQL, Python, Spark, cloud data platforms (Microsoft Azure), ETL/ELT design, API integrations, and data modeling.
SQL, Python, Spark, Microsoft Azure, Data Factory, Synapse, Databricks, Data Lake, Power PI, Tableau, Looker, Microsoft Dynamics 365, Salesforce
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Beavercreek or Dayton or St. Louis or United States
OnsiteFull Time
Awetomaton
Awetomaton: Develops software for satellite intelligence and geospatial data analysis.
5+ YOEBS degree, 5+ years experience, DoD Top Secret clearance required, proficiency with Python, SQL, Spark, orchestration tools (Airflow, Dagster, Argo Workflow), data modeling, cloud-native deployment, and strong communication skills.
Python, SQL, Spark, Airflow, Dagster, Argo Workflow, Kubernetes
1mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Navitus Health Solutions
Navitus Health Solutions: Transparent pharmacy benefit management and specialty pharmacy provider.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
1mo
Save
Mark Applied
Hide
Data Engineer Software Developer
Scott AFB, Illinois, United States
$99k-$106k/yr OnsiteFull Time
I2X Technologies
I2X Technologies: Provides mission-critical engineering, cybersecurity, and IT services to government agencies.
4+ YOEUS citizen with active Secret clearance, Bachelor's in CS/Engineering, 4+ years experience building data pipelines, proficiency with Kafka/Elastic/AWS/OpenShift, Python/Java/SQL, Linux, CI/CD, and ability to work onsite at Scott AFB.
Confluent Kafka, Elastic Stack, AWS, Red Hat OpenShift, Kubernetes, Kafka, Elastic, Logstash, Kibana, React, JavaScript, HTML, AWS Redshift, S3, Hadoop, Snowflake, Python, Java, SQL, shell scripting, Elasticsearch, Spark, NiFi, Databricks, ELK Stack, Azure, GCP, AWS GovCloud, Ansible, Puppet, Chef, Prometheus, Grafana, Git, Bitbucket, Atlassian JIRA, Confluence, CI/CD
1mo
Save
Mark Applied
Hide
Data Engineer 3 (Mid-Level, Data Product Implementation and Architecture)
Scott Air Force Base, Illinois, United States
OnsiteFull Time
UNCOMN
UNCOMN: A technology delivering secure data integration and systems solutions for public and private sector clients.
5+ YOEActive Secret clearance required, 5+ years in data engineering or systems integration, experience building secure APIs, data pipelines, orchestration, and enterprise security controls; proficiency with three or more listed technologies.
RESTful APIs, Python, Java, SQL, Spark, Databricks, Palantir Foundry, API gateways, Microservices, AWS, Azure, Google Cloud Platform (GCP)
1mo
Save
Mark Applied
Hide
Financial Data Engineer
Clayton, Missouri, United States
HybridFull Time
Equifax
EquifaxNew York Stock Exchange: EFX: Provides consumer credit reporting and data analytics services globally.
5+ YOEBachelor's in a quantitative field; 5+ years building, loading, transforming and analyzing data; 5+ years with GCP; scripting/coding experience; proficiency with Python, SQL, BigQuery, Airflow/Cloud Composer; ETL and data modeling experience.
GCP, Python, Airflow, Cloud Composer, Jenkins, Astronomer, Spark, BigQuery, SQL, ETL, Tableau, Looker, Spotfire, ML, AI, RPA
2w
Save
Mark Applied
Hide
Lead - Data / AI Native Engineer
St. Louis, Missouri, United States
$120k/yr OnsiteFull Time
Tech Mahindra
Tech MahindraNational Stock Exchange of India: TECHM: Global provider of information technology and business process services.
8+ YOE3+ Mgmt8+ years data/software engineering experience, 3+ years leading data initiatives, proven enterprise-scale data platform and pipeline experience, cloud-native analytics and AI solutions experience.
Spark, PySpark, GitHub Copilot, Claude Code CLI, AWS, Databricks, AWS EMR
1mo
Save
Mark Applied
Hide
Senior Principal, Data Engineering
Arlington or O'Fallon
$212k-$390k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Design, build, and operate enterprise-scale cloud-native data platforms across AWS and Azure; hands-on Spark/PySpark and Python experience; Infrastructure-as-Code and CI/CD; strong cloud security and data governance expertise.
AWS S3, Amazon EC2, AWS Lambda, AWS Glue, Amazon Redshift, Amazon EMR, Amazon Athena, AWS Lake Formation, Databricks, Azure Data Factory, Azure Synapse, Azure Fabric, Azure Data Lake, Terraform, CloudFormation, Bicep/ARM, Azure DevOps, GitLab CI/CD, Spark, PySpark, Python, Bash, PowerShell, Docker, Kubernetes, ECS, AKS, CloudWatch, Azure Monitor, ELK, Grafana
2mo
Save
Mark Applied
Hide
Data Platform Architect
Florissant, Missouri, United States
OnsiteFull Time
Augustine Institute
Augustine Institute: Provides Catholic theological education and media for faith formation.
7+ YOE7+ years in data engineering/architecture; experience designing lakehouse/data warehouse architectures at scale; Databricks, Spark, Delta Lake; ETL/ELT with dbt/Airflow; data governance; legacy modernization; BI tools; AI/ML data patterns
Databricks, Apache Spark, Delta Lake, dbt, Airflow
2w
Save
Mark Applied
Hide
Dashboard Developer, Mid-Level
Scott Air Force Base, Illinois, United States
$68k-$92k/yr OnsiteFull Time
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
2+ YOE2+ years data science/analytics experience, BA/BS, active Secret clearance, skills in Databricks, SQL, Spark, Python, BI tools, ETL, and analytical modeling.
Databricks, SQL, Spark, Qlik, Tableau, Microsoft Power BI, Python, SAS
1w
Save
Mark Applied
Hide
Senior Developer- Databricks
Scott Air Force Base, Illinois, United States
OnsiteFull Time
D&G Solutions
D&G Solutions: A mission-focused service provider delivering data and technical solutions in support of defense customers.
5+ YOEBachelor's in CS or related,5+ years data engineering experience,proficient in SQL and Python,experience with Spark/Kafka,cloud platforms,and active Secret clearance with TS/SCI eligibility.
SQL, Python, Apache Spark, Kafka, Databricks, Palantir Ontology, AWS, Microsoft Azure, Google Cloud Platform, REST, Maven Smart Systems
2w
Save
Mark Applied
Hide
Dashboard Developer, Mid-Level
Scott Air Force Base, Illinois, United States
$68k-$92k/yr OnsiteFull Time
GDIT
GDITNYSE: GD: Delivers IT and mission services to government agencies.
2+ YOE2+ years data science/analytics experience, expertise with Databricks, SQL, Spark, BI tools (Qlik, Tableau, Power BI), Python; BA/BS required; active Secret clearance preferred or ability to obtain.
Databricks, SQL, Spark, Qlik, Tableau, Power BI, Python, SAS
1w
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
NISC
NISC: Provides enterprise software solutions for utility and broadband cooperatives.
5+ YOE5+ years software development experience; proficiency with Databricks, Delta Lake, Spark, AWS, Java or Scala, data pipelines, and cloud-based full‑stack development.
Databricks, Delta Lake, Spark, Kafka, AWS, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, MDM, SQL, CI/CD
1mo
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
NISC
NISC: Develops enterprise software for energy and telecommunications cooperatives.
5+ YOE5+ years software development experience preferred; full-stack and data engineering experience; Databricks, Delta Lake, Spark, big data, AWS services, Java/Scala, Docker/Kubernetes, CI/CD, and strong analytical skills.
Databricks, Delta Lake, Apache Spark, Hadoop, Kafka, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, SQL, MDM
1mo
Save
Mark Applied
Hide
Lead QA Automation Engineer
Chesterfield or United States
$107k-$159k/yr RemoteFull Time
Reinsurance Group of America
Reinsurance Group of AmericaNYSE: RGA: Provides global life and health reinsurance and risk solutions
8+ YOE8+ years big data experience, 4+ years data analysis; BA/BS required (MA/MS preferred); lead QA and automation experience; expertise in data testing (ETL, pipelines, data lake), SQL, CI/CD, data security; experience with test automation frameworks and big data platforms preferred.
Playwright, Selenium, Cypress, SQL, Hive, Spark, NoSQL, Azure, AWS, Snowflake, Databricks, REST, JSON, CI/CD, ETL
4d
Save
Mark Applied
Hide
Databricks Solutions Architect
Saint Louis, Missouri, United States
$82k-$178k/yr OnsiteFull Time
Perficient
Perficient: Provides digital transformation and AI consulting for global enterprises.
10+ YOE10+ years in data management and cloud, 3+ years Databricks, 4+ years Spark/Hadoop/Kafka, 5+ years ETL/ELT architecture, Databricks project experience, bachelor\u0002s degree in CS/Engineering/IS.
Databricks, Databricks Unity Catalog, Databricks CI/CD, Spark, Hadoop, Kafka, Git, Terraform, Azure, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Event Hub, Azure DevOps, AWS, Amazon S3, AWS Lambda, AWS Glue, GCP, Delta Live Tables, Lakeflow, Lakebridge, ML/AI