26 spark data engineer jobs at 17 companies in O'Fallon, IL
3mo
Save
Mark Applied
Hide
3mo
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yrOnsiteFull Time
Absolute Business Solutions Corp: Provides technology and intelligence services to the US government.
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
CleanSlate Technology Group: Provides cloud-native software development and IT modernization services.
2+ YOE2+ years building data engineering or data platform solutions; experience with Python/Java/Scala, SQL, Spark/Databricks/Snowflake/Redshift/Azure Fabric/AWS Glue/Azure Data Factory, and AWS or Azure; strong collaboration and communication skills.
Agile Defense: Provides IT modernization and cybersecurity for federal government agencies.
3+ YOETop Secret clearance required, 3+ years data/software engineering experience, experience with Python, SQL, Spark/Databricks, Palantir Foundry, ML model development and deployment; bachelor’s preferred.
5+ YOE5+ years data engineering experience, bachelor’s in CS/IS/data engineering, skilled in SQL, Python, Spark, cloud data platforms (Microsoft Azure), ETL/ELT design, API integrations, and data modeling.
SQL, Python, Spark, Microsoft Azure, Data Factory, Synapse, Databricks, Data Lake, Power PI, Tableau, Looker, Microsoft Dynamics 365, Salesforce
Beavercreek or Dayton or St. Louis or United States
OnsiteFull Time
Awetomaton: Develops software for satellite intelligence and geospatial data analysis.
5+ YOEBS degree, 5+ years experience, DoD Top Secret clearance required, proficiency with Python, SQL, Spark, orchestration tools (Airflow, Dagster, Argo Workflow), data modeling, cloud-native deployment, and strong communication skills.
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Navitus Health Solutions: Transparent pharmacy benefit management and specialty pharmacy provider.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
I2X Technologies: Provides mission-critical engineering, cybersecurity, and IT services to government agencies.
4+ YOEUS citizen with active Secret clearance, Bachelor's in CS/Engineering, 4+ years experience building data pipelines, proficiency with Kafka/Elastic/AWS/OpenShift, Python/Java/SQL, Linux, CI/CD, and ability to work onsite at Scott AFB.
Data Engineer 3 (Mid-Level, Data Product Implementation and Architecture)
Scott Air Force Base, Illinois, United States
OnsiteFull Time
UNCOMN: A technology delivering secure data integration and systems solutions for public and private sector clients.
5+ YOEActive Secret clearance required, 5+ years in data engineering or systems integration, experience building secure APIs, data pipelines, orchestration, and enterprise security controls; proficiency with three or more listed technologies.
RESTful APIs, Python, Java, SQL, Spark, Databricks, Palantir Foundry, API gateways, Microservices, AWS, Azure, Google Cloud Platform (GCP)
EquifaxNew York Stock Exchange: EFX: Provides consumer credit reporting and data analytics services globally.
5+ YOEBachelor's in a quantitative field; 5+ years building, loading, transforming and analyzing data; 5+ years with GCP; scripting/coding experience; proficiency with Python, SQL, BigQuery, Airflow/Cloud Composer; ETL and data modeling experience.
Tech MahindraNational Stock Exchange of India: TECHM: Global provider of information technology and business process services.
8+ YOE3+ Mgmt8+ years data/software engineering experience, 3+ years leading data initiatives, proven enterprise-scale data platform and pipeline experience, cloud-native analytics and AI solutions experience.
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Design, build, and operate enterprise-scale cloud-native data platforms across AWS and Azure; hands-on Spark/PySpark and Python experience; Infrastructure-as-Code and CI/CD; strong cloud security and data governance expertise.
Augustine Institute: Provides Catholic theological education and media for faith formation.
7+ YOE7+ years in data engineering/architecture; experience designing lakehouse/data warehouse architectures at scale; Databricks, Spark, Delta Lake; ETL/ELT with dbt/Airflow; data governance; legacy modernization; BI tools; AI/ML data patterns
Databricks, Apache Spark, Delta Lake, dbt, Airflow
General Dynamics Information TechnologyNYSE: GD: Provides mission-critical IT services to government and defense organizations.
2+ YOE2+ years data science/analytics experience, BA/BS, active Secret clearance, skills in Databricks, SQL, Spark, Python, BI tools, ETL, and analytical modeling.
Databricks, SQL, Spark, Qlik, Tableau, Microsoft Power BI, Python, SAS
D&G Solutions: A mission-focused service provider delivering data and technical solutions in support of defense customers.
5+ YOEBachelor's in CS or related,5+ years data engineering experience,proficient in SQL and Python,experience with Spark/Kafka,cloud platforms,and active Secret clearance with TS/SCI eligibility.
SQL, Python, Apache Spark, Kafka, Databricks, Palantir Ontology, AWS, Microsoft Azure, Google Cloud Platform, REST, Maven Smart Systems
GDITNYSE: GD: Delivers IT and mission services to government agencies.
2+ YOE2+ years data science/analytics experience, expertise with Databricks, SQL, Spark, BI tools (Qlik, Tableau, Power BI), Python; BA/BS required; active Secret clearance preferred or ability to obtain.
Databricks, SQL, Spark, Qlik, Tableau, Power BI, Python, SAS
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
NISC: Provides enterprise software solutions for utility and broadband cooperatives.
5+ YOE5+ years software development experience; proficiency with Databricks, Delta Lake, Spark, AWS, Java or Scala, data pipelines, and cloud-based full‑stack development.
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
NISC: Develops enterprise software for energy and telecommunications cooperatives.
5+ YOE5+ years software development experience preferred; full-stack and data engineering experience; Databricks, Delta Lake, Spark, big data, AWS services, Java/Scala, Docker/Kubernetes, CI/CD, and strong analytical skills.
Reinsurance Group of AmericaNYSE: RGA: Provides global life and health reinsurance and risk solutions
8+ YOE8+ years big data experience, 4+ years data analysis; BA/BS required (MA/MS preferred); lead QA and automation experience; expertise in data testing (ETL, pipelines, data lake), SQL, CI/CD, data security; experience with test automation frameworks and big data platforms preferred.
Perficient: Provides digital transformation and AI consulting for global enterprises.
10+ YOE10+ years in data management and cloud, 3+ years Databricks, 4+ years Spark/Hadoop/Kafka, 5+ years ETL/ELT architecture, Databricks project experience, bachelor\u0002s degree in CS/Engineering/IS.
Databricks, Databricks Unity Catalog, Databricks CI/CD, Spark, Hadoop, Kafka, Git, Terraform, Azure, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Event Hub, Azure DevOps, AWS, Amazon S3, AWS Lambda, AWS Glue, GCP, Delta Live Tables, Lakeflow, Lakebridge, ML/AI