23 pyspark developer jobs at 12 companies in O'Fallon, IL

3mo
Save
Mark Applied
Hide
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yr OnsiteFull Time
Absolute Business Solutions Corp
Absolute Business Solutions Corp: Provides technology and intelligence services to the US government.
5+ YOETS/SCI-eligible candidate with 5+ years in data engineering or Spark development, strong PySpark/Scala, container and Kubernetes experience, object storage familiarity, and performance tuning skills.
Apache Spark, PySpark, Scala, Delta Lake, Parquet, Kubernetes, Docker, S3, AWS, GCP, Azure, Git, Jenkins, Python, Bash, Iceberg, Terraform
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
2w
Save
Mark Applied
Hide
Lead - Data / AI Native Engineer
St. Louis or O'Fallon
$150k-$155k/yr OnsiteFull Time
Tech Mahindra
Tech MahindraNational Stock Exchange of India: TECHM: Global provider of information technology and business process services.
8+ YOE3+ Mgmt8+ years data engineering experience, 3+ years leading teams, expertise with Spark/PySpark, cloud-native analytics on AWS and Databricks, ETL/ELT and scalable data platforms.
Spark, PySpark, GitHub Copilot, Claude Code CLI, AWS, Databricks
1mo
Save
Mark Applied
Hide
UI/UX Developer / Active Secret
Scott Air Force Base, Illinois, United States
$66k-$106k/yr HybridFull Time
Peraton
Peraton: National security and mission-critical government technology services provider.
2+ YOE2 years' relevant UI/UX development experience with BS/BA (or HS + 6 years), active DoD Secret clearance, U.S. citizenship, strong communication and collaboration; Palantir Foundry and Python/PySpark preferred.
Palantir Foundry, Python, PySpark
1w
Save
Mark Applied
Hide
SAS Data Engineer
Saint Louis, Missouri, United States
$105k-$120k/yr RemoteFull Time
Cognizant
CognizantNasdaq: CTSH: Provides IT consulting and digital business process services.
7+ YOE7+ years SAS programming experience, strong Python and PySpark skills, SAS migration and QA experience, advanced SQL, testing and reconciliation expertise, and strong stakeholder communication.
SAS, Python, PySpark, Databricks, Snowflake, SQL
3w
Save
Mark Applied
Hide
Data Engineer, Data Solutions
St. Louis, Missouri, United States
OnsiteFull Time
NISA Investment Advisors
NISA Investment Advisors: Provides customized investment and risk management solutions for institutional investors.
5+ YOE5+ years ETL/ELT experience, 3+ years SQL, proficiency with Python or C#, AWS (Lambda,S3), Airflow, Databricks/PySpark; strong analytical, troubleshooting, and customer-support skills.
SQL, Python, C#, AWS, AWS Lambda, S3, Airflow, Databricks, PySpark, Microsoft SQL Server, PostgreSQL, SSIS
2mo
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
NISC
NISC: Develops enterprise software for energy and telecommunications cooperatives.
5+ YOE5+ years software development experience preferred; full-stack and data engineering experience; Databricks, Delta Lake, Spark, big data, AWS services, Java/Scala, Docker/Kubernetes, CI/CD, and strong analytical skills.
Databricks, Delta Lake, Apache Spark, Hadoop, Kafka, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, SQL, MDM
1mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Navitus Health Solutions
Navitus Health Solutions: Transparent pharmacy benefit management and specialty pharmacy provider.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
1w
Save
Mark Applied
Hide
Data Engineer - TRANSCOM
Scott Air Force Base, Illinois, United States
$130k-$155k/yr OnsiteFull Time
Agile Defense
Agile Defense: Provides IT modernization and cybersecurity for federal government agencies.
3+ YOETop Secret clearance required, 3+ years data/software engineering experience, experience with Python, SQL, Spark/Databricks, Palantir Foundry, ML model development and deployment; bachelor’s preferred.
Palantir's MSS Workshop, Slate, Palantir Foundry, Python, SQL, Spark, Databricks, PySpark, scikit-learn, TensorFlow, XGBoost, AWS, Azure
2w
Save
Mark Applied
Hide
Senior Developer- Databricks
Scott Air Force Base, Illinois, United States
OnsiteFull Time
D&G Solutions
D&G Solutions: A mission-focused service provider delivering data and technical solutions in support of defense customers.
5+ YOEBachelor's in CS or related,5+ years data engineering experience,proficient in SQL and Python,experience with Spark/Kafka,cloud platforms,and active Secret clearance with TS/SCI eligibility.
SQL, Python, Apache Spark, Kafka, Databricks, Palantir Ontology, AWS, Microsoft Azure, Google Cloud Platform, REST, Maven Smart Systems
1mo
Save
Mark Applied
Hide
UI/UX Developer / Active Secret
Scott AFB, Illinois, United States
$66k-$106k/yr HybridFull Time
Peraton
Peraton: Provides advanced technology and mission support for government agencies.
2+ YOEU.S. citizen with active DoD Secret clearance. 2 years relevant experience with a BS/BA (or HS + 6 years). Experience developing enterprise-level UI/UX solutions, collaborative mindset, and strong communication skills.
Palantir Foundry, Python, PySpark
4w
Save
Mark Applied
Hide
Test Engineer
St. Louis, Missouri, United States
OnsiteFull Time
Freedom Technology Solutions Group
Freedom Technology Solutions Group: Provides geospatial and software engineering solutions for national security agencies.
4+ YOEActive security clearance required; 4+ years test engineering experience; knowledge of DevSecOps, Agile/SAFe, AI model use, geospatial systems, vendor coordination, and delivering complex technology assignments.
Linux, Java, JavaScript, Python, Docker, OpenShift, Kubernetes, AWS Services, GitLab, Apache Spark, Glue, Parquet, JSON, XML, Argo Workflows, Boundless Spatial, Remote View, PostGRES/PostGIS, Oracle Spatial, ArcGIS Desktop, ArcGIS Server, Image Server, File Geodatabases, KML, KMZ, NITF, TIFF, JPEG, GeoPDF, PHP, C, C++, C#, Perl
1mo
Save
Mark Applied
Hide
Senior Principal, Data Engineering
Arlington or O'Fallon
$212k-$390k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Design, build, and operate enterprise-scale cloud-native data platforms across AWS and Azure; hands-on Spark/PySpark and Python experience; Infrastructure-as-Code and CI/CD; strong cloud security and data governance expertise.
AWS S3, Amazon EC2, AWS Lambda, AWS Glue, Amazon Redshift, Amazon EMR, Amazon Athena, AWS Lake Formation, Databricks, Azure Data Factory, Azure Synapse, Azure Fabric, Azure Data Lake, Terraform, CloudFormation, Bicep/ARM, Azure DevOps, GitLab CI/CD, Spark, PySpark, Python, Bash, PowerShell, Docker, Kubernetes, ECS, AKS, CloudWatch, Azure Monitor, ELK, Grafana