21 pyspark data engineer jobs at 13 companies in Ballwin, MO

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Navitus Health Solutions
Navitus Health Solutions: Transparent pharmacy benefit management and specialty pharmacy provider.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
4d
Save
Mark Applied
Hide
Data Engineer, Data Solutions
St. Louis, Missouri, United States
OnsiteFull Time
NISA Investment Advisors
NISA Investment Advisors: Provides customized risk-controlled investment solutions for institutional clients.
5+ YOEBachelor's degree or equivalent experience, 5+ years ETL/ELT experience, 3+ years SQL, experience with Python or C#, AWS and Airflow, Databricks or PySpark, strong analytical and customer support skills.
ETL/ELT, SQL, Python, C#, AWS, AWS Lambda, S3, Airflow, Databricks, PySpark, Microsoft SQL Server, PostgreSQL, SSIS
1mo
Save
Mark Applied
Hide
Data Engineer 1-2 (Junior/Associate)
Scott Air Force Base, Illinois, United States
OnsiteFull Time
UNCOMN
UNCOMN: A delivering secure data solutions for public and private sectors, emphasizing culture, growth, and work-life balance.
3+ YOEDesign, develop, and maintain data pipelines; build data models; optimize ETL; ensure data quality and security; collaborate with data teams.
Python, SQL, Tableau, Power BI, Qlik Sense, Databricks, Palantir Foundry, PySpark
3w
Save
Mark Applied
Hide
Senior Principal, Data Engineering
Arlington or O'Fallon
$212k-$390k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Design, build, and operate enterprise-scale cloud-native data platforms across AWS and Azure; hands-on Spark/PySpark and Python experience; Infrastructure-as-Code and CI/CD; strong cloud security and data governance expertise.
AWS S3, Amazon EC2, AWS Lambda, AWS Glue, Amazon Redshift, Amazon EMR, Amazon Athena, AWS Lake Formation, Databricks, Azure Data Factory, Azure Synapse, Azure Fabric, Azure Data Lake, Terraform, CloudFormation, Bicep/ARM, Azure DevOps, GitLab CI/CD, Spark, PySpark, Python, Bash, PowerShell, Docker, Kubernetes, ECS, AKS, CloudWatch, Azure Monitor, ELK, Grafana
3mo
Save
Mark Applied
Hide
Sr AI Engineer / Data Scientist
Chesterfield, Missouri, United States
RemoteFull Time, Contract
Koantek
Koantek: Systems integrator delivering Databricks-powered data and AI solutions.
4+ YOE4+ years hands-on experience building, deploying, and managing ML models in production; strong client-facing delivery mindset; expertise in ML, MLOps, GenAI/NLP.
Docker, Databricks, MLOps, LLMs, NLP, Apache Spark, CI/CD
2mo
Save
Mark Applied
Hide
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yr OnsiteFull Time
Absolute Business Solutions Corp
Absolute Business Solutions Corp: Provides technology and intelligence services to the US government.
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
Apache Spark, PySpark, Scala, Delta Lake, Parquet, Structured Streaming, Kubernetes, Docker, S3, AWS, GCP, Azure, Git, Jenkins, Python, Bash, Terraform, Iceberg
2mo
Save
Mark Applied
Hide
Data Platform Architect
Florissant, Missouri, United States
OnsiteFull Time
Augustine Institute
Augustine Institute: Provides Catholic theological education and media for faith formation.
7+ YOE7+ years in data engineering/architecture; experience designing lakehouse/data warehouse architectures at scale; Databricks, Spark, Delta Lake; ETL/ELT with dbt/Airflow; data governance; legacy modernization; BI tools; AI/ML data patterns
Databricks, Apache Spark, Delta Lake, dbt, Airflow
1mo
Save
Mark Applied
Hide
Senior Developer
Scott Air Force Base or St. Louis
OnsiteFull Time
D&G Solutions
D&G Solutions: A small business that provides data and technology solutions in support of defense and government customers, emphasizing people-first culture and mission focus.
5+ YOEBachelor's in CS/data field, 5+ years in data engineering or software development, active Secret clearance with TS/SCI eligibility, strong SQL and Python, experience with Spark, Kafka, cloud platforms, and data integration.
SQL, Python, Apache Spark, Kafka, Databricks, Palantir Ontology, Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform, Maven Smart Systems, RESTful web services
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
NISC
NISC: Develops enterprise software for energy and telecommunications cooperatives.
5+ YOE5+ years software development experience preferred; full-stack and data engineering experience; Databricks, Delta Lake, Spark, big data, AWS services, Java/Scala, Docker/Kubernetes, CI/CD, and strong analytical skills.
Databricks, Delta Lake, Apache Spark, Hadoop, Kafka, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, SQL, MDM
1mo
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan or United States or North America
HybridFull Time
NISC
NISC: Provides enterprise software solutions for utility and broadband cooperatives.
5+ YOE5+ years software development experience; full-stack/cloud background with strong data engineering skills (Databricks/Delta Lake, Apache Spark, Kafka). Experience building and optimizing data pipelines, ETL/ELT, AWS services, relational and NoSQL databases, Java/Scala, Docker/Kubernetes, and CI/CD tools.
Databricks, Delta Lake, Apache Spark, Kafka, AWS, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, MDM, SQL
3d
Save
Mark Applied
Hide
Software Engineer
St. Louis, Missouri, United States
$30-$47/hr HybridFull Time
Merck
MerckXETRA: MRK: A science and technology providing healthcare, life science, and electronics solutions.
1+ YOEBachelor's in CS or related,1+ year AI/ML model training and deployment,experience with autonomous agent frameworks (LangChain,CrewAI,AutoGen),Python/R and ML frameworks,cloud and data tool familiarity.
TensorFlow, PyTorch, Scikit-learn, Pandas, NumPy, SQL, AWS, Google Cloud, Azure, Apache Spark, Airflow, Docker, LangChain, CrewAI, AutoGen, Python, R
2mo
Save
Mark Applied
Hide
Databricks Architect
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Minneapolis or Nashville or New Brunswick or New York or Philadelphia or Raleigh or Seattle or St. Louis or Tampa
$106k-$200k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
8+ YOE8+ years in data engineering/architecture with 4+ years on Databricks, experience designing Lakehouse solutions (Delta Lake, Delta Live Tables, Unity Catalog), cloud platform expertise (AWS/Azure/GCP), strong programming (Java/Python/PySpark) and data modeling skills.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables, Unity Catalog, AWS, Azure, GCP, Star Schema, Data Vault, Java, Python, PySpark, NoSQL
2w
Save
Mark Applied
Hide
Manager, Field Engineering - MFG
Texas or Illinois or St. Louis
$173k-$237k/yr RemoteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
7+ YOE3+ Mgmt3+ years leading technical pre-sales teams, 7+ years in Data + AI, ability to hire/coach SAs, technical competence in data/AI architectures, trusted advisor to technical executives.
Apache Spark, Delta Lake, MLflow