32 pyspark data engineer jobs at 20 companies in Berkeley, MO
3d
Save
Mark Applied
Hide
Data Engineer
Atlanta or Chicago or Fairview Heights or Houston or Arlington
$89k-$148k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5 years of data engineering or software development experience. Requires U.S. citizenship or green card, ability to obtain Public Trust, Java, Python, SQL, PySpark, ETL, databases, Databricks, APIs, and CI/CD experience.
SQL, R, Python, Git, Docker, Kubernetes, Java, PySpark, RESTful, SOAP, Co-Pilot, CodeX, MySQL, PostgreSQL, SQL Server, MongoDB, Databricks, GitHub, Jira, Confluence, Kibana, Tableau, Spring Boot
2mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
1mo
Save
Mark Applied
Hide
Data Engineer, Data Solutions
St. Louis, Missouri, United States
OnsiteFull Time
5+ YOE5+ years ETL/ELT experience, 3+ years SQL, proficiency with Python or C#, AWS (Lambda,S3), Airflow, Databricks/PySpark; strong analytical, troubleshooting, and customer-support skills.
SQL, Python, C#, AWS, AWS Lambda, S3, Airflow, Databricks, PySpark, Microsoft SQL Server, PostgreSQL, SSIS
2d
Save
Mark Applied
Hide
Data Engineer
Scott Air Force Base or St. Louis or United States
OnsiteFull Time
Bachelor's degree in a relevant technical field, 5+ years of data engineering or software development experience, SQL and Python proficiency, cloud and data pipeline experience, and active Secret clearance.
SQL, Python, Databricks, Palantir Ontology, Apache Spark, Kafka, Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform, Maven Smart Systems
4w
Save
Mark Applied
Hide
SAS Data Engineer
Saint Louis, Missouri, United States
$105k-$120k/yr RemoteFull Time
7+ YOE7+ years SAS programming experience, strong Python and PySpark skills, SAS migration and QA experience, advanced SQL, testing and reconciliation expertise, and strong stakeholder communication.
SAS, Python, PySpark, Databricks, Snowflake, SQL
3w
Save
Mark Applied
Hide
Data Engineer - TRANSCOM
Scott Air Force Base, Illinois, United States
$130k-$155k/yr OnsiteFull Time
3+ YOETop Secret clearance required, 3+ years data/software engineering experience, experience with Python, SQL, Spark/Databricks, Palantir Foundry, ML model development and deployment; bachelor’s preferred.
Palantir's MSS Workshop, Slate, Palantir Foundry, Python, SQL, Spark, Databricks, PySpark, scikit-learn, TensorFlow, XGBoost, AWS, Azure
1mo
Save
Mark Applied
Hide
Financial Data Engineer
St. Louis, Missouri, United States
HybridFull Time
5+ YOEBachelor's degree in a quantitative field and 5+ years of data engineering, GCP or cloud, and scripting experience; proficiency in Python, SQL, BigQuery, and Airflow or Cloud Composer.
Google Cloud Platform (GCP), Python, Apache Airflow, Jenkins, Astronomer, Apache Spark, SQL, BigQuery, Cloud Composer, Tableau, Looker, Spotfire, RPA, ML, AI, ETL
1mo
Save
Mark Applied
Hide
Senior Principal, Data Engineering
Arlington or O'Fallon
$212k-$390k/yr OnsiteFull Time
Design, build, and operate enterprise-scale cloud-native data platforms across AWS and Azure; hands-on Spark/PySpark and Python experience; Infrastructure-as-Code and CI/CD; strong cloud security and data governance expertise.
AWS S3, Amazon EC2, AWS Lambda, AWS Glue, Amazon Redshift, Amazon EMR, Amazon Athena, AWS Lake Formation, Databricks, Azure Data Factory, Azure Synapse, Azure Fabric, Azure Data Lake, Terraform, CloudFormation, Bicep/ARM, Azure DevOps, GitLab CI/CD, Spark, PySpark, Python, Bash, PowerShell, Docker, Kubernetes, ECS, AKS, CloudWatch, Azure Monitor, ELK, Grafana
1mo
Save
Mark Applied
Hide
Lead - Data / AI Native Engineer
St. Louis, Missouri, United States
$120k/yr OnsiteFull Time
8+ YOE3+ Mgmt8+ years data/software engineering experience, 3+ years leading data initiatives, proven enterprise-scale data platform and pipeline experience, cloud-native analytics and AI solutions experience.
Spark, PySpark, GitHub Copilot, Claude Code CLI, AWS, Databricks, AWS EMR
3mo
Save
Mark Applied
Hide
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yr OnsiteFull Time
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
Apache Spark, PySpark, Scala, Delta Lake, Parquet, Structured Streaming, Kubernetes, Docker, S3, AWS, GCP, Azure, Git, Jenkins, Python, Bash, Terraform, Iceberg
3mo
Save
Mark Applied
Hide
Data Platform Architect
Florissant, Missouri, United States
OnsiteFull Time
7+ YOE7+ years in data engineering/architecture; experience designing lakehouse/data warehouse architectures at scale; Databricks, Spark, Delta Lake; ETL/ELT with dbt/Airflow; data governance; legacy modernization; BI tools; AI/ML data patterns
Databricks, Apache Spark, Delta Lake, dbt, Airflow
1d
Save
Mark Applied
Hide
Azure AI Data Architect
Saint Louis, Missouri, United States
$82k-$178k/yr OnsiteFull Time
10+ YOEBachelor's or Master's degree and 10+ years in data engineering, architecture, analytics, or cloud architecture; 5+ years designing Azure solutions; expertise in enterprise data platforms, AI/ML, programming, governance, and DevOps.
Microsoft Azure, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL, Azure Data Lake Storage Gen2, Azure AI Services, Azure Machine Learning, Azure OpenAI, Azure AI Foundry, Python, SQL, Spark, PySpark, Microsoft Purview, Terraform, Bicep, ARM Templates, Microsoft Fabric, Azure Kubernetes Service (AKS)
2mo
Save
Mark Applied
Hide
Intern - AI/ML Data Engineering - Onsite - St. Louis
Saint Louis, Missouri, United States
OnsitePart Time, Internship
Currently pursuing a Bachelor's or Master's in CS, Data Science, Engineering, Math or related; basic programming (Python preferred); foundational statistics/ML and data analysis knowledge; exposure to SQL, Python libraries, cloud platforms, and Git; ≤2 years professional experience preferred.
Python, Pandas, NumPy, scikit-learn, PySpark, SQL, Microsoft Azure, Copilot Agents, Microsoft Power BI, Tableau, Git
2mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
2w
Save
Mark Applied
Hide
Lead Data Architect
St. Louis or New York City or United States
$130k-$150k/yr HybridFull Time
15+ YOE15+ years in data management, analytics, engineering, or enterprise architecture; expertise in data platforms, architecture, governance, AI, and large transformation programs; banking or regulated-industry experience; bachelor's or master's degree preferred.
Informatica PowerCenter, IDMC, IICS, Netezza, Oracle, PostgreSQL, Snowflake, Databricks, Spark, PySpark, SQL, Azure
2mo
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
5+ YOE5+ years software development experience preferred; full-stack and data engineering experience; Databricks, Delta Lake, Spark, big data, AWS services, Java/Scala, Docker/Kubernetes, CI/CD, and strong analytical skills.
Databricks, Delta Lake, Apache Spark, Hadoop, Kafka, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, SQL, MDM
5d
Save
Mark Applied
Hide
Software Developer - Meter Data Management Software (Full Stack, Back End)
Atlanta or Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
1+ YOE1+ year software development experience; full-stack cloud experience; JavaScript, Angular, TypeScript, Java or Scala; AWS, databases, ETL/ELT, Docker, Kubernetes, CI/CD, and strong analytical skills.
JavaScript, Angular, TypeScript, Java, Scala, Amazon Web Services (AWS), Amazon S3, AWS Lambda, Amazon EC2, Amazon EMR, Amazon SQS, Amazon SNS, Amazon CloudWatch, Oracle, PostgreSQL, Cassandra, Amazon DynamoDB, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, Delta Lake, Apache Spark, SQL, CI/CD, Agile
2d
Save
Mark Applied
Hide
Director - AI Engineering
Austin or Chicago or Dallas or Detroit or Minneapolis or St. Louis
$215k-$275k/yr OnsiteFull Time
10+ YOE5+ MgmtRequires 10+ years in AI, ML, data science, or software engineering; 8+ years building production services; 5+ years leadership; 2+ years delivering GenAI systems; strong Python, SQL, cloud, RAG, MLOps, and consulting experience.
Python, SQL, PySpark, FastAPI, Pydantic, Microsoft Foundry, Azure Machine Learning, Amazon Bedrock, Amazon SageMaker, Google Vertex AI, Gemini, OpenAI, Anthropic, Hugging Face, LangGraph, LangChain, LlamaIndex, Semantic Kernel, Azure AI Search, OpenSearch, Pinecone, Weaviate, pgvector, Databricks, Snowflake, Spark, Delta Lake, MLflow, Docker, Kubernetes, GitHub Actions, Azure DevOps, GitLab CI, Terraform, OpenTelemetry
4d
Save
Mark Applied
Hide
IT Specialist (DATAMGT)
Fresno or Washington or Jacksonville or Chamblee or Fairview Heights or Covington or Lanham or Detroit or Kansas City or Saint Louis or Holtsville or Philadelphia or Guaynabo or San Juan or Memphis or Austin or Farmers Branch or Ogden or Kearneysville
$126k-$193k/yr HybridFull Time
1+ YOERequires one year of GS-13-equivalent specialized experience, advanced IT and data engineering expertise, ETL/ELT pipeline experience, data modeling, governance, Databricks, and CI/CD experience.
Databricks, Apache Spark, GitHub, GitHub Actions, Delta Lake, Unity Catalog, Extract, Transform, Load (ETL), Extract, Load, Transform (ELT), continuous integration and continuous deployment (CI/CD)
3d
Save
Mark Applied
Hide
Databricks Architect -
St. Louis or Minneapolis or Des Moines
$88k-$215k/yr HybridFull Time
10+ YOERequires 10+ years in data engineering or architecture and 5+ years designing Databricks cloud solutions, with expertise in Spark, SQL, Delta Lake, Unity Catalog, Python, Scala, cloud platforms, ETL, and data modeling.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables, Unity Catalog, Apache Spark, Databricks SQL, Python, Scala, Databricks Repos, Jobs API, Workflows, Azure, AWS, GCP, Azure Data Factory, CI/CD, Lakebridge, SQL
Explore Jobs