30 spark data engineer jobs at 20 companies in Berkeley, MO
3mo
Save
Mark Applied
Hide
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yr OnsiteFull Time
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
Apache Spark, PySpark, Scala, Delta Lake, Parquet, Structured Streaming, Kubernetes, Docker, S3, AWS, GCP, Azure, Git, Jenkins, Python, Bash, Terraform, Iceberg
1mo
Save
Mark Applied
Hide
Data Engineer
Carmel or St. Louis
HybridFull Time
2+ YOE2+ years building data engineering or data platform solutions; experience with Python/Java/Scala, SQL, Spark/Databricks/Snowflake/Redshift/Azure Fabric/AWS Glue/Azure Data Factory, and AWS or Azure; strong collaboration and communication skills.
Python, Java, Scala, SQL, Spark, Databricks, Snowflake, Redshift, Azure Fabric, AWS Glue, Azure Data Factory, AWS, Azure, CI/CD, infrastructure-as-code, Claude Code, Cursor, Kiro, NoSQL
3w
Save
Mark Applied
Hide
Data Engineer - TRANSCOM
Scott Air Force Base, Illinois, United States
$130k-$155k/yr OnsiteFull Time
3+ YOETop Secret clearance required, 3+ years data/software engineering experience, experience with Python, SQL, Spark/Databricks, Palantir Foundry, ML model development and deployment; bachelor’s preferred.
Palantir's MSS Workshop, Slate, Palantir Foundry, Python, SQL, Spark, Databricks, PySpark, scikit-learn, TensorFlow, XGBoost, AWS, Azure
1mo
Save
Mark Applied
Hide
Data Engineer
St Louis, Missouri, United States
HybridFull Time
5+ YOE5+ years data engineering experience, bachelor’s in CS/IS/data engineering, skilled in SQL, Python, Spark, cloud data platforms (Microsoft Azure), ETL/ELT design, API integrations, and data modeling.
SQL, Python, Spark, Microsoft Azure, Data Factory, Synapse, Databricks, Data Lake, Power PI, Tableau, Looker, Microsoft Dynamics 365, Salesforce
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Beavercreek or Dayton or St. Louis or United States
OnsiteFull Time
5+ YOEBS degree, 5+ years experience, DoD Top Secret clearance required, proficiency with Python, SQL, Spark, orchestration tools (Airflow, Dagster, Argo Workflow), data modeling, cloud-native deployment, and strong communication skills.
Python, SQL, Spark, Airflow, Dagster, Argo Workflow, Kubernetes
2mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
2w
Save
Mark Applied
Hide
Data Engineer
O'Fallon, Illinois, United States
$62k-$141k/yr OnsiteFull Time
2+ YOE2+ years experience with Python and scalable data stores, ETL/ELT workflows, processing structured/unstructured data, scripting, and working in cross-functional teams; Secret clearance and Bachelor's degree required.
Python, C++, Java, Linux, SQL, Scala, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake, UNIX, Shell
2mo
Save
Mark Applied
Hide
Data Engineer Software Developer
Scott AFB, Illinois, United States
$99k-$106k/yr OnsiteFull Time
4+ YOEUS citizen with active Secret clearance, Bachelor's in CS/Engineering, 4+ years experience building data pipelines, proficiency with Kafka/Elastic/AWS/OpenShift, Python/Java/SQL, Linux, CI/CD, and ability to work onsite at Scott AFB.
Confluent Kafka, Elastic Stack, AWS, Red Hat OpenShift, Kubernetes, Kafka, Elastic, Logstash, Kibana, React, JavaScript, HTML, AWS Redshift, S3, Hadoop, Snowflake, Python, Java, SQL, shell scripting, Elasticsearch, Spark, NiFi, Databricks, ELK Stack, Azure, GCP, AWS GovCloud, Ansible, Puppet, Chef, Prometheus, Grafana, Git, Bitbucket, Atlassian JIRA, Confluence, CI/CD
4d
Save
Mark Applied
Hide
Senior Data Engineer - Secret Clearance
Shiloh or Saint Louis
$85k-$130k/yr OnsiteFull Time
10+ YOERequires U.S. citizenship, active Secret clearance, 10+ years of experience, and strong SQL, ETL, Python, Spark, Scala, JavaScript/JSON, BI, and large-dataset skills.
SQL, Python, Databricks, Spark, Scala, JavaScript, JSON, Jupyter Notebooks, Cognos Analytics, Qlik Sense, Power BI, Amazon Web Services, AWS, Amazon S3, Teradata, Multiload, BTEQ, DEAMS, TFMS, NERP
1mo
Save
Mark Applied
Hide
Financial Data Engineer
Clayton, Missouri, United States
HybridFull Time
5+ YOEBachelor's in a quantitative field; 5+ years building, loading, transforming and analyzing data; 5+ years with GCP; scripting/coding experience; proficiency with Python, SQL, BigQuery, Airflow/Cloud Composer; ETL and data modeling experience.
GCP, Python, Airflow, Cloud Composer, Jenkins, Astronomer, Spark, BigQuery, SQL, ETL, Tableau, Looker, Spotfire, ML, AI, RPA
1mo
Save
Mark Applied
Hide
Lead - Data / AI Native Engineer
St. Louis, Missouri, United States
$120k/yr OnsiteFull Time
8+ YOE3+ Mgmt8+ years data/software engineering experience, 3+ years leading data initiatives, proven enterprise-scale data platform and pipeline experience, cloud-native analytics and AI solutions experience.
Spark, PySpark, GitHub Copilot, Claude Code CLI, AWS, Databricks, AWS EMR
2mo
Save
Mark Applied
Hide
Senior Principal, Data Engineering
Arlington or O'Fallon
$212k-$390k/yr OnsiteFull Time
Design, build, and operate enterprise-scale cloud-native data platforms across AWS and Azure; hands-on Spark/PySpark and Python experience; Infrastructure-as-Code and CI/CD; strong cloud security and data governance expertise.
AWS S3, Amazon EC2, AWS Lambda, AWS Glue, Amazon Redshift, Amazon EMR, Amazon Athena, AWS Lake Formation, Databricks, Azure Data Factory, Azure Synapse, Azure Fabric, Azure Data Lake, Terraform, CloudFormation, Bicep/ARM, Azure DevOps, GitLab CI/CD, Spark, PySpark, Python, Bash, PowerShell, Docker, Kubernetes, ECS, AKS, CloudWatch, Azure Monitor, ELK, Grafana
2w
Save
Mark Applied
Hide
Data Engineer
O'Fallon, Illinois, United States
$62k-$141k/yr OnsiteFull Time
2+ YOE2+ years experience; proficiency with Python and scalable data stores; experience building ETL/ELT pipelines, parsing structured and unstructured data; ability to script data conversions; Secret clearance and bachelor's degree required.
Python, C++, Java, Linux, SQL, Scala, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake, UNIX, Shell
3mo
Save
Mark Applied
Hide
Data Platform Architect
Florissant, Missouri, United States
OnsiteFull Time
7+ YOE7+ years in data engineering/architecture; experience designing lakehouse/data warehouse architectures at scale; Databricks, Spark, Delta Lake; ETL/ELT with dbt/Airflow; data governance; legacy modernization; BI tools; AI/ML data patterns
Databricks, Apache Spark, Delta Lake, dbt, Airflow
1d
Save
Mark Applied
Hide
Azure AI Data Architect
Saint Louis, Missouri, United States
$82k-$178k/yr OnsiteFull Time
10+ YOEBachelor's or Master's degree and 10+ years in data engineering, architecture, analytics, or cloud architecture; 5+ years designing Azure solutions; expertise in enterprise data platforms, AI/ML, programming, governance, and DevOps.
Microsoft Azure, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL, Azure Data Lake Storage Gen2, Azure AI Services, Azure Machine Learning, Azure OpenAI, Azure AI Foundry, Python, SQL, Spark, PySpark, Microsoft Purview, Terraform, Bicep, ARM Templates, Microsoft Fabric, Azure Kubernetes Service (AKS)
1mo
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
5+ YOE5+ years software development experience; proficiency with Databricks, Delta Lake, Spark, AWS, Java or Scala, data pipelines, and cloud-based full‑stack development.
Databricks, Delta Lake, Spark, Kafka, AWS, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, MDM, SQL, CI/CD
2mo
Save
Mark Applied
Hide
Software Developer II - Meter Data Management Software (Full Stack, Databricks)
Cedar Rapids or Lake Saint Louis or Mandan
HybridFull Time
5+ YOE5+ years software development experience preferred; full-stack and data engineering experience; Databricks, Delta Lake, Spark, big data, AWS services, Java/Scala, Docker/Kubernetes, CI/CD, and strong analytical skills.
Databricks, Delta Lake, Apache Spark, Hadoop, Kafka, S3, Lambda, EC2, EMR, SQS, SNS, CloudWatch, Oracle, Postgres, Cassandra, DynamoDB, Java, Scala, Docker, Kubernetes, JIRA, Confluence, Bitbucket, Bamboo, Python, JavaScript, Bash, Angular, Spring Boot, SQL, MDM
2w
Save
Mark Applied
Hide
Lead Data Architect
St. Louis or New York City or United States
$130k-$150k/yr HybridFull Time
15+ YOE15+ years in data management, analytics, engineering, or enterprise architecture; expertise in data platforms, architecture, governance, AI, and large transformation programs; banking or regulated-industry experience; bachelor's or master's degree preferred.
Informatica PowerCenter, IDMC, IICS, Netezza, Oracle, PostgreSQL, Snowflake, Databricks, Spark, PySpark, SQL, Azure
2w
Save
Mark Applied
Hide
Machine Learning Engineer
United States or Missouri or St. Louis or Boston
$160k-$180k/yr RemoteFull Time
3+ YOEBachelor’s or Master’s degree in a technical field; 3+ years of ML engineering or related experience; Python, ML frameworks, data processing, Docker, Kubernetes, Git, and cloud platform experience.
Python, TensorFlow, PyTorch, scikit-learn, Pandas, Spark, Dask, Docker, Kubernetes, Git, AWS, Azure, GCP, SageMaker, Vertex AI, Databricks, Snowflake ML
2w
Save
Mark Applied
Hide
Lead AI / ML Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$294k/yr HybridFull Time
6+ YOERequires 6+ years developing AI/ML solutions, programming in Python, R, or Java, machine learning frameworks, data analysis, cloud platforms, and strong communication skills.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Azure, Google Cloud, D3.js, ggplot
Explore Jobs