14 spark data engineer jobs at 9 companies in Eighty Four, PA
2mo
Save
Mark Applied
Hide
Kafka/Spark Developer
Pittsburgh, Pennsylvania, United States
$71k-$157k/yr OnsiteFull Time
5+ YOE5+ years in big data development with hands-on Kafka, Spark, Hadoop, Impala, strong Java/Scala/Python skills, SQL proficiency, and experience in Agile teams.
Apache Kafka, Apache Spark, Hadoop Ecosystem (HDFS), Impala, PySpark, Scala, Java, Kafka Connect, Schema Registry, Hive, Oracle, PostgreSQL, Python, SQL, Neo4j
1w
Save
Mark Applied
Hide
Data Engineer
Pittsburgh, Pennsylvania, United States
$90k-$176k/yr OnsiteFull Time
6+ YOE6+ years data engineering experience; expertise with Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3, data lake and Hive/Iceberg, CI/CD, shell scripting, and data governance.
Apache Spark, Spark Core, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, SQL, Apache Airflow, CA7, Control M, Jenkins, Python, MongoDB, GraphQL, Azure, LangGraph, Large Language Model (LLM), Machine Learning, CI/CD
2d
Save
Mark Applied
Hide
Data Engineer, Senior
Pittsburgh, Pennsylvania, United States
$54-$88/hr HybridFull Time
7+ YOERequires 7+ years of relevant experience, healthcare IT data proficiency, advanced analytics, technical writing, and expertise with Java, Python, Spark, Kubernetes, ETL, AWS, and healthcare data standards.
Java, Python, Apache Spark, Kubernetes, OMOP CDM, Microsoft Fabric, AWS Lambda, Amazon S3, AWS Glue, HL7, CDA, CCDA, FHIR, ETL, SDLC, Scrum
3d
Save
Mark Applied
Hide
Big Data Engineer
Pittsburgh or Cleveland or Dallas
$100k-$130k/yr HybridFull Time
7+ YOERequires 7–10 years of data engineering experience, strong Python and Apache Spark skills, Hadoop ecosystem expertise, CA7 or Control-M experience, SQL knowledge, and technical leadership and mentoring experience.
Python, Hadoop, Hive, Impala, HDFS, Apache Spark, CA7, Control-M, SQL, Shell Scripting
2mo
Save
Mark Applied
Hide
Senior Vice President, Data Pipeline Engineer – Ontology & Investment Data Standard (IDS)
Pittsburgh or Lake Mary
$104k-$200k/yr OnsiteFull Time
6+ YOEBachelor's degree or equivalent; 6+ years data engineering/BI experience; Python, Spark, SQL; ETL/ELT; cloud (Snowflake/AWS/Databricks); knowledge graph/ontology experience preferred; strong data modeling and lineage; financial data domain familiarity.
Python, Spark, SQL, ETL/ELT, Snowflake, AWS, Databricks
1w
Save
Mark Applied
Hide
Data Engineer - Clearance Required
Pittsburgh or United States
$101k-$175k/yr HybridFull Time
3+ YOE3+ years data engineering experience building Foundry pipelines and Databricks workflows; proficiency in Python, PySpark, SQL; ontology design; familiarity with CI/CD, Git; active or eligible for Secret clearance.
Palantir Foundry (Vantage), Databricks, Python, PySpark, SQL, TypeScript, JavaScript, Delta Lake, Spark, Git, Foundry AIP, OpenAI, Anthropic Claude, LangChain, D3.js, Plotly, Recharts, Storybook, Pipeline Builder
1w
Save
Mark Applied
Hide
Data Engineer - Clearance Required
Pittsburgh or United States
$101k-$175k/yr OnsiteFull Time
3+ YOE3+ years data engineering with Palantir Foundry and Databricks, proficiency in Python and SQL, Foundry pipeline development (PySpark/Pipeline Builder), Git/CI/CD, leadership/mentorship experience, and ability to obtain Active Secret clearance.
Palantir Foundry (Vantage), Foundry Workshop, Foundry AIP, Databricks, Delta Lake, Spark, PySpark, Pipeline Builder, Python, SQL, pandas, numpy, D3.js, Plotly, Recharts, TypeScript, JavaScript, Git, Storybook, OpenAI, Anthropic Claude, LangChain
1mo
Save
Mark Applied
Hide
Data Engineer - Databricks - Local to Pittsburgh, PA
Pittsburgh, Pennsylvania, United States
$80k-$139k/yr OnsiteFull Time
5+ YOE5+ years Azure Databricks experience with Unity Catalog, Apache Spark/PySpark, SQL, Delta Lake, Azure data services, data governance, CI/CD, and Investment/Capital Markets domain experience.
Azure Databricks, Unity Catalog, Apache Spark, PySpark, SQL, Delta Lake, Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), Microsoft Azure, Git, Terraform, Bicep, Azure Purview, Microsoft Purview
1mo
Save
Mark Applied
Hide
Senior Data Engineer with DevOps
Pittsburgh or Cleveland or Dallas
$80k-$139k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience; strong Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3; CI/CD and containerization skills; Linux and scripting proficiency.
Apache Spark, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, Apache Airflow, Linux, Docker, OpenShift, Kubernetes, Jenkins, GitHub Actions, Azure DevOps, GitLab CI, Maven, Gradle, Python, Bash, PowerShell, Application Insights, ELK, Elastic Stack, Elasticsearch, GitHub, Hadoop, JSON Web Token (JWT), SQLite, Shell Script
1mo
Save
Mark Applied
Hide
Engineer
Pittsburgh, Pennsylvania, United States
$90k-$110k/yr OnsiteFull Time
8+ YOEBachelor in Computer Science, 8+ years experience in data/feature engineering or ML engineering; production feature pipelines, Python and SQL, Spark/Flink, cloud platforms; mentoring experience.
Python, SQL, Spark, Flink, Hopsworks, Feast, SageMaker, Azure, AWS, GCP
1mo
Save
Mark Applied
Hide
Engineer
Pittsburgh, Pennsylvania, United States
$100k-$120k/yr OnsiteFull Time
8+ YOE8+ years in data/feature/ML engineering, production-grade feature pipelines, Python and SQL, Spark/Flink, cloud platforms, feature stores, and technical leadership experience.
Python, SQL, Spark, Flink, Hopsworks, Feast, SageMaker, CI/CD, Azure, AWS, GCP
1mo
Save
Mark Applied
Hide
Data & AI Strategy - Senior Advisor
New York or Pittsburgh or Dallas or Toronto
$175k-$220k/yr HybridFull Time
8+ YOE2+ Mgmt8+ years in data engineering/architecture/analytics with 2+ years leadership; advanced Python, SQL, Spark, Databricks; experience with cloud platforms (Azure, AWS, GCP, Snowflake); consulting and executive stakeholder experience.
Azure, AWS, GCP, Snowflake, Databricks, Python, SQL, Spark, Airflow
1w
Save
Mark Applied
Hide
Artificial Intelligence Engineer
Pittsburgh, Pennsylvania, United States
HybridFull Time
Bachelor's in Computer Science, strong ML and generative AI knowledge, experience with cloud AI tools, data preprocessing, model training/validation, and integrating AI into products.
Azure OpenAI, AWS bedrock, Python, Spark, TensorFlow, scikit-learn, Microsoft Office
5d
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot