21 spark engineer jobs at 12 companies in Millvale, PA
2mo
Save
Mark Applied
Hide
Kafka/Spark Developer
Pittsburgh, Pennsylvania, United States
$71k-$157k/yr OnsiteFull Time
5+ YOE5+ years in big data development with hands-on Kafka, Spark, Hadoop, Impala, strong Java/Scala/Python skills, SQL proficiency, and experience in Agile teams.
Apache Kafka, Apache Spark, Hadoop Ecosystem (HDFS), Impala, PySpark, Scala, Java, Kafka Connect, Schema Registry, Hive, Oracle, PostgreSQL, Python, SQL, Neo4j
1mo
Save
Mark Applied
Hide
Engineer
Pittsburgh, Pennsylvania, United States
$90k-$110k/yr OnsiteFull Time
8+ YOEBachelor in Computer Science, 8+ years experience in data/feature engineering or ML engineering; production feature pipelines, Python and SQL, Spark/Flink, cloud platforms; mentoring experience.
Python, SQL, Spark, Flink, Hopsworks, Feast, SageMaker, Azure, AWS, GCP
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
2mo
Save
Mark Applied
Hide
Senior Vice President, Full-Stack Engineer
New York or Pittsburgh
$120k-$200k/yr OnsiteFull Time
15+ YOEMinimum 15 years Java engineering experience (Java 17+), deep Java SE/EE, Spring (Batch, Boot), Hibernate; experience with Kafka, Spark, IBM Message Queues (MQ), Oracle/SQL Server, Docker, GitLab CI/CD, Angular, GraphQL, RESTful APIs, and Agile tools.
Java, Java 17+, Java SE/EE, Spring, Spring Batch, Spring Boot, Hibernate, Kafka, Spark, IBM Message Queues (MQ), Oracle, SQL Server, SQL, Docker, GitLab CI/CD, Junit, BDD, Angular, HTML5, JavaScript, GraphQL, RESTful APIs, GitHub Copilot, Windsurf, Confluence, JIRA, Kanban, .Net
5d
Save
Mark Applied
Hide
Big Data Engineer
Pittsburgh or Cleveland or Dallas
$100k-$130k/yr HybridFull Time
7+ YOERequires 7–10 years of data engineering experience, strong Python and Apache Spark skills, Hadoop ecosystem expertise, CA7 or Control-M experience, SQL knowledge, and technical leadership and mentoring experience.
Python, Hadoop, Hive, Impala, HDFS, Apache Spark, CA7, Control-M, SQL, Shell Scripting
4d
Save
Mark Applied
Hide
Data Engineer, Senior
Pittsburgh, Pennsylvania, United States
$54-$88/hr HybridFull Time
7+ YOERequires 7+ years of relevant experience, healthcare IT data proficiency, advanced analytics, technical writing, and expertise with Java, Python, Spark, Kubernetes, ETL, AWS, and healthcare data standards.
Java, Python, Apache Spark, Kubernetes, OMOP CDM, Microsoft Fabric, AWS Lambda, Amazon S3, AWS Glue, HL7, CDA, CCDA, FHIR, ETL, SDLC, Scrum
2w
Save
Mark Applied
Hide
Data Engineer - Clearance Required
Pittsburgh or United States
$101k-$175k/yr HybridFull Time
3+ YOE3+ years data engineering experience building Foundry pipelines and Databricks workflows; proficiency in Python, PySpark, SQL; ontology design; familiarity with CI/CD, Git; active or eligible for Secret clearance.
Palantir Foundry (Vantage), Databricks, Python, PySpark, SQL, TypeScript, JavaScript, Delta Lake, Spark, Git, Foundry AIP, OpenAI, Anthropic Claude, LangChain, D3.js, Plotly, Recharts, Storybook, Pipeline Builder
2w
Save
Mark Applied
Hide
Data Engineer - Clearance Required
Pittsburgh or United States
$101k-$175k/yr OnsiteFull Time
3+ YOE3+ years data engineering with Palantir Foundry and Databricks, proficiency in Python and SQL, Foundry pipeline development (PySpark/Pipeline Builder), Git/CI/CD, leadership/mentorship experience, and ability to obtain Active Secret clearance.
Palantir Foundry (Vantage), Foundry Workshop, Foundry AIP, Databricks, Delta Lake, Spark, PySpark, Pipeline Builder, Python, SQL, pandas, numpy, D3.js, Plotly, Recharts, TypeScript, JavaScript, Git, Storybook, OpenAI, Anthropic Claude, LangChain
1d
Save
Mark Applied
Hide
Quality Engineer Principal - Big Data / Hadoop / Data Warehousing
Pittsburgh or Strongsville
$91k-$169k/yr OnsiteFull Time
5+ YOEBachelor's degree and 5+ years of relevant experience. Requires Python, Big Data, Hadoop, Spark/PySpark, HQL/SQL, data warehouse and ETL testing, AWS/cloud, automation, and QA team leadership.
Python, Big Data, Hadoop, Data Warehouse, Apache Spark, PySpark, HQL, SQL, AWS, Hive, HDFS, YARN, CI/CD, Agile, Scrum, DevOps, API
1w
Save
Mark Applied
Hide
Artificial Intelligence Engineer
Pittsburgh, Pennsylvania, United States
HybridFull Time
Bachelor's in Computer Science, strong ML and generative AI knowledge, experience with cloud AI tools, data preprocessing, model training/validation, and integrating AI into products.
Azure OpenAI, AWS bedrock, Python, Spark, TensorFlow, scikit-learn, Microsoft Office
1w
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
1mo
Save
Mark Applied
Hide
Data & AI Strategy - Senior Advisor
New York or Pittsburgh or Dallas or Toronto
$175k-$220k/yr HybridFull Time
8+ YOE2+ Mgmt8+ years in data engineering/architecture/analytics with 2+ years leadership; advanced Python, SQL, Spark, Databricks; experience with cloud platforms (Azure, AWS, GCP, Snowflake); consulting and executive stakeholder experience.
Azure, AWS, GCP, Snowflake, Databricks, Python, SQL, Spark, Airflow
Explore Jobs