19 spark engineer jobs at 11 companies in Eighty Four, PA
2mo
Save
Mark Applied
Hide
2mo
Kafka/Spark Developer
Pittsburgh, Pennsylvania, United States
$71k-$157k/yrOnsiteFull Time
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years in big data development with hands-on Kafka, Spark, Hadoop, Impala, strong Java/Scala/Python skills, SQL proficiency, and experience in Agile teams.
CGINYSE: GIB: Provides information technology and business consulting services.
8+ YOE8+ years designing and developing large-scale Kafka and Spark streaming applications; proficiency with Java/Scala/Python, Kafka Connect, Schema Registry, distributed systems, and Agile practices.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOEBachelor in Computer Science, 8+ years experience in data/feature engineering or ML engineering; production feature pipelines, Python and SQL, Spark/Flink, cloud platforms; mentoring experience.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOEDesign and implement production-grade feature pipelines; advanced Python/SQL; experience with Spark/Flink and feature stores; mentoring and technical leadership experience.
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yrRemoteFull Time
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
CGINYSE: GIB: Provides information technology and business consulting services.
6+ YOE6+ years data engineering experience; expertise with Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3, data lake and Hive/Iceberg, CI/CD, shell scripting, and data governance.
Apache Spark, Spark Core, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, SQL, Apache Airflow, CA7, Control M, Jenkins, Python, MongoDB, GraphQL, Azure, LangGraph, Large Language Model (LLM), Machine Learning, CI/CD
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
7+ YOERequires 7–10 years of data engineering experience, strong Python and Apache Spark skills, Hadoop ecosystem expertise, CA7 or Control-M experience, SQL knowledge, and technical leadership and mentoring experience.
Senior Vice President, Data Pipeline Engineer – Ontology & Investment Data Standard (IDS)
Pittsburgh or Lake Mary
$104k-$200k/yrOnsiteFull Time
BNYNYSE: BK: Global institution managing and servicing financial assets worldwide.
6+ YOEBachelor's degree or equivalent; 6+ years data engineering/BI experience; Python, Spark, SQL; ETL/ELT; cloud (Snowflake/AWS/Databricks); knowledge graph/ontology experience preferred; strong data modeling and lineage; financial data domain familiarity.
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years data engineering experience; strong Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3; CI/CD and containerization skills; Linux and scripting proficiency.
UPMC: Integrated health system providing clinical care and medical insurance.
7+ YOERequires 7+ years of relevant experience, healthcare IT data proficiency, advanced analytics, technical writing, and expertise with Java, Python, Spark, Kubernetes, ETL, AWS, and healthcare data standards.
LMI: Provides management consulting and digital solutions to government agencies.
3+ YOE3+ years data engineering experience building Foundry pipelines and Databricks workflows; proficiency in Python, PySpark, SQL; ontology design; familiarity with CI/CD, Git; active or eligible for Secret clearance.
LMI: Provides management consulting and digital solutions to federal government agencies.
3+ YOE3+ years data engineering with Palantir Foundry and Databricks, proficiency in Python and SQL, Foundry pipeline development (PySpark/Pipeline Builder), Git/CI/CD, leadership/mentorship experience, and ability to obtain Active Secret clearance.
Data Engineer - Databricks - Local to Pittsburgh, PA
Pittsburgh, Pennsylvania, United States
$80k-$139k/yrOnsiteFull Time
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years Azure Databricks experience with Unity Catalog, Apache Spark/PySpark, SQL, Delta Lake, Azure data services, data governance, CI/CD, and Investment/Capital Markets domain experience.
Azure Databricks, Unity Catalog, Apache Spark, PySpark, SQL, Delta Lake, Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), Microsoft Azure, Git, Terraform, Bicep, Azure Purview, Microsoft Purview
Aires: Provides corporate relocation and global mobility management services.
Bachelor's in Computer Science, strong ML and generative AI knowledge, experience with cloud AI tools, data preprocessing, model training/validation, and integrating AI into products.
Azure OpenAI, AWS bedrock, Python, Spark, TensorFlow, scikit-learn, Microsoft Office
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yrHybridFull Time
AccentureNYSE: ACN: Global provider of management consulting and technology services.
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
Site Rel Engineer Sr. - Model Integration Platform
Cleveland or Phoenix or Pittsburgh or Denver or Birmingham or Dallas or Strongsville
$86k-$158k/yrOnsiteFull Time
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
3+ YOE3+ years experience with Linux/RHEL, site reliability, monitoring, incident response, storage and scheduler administration; proficiency with shell/bash and Python; bachelor's degree typically required.
Linux (RHEL), IBM GPFS / Spectrum Scale, Slurm Scheduler, Shell/Bash, Python, Spark, Jupyter, IBM Spectrum Conductor, AWS, Azure, Ansible, VMware, KVM, Docker, Kubernetes, Oracle, MySQL, Postgres, Tableau, Power BI, Apache Tomcat
WavestoneEuronext Paris: WAVE: Provides strategic management and digital transformation consulting services.
8+ YOE2+ Mgmt8+ years in data engineering/architecture/analytics with 2+ years leadership; advanced Python, SQL, Spark, Databricks; experience with cloud platforms (Azure, AWS, GCP, Snowflake); consulting and executive stakeholder experience.