16 pyspark data engineer jobs at 8 companies in Export, PA
1w
Save
Mark Applied
Hide
1w
Data Engineer
Pittsburgh, Pennsylvania, United States
$90k-$176k/yrOnsiteFull Time
CGINYSE: GIB: Provides information technology and business consulting services.
6+ YOE6+ years data engineering experience; expertise with Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3, data lake and Hive/Iceberg, CI/CD, shell scripting, and data governance.
Apache Spark, Spark Core, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, SQL, Apache Airflow, CA7, Control M, Jenkins, Python, MongoDB, GraphQL, Azure, LangGraph, Large Language Model (LLM), Machine Learning, CI/CD
LMI: Delivers management, technology, and analytics solutions for federal agencies.
3+ YOE3+ years data engineering with Palantir Foundry and Databricks experience; proficiency in Python, PySpark, SQL; experience with ontologies, pipelines, and CI/CD; active or eligible Secret clearance required.
LMI: Provides management consulting and digital solutions to government agencies.
3+ YOE3+ years data engineering experience building Foundry pipelines and Databricks workflows; proficiency in Python, PySpark, SQL; ontology design; familiarity with CI/CD, Git; active or eligible for Secret clearance.
LMI: Provides management consulting and digital solutions to federal government agencies.
3+ YOE3+ years data engineering with Palantir Foundry and Databricks, proficiency in Python and SQL, Foundry pipeline development (PySpark/Pipeline Builder), Git/CI/CD, leadership/mentorship experience, and ability to obtain Active Secret clearance.
Data Engineer - Databricks - Local to Pittsburgh, PA
Pittsburgh, Pennsylvania, United States
$80k-$139k/yrOnsiteFull Time
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years Azure Databricks experience with Unity Catalog, Apache Spark/PySpark, SQL, Delta Lake, Azure data services, data governance, CI/CD, and Investment/Capital Markets domain experience.
Azure Databricks, Unity Catalog, Apache Spark, PySpark, SQL, Delta Lake, Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), Microsoft Azure, Git, Terraform, Bicep, Azure Purview, Microsoft Purview
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years data engineering experience; strong Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3; CI/CD and containerization skills; Linux and scripting proficiency.
Concurrent Technologies Corporation: Conducts applied research and development for national security.
3+ YOEBachelor's degree in a quantitative field, 3–5 years data science experience, proficiency in Python, SQL, PySpark, statistical and ML methods, strong communication and problem-solving skills.
Python, Pandas, NumPy, Scikit-learn, SQL, PySpark, AWS, Azure, GCP, Spark, Hadoop, Tableau, Power BI, Matplotlib, R, SAS
Software Engineer Principal - Data and Automation (Sagemaker, AWS CDK, Infrastructure as Code (IaC), Python, Pyspark)
Pittsburgh or Farmers Branch
OnsiteFull Time
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEExperience with AWS services (SageMaker, Bedrock, EMR, Lake Formation, DataZone), Infrastructure as Code (AWS CDK or Terraform), Python and PySpark; bachelor's degree and 5+ years industry experience preferred.
SageMaker, Bedrock, EMR, Lake Formation, DataZone, AWS CDK, Terraform, Python, PySpark, Amazon SageMaker, Amazon Web Services (AWS), Apache Spark
Senior Software Engineer (Data Engineering and Infrastructure)
Pittsburgh, Pennsylvania, United States
$146k-$234k/yrHybridFull Time
AuroraNASDAQ: AUR: Developing autonomous driving technology for trucking and passenger mobility.
5+ YOE5+ years software engineering experience focused on data projects, proficiency in Python/Go/C++, big-data frameworks, cloud data services, SQL, Airflow and DBT; strong communication and cross-functional collaboration skills.
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
2+ YOEBachelor's degree and 2+ years experience or equivalent, strong Python and big-data engineering skills, experience with MLOps, large-scale data pipelines, production support, and troubleshooting.
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yrHybridFull Time
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$305k/yrHybridFull Time
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOE5+ years data engineering; 3+ years Palantir Foundry/Gotham/AIP experience; 5+ years cloud (AWS/Azure/GCP); 5+ years Python/PySpark/Java; Bachelor’s in CS/Engineering or equivalent; strong client-facing and communication skills.
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
5+ YOE5+ years enterprise web application development and production support experience; strong SQL/SSRS/SSIS, .NET/C#/ReactJS, cloud, big data, and healthcare payer analytics knowledge.
.NET framework 4.0/4.5, C#.NET, ASP.NET, MVC, Web Service, IIS, HTML, CSS, XML, SOAP, JQuery, Ajax, ReactJS, NHibernate, Entity framework, SQL Server 2016, SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), Tortoise HG, SVN, Azure, AWS, Python, PySpark, DTKBarcode, Esker, Biscom, WebStart, 3M, Tableau, APM Tools (Application Performance Management), Microsoft Power BI, Microsoft Excel, CRM Systems
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years in big data development with hands-on Kafka, Spark, Hadoop, Impala, strong Java/Scala/Python skills, SQL proficiency, and experience in Agile teams.
CGINYSE: GIB: Provides information technology and business consulting services.
4+ YOEPega CSSA required,4+ years Pega experience (2+ in CDH),NBA/decisioning,REST integrations,PRPC,Tracer/Clipboard debugging,experience with APIs, integration patterns, and customer data/personalization.
Pega Customer Decision Hub (CDH), Next Best Action, Java, VB (.NET), Mainframe, REST APIs, Tracer, Clipboard, Live UI, PRPC, Connect-Rest, Connect-SOAP, Data Pages, Data Flows, Adobe Experience Cloud (AEP, AJO, AEM), Kafka, AWS, Azure, GCP, Kubernetes, Docker, Python, PySpark, SQL, Informatica, COBOL/DB2
CGINYSE: GIB: Provides information technology and business consulting services.
8+ YOE8+ years QA experience, lead QA initiatives, strong Python and PySpark skills, big data and Hadoop testing experience, Oracle/SQL validation, Unix/Linux scripting, Jenkins/Git CI/CD, Docker/OpenShift experience.