16 pyspark data engineer jobs at 8 companies in Export, PA

1w
Save
Mark Applied
Hide
Data Engineer
Pittsburgh, Pennsylvania, United States
$90k-$176k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
6+ YOE6+ years data engineering experience; expertise with Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3, data lake and Hive/Iceberg, CI/CD, shell scripting, and data governance.
Apache Spark, Spark Core, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, SQL, Apache Airflow, CA7, Control M, Jenkins, Python, MongoDB, GraphQL, Azure, LangGraph, Large Language Model (LLM), Machine Learning, CI/CD
1w
Save
Mark Applied
Hide
Data Engineer - Clearance Required
Pittsburgh or United States
$101k-$175k/yr OnsiteFull Time
LMI
LMI: Delivers management, technology, and analytics solutions for federal agencies.
3+ YOE3+ years data engineering with Palantir Foundry and Databricks experience; proficiency in Python, PySpark, SQL; experience with ontologies, pipelines, and CI/CD; active or eligible Secret clearance required.
Palantir Foundry (Vantage), Databricks, Python, PySpark, SQL, TypeScript, JavaScript, Delta Lake, Spark, Git, Foundry AIP, OpenAI, Anthropic Claude, LangChain, Storybook, D3.js, Plotly, Recharts
1w
Save
Mark Applied
Hide
Data Engineer - Clearance Required
Pittsburgh or United States
$101k-$175k/yr HybridFull Time
LMI
LMI: Provides management consulting and digital solutions to government agencies.
3+ YOE3+ years data engineering experience building Foundry pipelines and Databricks workflows; proficiency in Python, PySpark, SQL; ontology design; familiarity with CI/CD, Git; active or eligible for Secret clearance.
Palantir Foundry (Vantage), Databricks, Python, PySpark, SQL, TypeScript, JavaScript, Delta Lake, Spark, Git, Foundry AIP, OpenAI, Anthropic Claude, LangChain, D3.js, Plotly, Recharts, Storybook, Pipeline Builder
1w
Save
Mark Applied
Hide
Data Engineer - Clearance Required
Pittsburgh or United States
$101k-$175k/yr OnsiteFull Time
LMI
LMI: Provides management consulting and digital solutions to federal government agencies.
3+ YOE3+ years data engineering with Palantir Foundry and Databricks, proficiency in Python and SQL, Foundry pipeline development (PySpark/Pipeline Builder), Git/CI/CD, leadership/mentorship experience, and ability to obtain Active Secret clearance.
Palantir Foundry (Vantage), Foundry Workshop, Foundry AIP, Databricks, Delta Lake, Spark, PySpark, Pipeline Builder, Python, SQL, pandas, numpy, D3.js, Plotly, Recharts, TypeScript, JavaScript, Git, Storybook, OpenAI, Anthropic Claude, LangChain
4w
Save
Mark Applied
Hide
Data Engineer - Databricks - Local to Pittsburgh, PA
Pittsburgh, Pennsylvania, United States
$80k-$139k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years Azure Databricks experience with Unity Catalog, Apache Spark/PySpark, SQL, Delta Lake, Azure data services, data governance, CI/CD, and Investment/Capital Markets domain experience.
Azure Databricks, Unity Catalog, Apache Spark, PySpark, SQL, Delta Lake, Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), Microsoft Azure, Git, Terraform, Bicep, Azure Purview, Microsoft Purview
1mo
Save
Mark Applied
Hide
Senior Data Engineer with DevOps
Pittsburgh or Cleveland or Dallas
$80k-$139k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years data engineering experience; strong Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3; CI/CD and containerization skills; Linux and scripting proficiency.
Apache Spark, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, Apache Airflow, Linux, Docker, OpenShift, Kubernetes, Jenkins, GitHub Actions, Azure DevOps, GitLab CI, Maven, Gradle, Python, Bash, PowerShell, Application Insights, ELK, Elastic Stack, Elasticsearch, GitHub, Hadoop, JSON Web Token (JWT), SQLite, Shell Script
3w
Save
Mark Applied
Hide
SR. DATA SCIENCE ENGINEER SPEC-DATA SCIENTIST
Johnstown, Pennsylvania, United States
RemoteFull Time
Concurrent Technologies Corporation
Concurrent Technologies Corporation: Conducts applied research and development for national security.
3+ YOEBachelor's degree in a quantitative field, 3–5 years data science experience, proficiency in Python, SQL, PySpark, statistical and ML methods, strong communication and problem-solving skills.
Python, Pandas, NumPy, Scikit-learn, SQL, PySpark, AWS, Azure, GCP, Spark, Hadoop, Tableau, Power BI, Matplotlib, R, SAS
1mo
Save
Mark Applied
Hide
Software Engineer Principal - Data and Automation (Sagemaker, AWS CDK, Infrastructure as Code (IaC), Python, Pyspark)
Pittsburgh or Farmers Branch
OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEExperience with AWS services (SageMaker, Bedrock, EMR, Lake Formation, DataZone), Infrastructure as Code (AWS CDK or Terraform), Python and PySpark; bachelor's degree and 5+ years industry experience preferred.
SageMaker, Bedrock, EMR, Lake Formation, DataZone, AWS CDK, Terraform, Python, PySpark, Amazon SageMaker, Amazon Web Services (AWS), Apache Spark
3w
Save
Mark Applied
Hide
Senior Software Engineer (Data Engineering and Infrastructure)
Pittsburgh, Pennsylvania, United States
$146k-$234k/yr HybridFull Time
Aurora
AuroraNASDAQ: AUR: Developing autonomous driving technology for trucking and passenger mobility.
5+ YOE5+ years software engineering experience focused on data projects, proficiency in Python/Go/C++, big-data frameworks, cloud data services, SQL, Airflow and DBT; strong communication and cross-functional collaboration skills.
Python, Go, C++, Presto, Trino, EMR, Apache Spark, Flink, Kinesis Data Stream, AWS, GCP, Azure, S3, Redshift, BigQuery, Glue, SQL, DBT, Apache Airflow, Snowflake
1d
Save
Mark Applied
Hide
Software Engineer I, MLOps (Python/Big Data)
Pittsburgh or Cleveland
$75k-$150k/yr OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
2+ YOEBachelor's degree and 2+ years experience or equivalent, strong Python and big-data engineering skills, experience with MLOps, large-scale data pipelines, production support, and troubleshooting.
Python, Pandas, PySpark, PyArrow, Hadoop, Kafka, Spark Streaming, SLURM, AWS SageMaker
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Senior Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$305k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOE5+ years data engineering; 3+ years Palantir Foundry/Gotham/AIP experience; 5+ years cloud (AWS/Azure/GCP); 5+ years Python/PySpark/Java; Bachelor’s in CS/Engineering or equivalent; strong client-facing and communication skills.
Palantir Foundry, Palantir Gotham, Palantir AIP, Python, PySpark, Java, TypeScript, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
2w
Save
Mark Applied
Hide
Production Engineer
Pittsburgh or United States
$60k-$99k/yr RemoteFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
5+ YOE5+ years enterprise web application development and production support experience; strong SQL/SSRS/SSIS, .NET/C#/ReactJS, cloud, big data, and healthcare payer analytics knowledge.
.NET framework 4.0/4.5, C#.NET, ASP.NET, MVC, Web Service, IIS, HTML, CSS, XML, SOAP, JQuery, Ajax, ReactJS, NHibernate, Entity framework, SQL Server 2016, SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), Tortoise HG, SVN, Azure, AWS, Python, PySpark, DTKBarcode, Esker, Biscom, WebStart, 3M, Tableau, APM Tools (Application Performance Management), Microsoft Power BI, Microsoft Excel, CRM Systems
1mo
Save
Mark Applied
Hide
Kafka/Spark Developer
Pittsburgh, Pennsylvania, United States
$71k-$157k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years in big data development with hands-on Kafka, Spark, Hadoop, Impala, strong Java/Scala/Python skills, SQL proficiency, and experience in Agile teams.
Apache Kafka, Apache Spark, Hadoop Ecosystem (HDFS), Impala, PySpark, Scala, Java, Kafka Connect, Schema Registry, Hive, Oracle, PostgreSQL, Python, SQL, Neo4j
3w
Save
Mark Applied
Hide
Pega CDH Developer
Pittsburgh or Cleveland
$59k-$157k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
4+ YOEPega CSSA required,4+ years Pega experience (2+ in CDH),NBA/decisioning,REST integrations,PRPC,Tracer/Clipboard debugging,experience with APIs, integration patterns, and customer data/personalization.
Pega Customer Decision Hub (CDH), Next Best Action, Java, VB (.NET), Mainframe, REST APIs, Tracer, Clipboard, Live UI, PRPC, Connect-Rest, Connect-SOAP, Data Pages, Data Flows, Adobe Experience Cloud (AEP, AJO, AEM), Kafka, AWS, Azure, GCP, Kubernetes, Docker, Python, PySpark, SQL, Informatica, COBOL/DB2
2w
Save
Mark Applied
Hide
Quality Assurance Lead
Pittsburgh or Dallas or Cleveland or Birmingham
$63k-$139k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
8+ YOE8+ years QA experience, lead QA initiatives, strong Python and PySpark skills, big data and Hadoop testing experience, Oracle/SQL validation, Unix/Linux scripting, Jenkins/Git CI/CD, Docker/OpenShift experience.
Python, PySpark, Hadoop, HDFS, Hive, Impala, Sqoop, Oracle PL/SQL, SQL, Jenkins, Git, Docker, OpenShift, Unix/Linux, Control M, MLflow, AWS Glue, AWS Athena, AWS S3, AWS SageMaker