17 spark data engineer jobs at 12 companies in Upper Saint Clair, PA

1mo
Save
Mark Applied
Hide
Kafka/Spark Developer
Pittsburgh, Pennsylvania, United States
$71k-$157k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years in big data development with hands-on Kafka, Spark, Hadoop, Impala, strong Java/Scala/Python skills, SQL proficiency, and experience in Agile teams.
Apache Kafka, Apache Spark, Hadoop Ecosystem (HDFS), Impala, PySpark, Scala, Java, Kafka Connect, Schema Registry, Hive, Oracle, PostgreSQL, Python, SQL, Neo4j
3d
Save
Mark Applied
Hide
Data Engineer
Pittsburgh, Pennsylvania, United States
$90k-$176k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
6+ YOE6+ years data engineering experience; expertise with Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3, data lake and Hive/Iceberg, CI/CD, shell scripting, and data governance.
Apache Spark, Spark Core, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, SQL, Apache Airflow, CA7, Control M, Jenkins, Python, MongoDB, GraphQL, Azure, LangGraph, Large Language Model (LLM), Machine Learning, CI/CD
3mo
Save
Mark Applied
Hide
Senior Data Engineer (Cranberry Township, US)
Cranberry Township, Pennsylvania, United States
$117k-$146k/yr HybridFull Time
WECTEC Staffing Services
WECTEC Staffing Services: Provides technical staffing and contingent labor for energy industries.
5+ YOE5+ years data engineering/analysis/reporting; Bachelor's in Computer Science/Data Engineering or related field; experience with Databricks Lakehouse, Spark, Oracle, PowerBI, SQL Server, Python, ETL
Databricks, Spark, Oracle, PowerBI, SQL Server, Python, ETL
2mo
Save
Mark Applied
Hide
Senior Vice President, Data Pipeline Engineer – Ontology & Investment Data Standard (IDS)
Pittsburgh or Lake Mary
$104k-$200k/yr OnsiteFull Time
BNY
BNYNYSE: BK: Global institution managing and servicing financial assets worldwide.
6+ YOEBachelor's degree or equivalent; 6+ years data engineering/BI experience; Python, Spark, SQL; ETL/ELT; cloud (Snowflake/AWS/Databricks); knowledge graph/ontology experience preferred; strong data modeling and lineage; financial data domain familiarity.
Python, Spark, SQL, ETL/ELT, Snowflake, AWS, Databricks
4d
Save
Mark Applied
Hide
Data Engineer - Clearance Required
Pittsburgh or United States
$101k-$175k/yr OnsiteFull Time
LMI
LMI: Delivers management, technology, and analytics solutions for federal agencies.
3+ YOE3+ years data engineering with Palantir Foundry and Databricks experience; proficiency in Python, PySpark, SQL; experience with ontologies, pipelines, and CI/CD; active or eligible Secret clearance required.
Palantir Foundry (Vantage), Databricks, Python, PySpark, SQL, TypeScript, JavaScript, Delta Lake, Spark, Git, Foundry AIP, OpenAI, Anthropic Claude, LangChain, Storybook, D3.js, Plotly, Recharts
4d
Save
Mark Applied
Hide
Data Engineer - Clearance Required
Pittsburgh or United States
$101k-$175k/yr OnsiteFull Time
LMI
LMI: Provides management consulting and digital solutions to federal government agencies.
3+ YOE3+ years data engineering with Palantir Foundry and Databricks, proficiency in Python and SQL, Foundry pipeline development (PySpark/Pipeline Builder), Git/CI/CD, leadership/mentorship experience, and ability to obtain Active Secret clearance.
Palantir Foundry (Vantage), Foundry Workshop, Foundry AIP, Databricks, Delta Lake, Spark, PySpark, Pipeline Builder, Python, SQL, pandas, numpy, D3.js, Plotly, Recharts, TypeScript, JavaScript, Git, Storybook, OpenAI, Anthropic Claude, LangChain
3w
Save
Mark Applied
Hide
Data Engineer - Databricks - Local to Pittsburgh, PA
Pittsburgh, Pennsylvania, United States
$80k-$139k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years Azure Databricks experience with Unity Catalog, Apache Spark/PySpark, SQL, Delta Lake, Azure data services, data governance, CI/CD, and Investment/Capital Markets domain experience.
Azure Databricks, Unity Catalog, Apache Spark, PySpark, SQL, Delta Lake, Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), Microsoft Azure, Git, Terraform, Bicep, Azure Purview, Microsoft Purview
1mo
Save
Mark Applied
Hide
Senior Data Engineer with DevOps
Pittsburgh or Cleveland or Dallas
$80k-$139k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years data engineering experience; strong Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3; CI/CD and containerization skills; Linux and scripting proficiency.
Apache Spark, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, Apache Airflow, Linux, Docker, OpenShift, Kubernetes, Jenkins, GitHub Actions, Azure DevOps, GitLab CI, Maven, Gradle, Python, Bash, PowerShell, Application Insights, ELK, Elastic Stack, Elasticsearch, GitHub, Hadoop, JSON Web Token (JWT), SQLite, Shell Script
2mo
Save
Mark Applied
Hide
Data Scientist Senior - Data, Model & Analytics
Pittsburgh or Tysons Corner or Washington
$78k-$187k/yr OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEMaster's degree in data science, computer science, engineering, or related field; 5+ years of data science/ML experience in industry with 2+ years NLP; strong math/stats; expert Python, PyTorch, Spark, SQL; ML deployment and big data/cloud experience.
Python, PyTorch, Spark, SQL, MLOps
3w
Save
Mark Applied
Hide
Engineer
Pittsburgh, Pennsylvania, United States
$90k-$110k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOEBachelor in Computer Science, 8+ years experience in data/feature engineering or ML engineering; production feature pipelines, Python and SQL, Spark/Flink, cloud platforms; mentoring experience.
Python, SQL, Spark, Flink, Hopsworks, Feast, SageMaker, Azure, AWS, GCP
3w
Save
Mark Applied
Hide
Engineer
Pittsburgh, Pennsylvania, United States
$100k-$120k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years in data/feature/ML engineering, production-grade feature pipelines, Python and SQL, Spark/Flink, cloud platforms, feature stores, and technical leadership experience.
Python, SQL, Spark, Flink, Hopsworks, Feast, SageMaker, CI/CD, Azure, AWS, GCP
3w
Save
Mark Applied
Hide
Engineer
Pittsburgh, Pennsylvania, United States
$120k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years in data/feature/ML engineering, production-grade feature pipelines, Python and SQL proficiency, Spark/Flink and cloud platform experience, mentoring and leadership experience.
Python, SQL, Spark, Flink, Hopsworks, Feast, SageMaker, Azure, AWS, GCP
3mo
Save
Mark Applied
Hide
Software Engineer, Labelling, Data & Automation
Toronto or San Francisco or Dallas or Pittsburgh or United States or Canada
$127k-$225k/yr HybridFull Time
Waabi
Waabi: Develops Physical AI for autonomous trucking and robotaxis.
4+ YOE4+ years of industry experience; Bachelor's in computer science/engineering/ML or related; proficient in Python; strong software engineering fundamentals; experienced with data pipelines; good communication; cloud orchestration knowledge.
Python, Hadoop, Spark, Airflow, Terraform, CloudFormation, Google Dataflow, AWS Step Functions
1mo
Save
Mark Applied
Hide
Data & AI Strategy - Senior Advisor
New York or Pittsburgh or Dallas or Toronto
$175k-$220k/yr HybridFull Time
Wavestone
WavestoneEuronext Paris: WAVE: Provides strategic management and digital transformation consulting services.
8+ YOE2+ Mgmt8+ years in data engineering/architecture/analytics with 2+ years leadership; advanced Python, SQL, Spark, Databricks; experience with cloud platforms (Azure, AWS, GCP, Snowflake); consulting and executive stakeholder experience.
Azure, AWS, GCP, Snowflake, Databricks, Python, SQL, Spark, Airflow
3mo
Save
Mark Applied
Hide
Sr Application Developer
Pittsburgh or Warrendale
HybridFull Time
Federated Hermes
Federated HermesNYSE: FHI: Global investment management firm providing diversified financial strategies.
5+ YOEBachelor's in CS/Engineering, 5+ years programming experience including ≥1 year with big data (Databricks preferred). Experience with Python, SQL, Azure, data lakehouse principles, Kimball modeling, version control. CI/CD and Databricks certification preferred.
Databricks, Python, SQL, Azure, Spark, Delta Lake, PySpark
1d
Save
Mark Applied
Hide
Artificial Intelligence Engineer
Pittsburgh, Pennsylvania, United States
HybridFull Time
Aires
Aires: Provides corporate relocation and global mobility management services.
Bachelor's in Computer Science, strong ML and generative AI knowledge, experience with cloud AI tools, data preprocessing, model training/validation, and integrating AI into products.
Azure OpenAI, AWS bedrock, Python, Spark, TensorFlow, scikit-learn, Microsoft Office
1mo
Save
Mark Applied
Hide
Senior Manager, Healthcare Solutions Architect
Pittsburgh or United States
$94k-$154k/yr RemoteFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
12+ YOE5+ Mgmt12+ years in software technology, 5+ years senior product/platform leadership, bachelor’s in computer science, experience launching enterprise-scale platforms in regulated, data-intensive healthcare environments; strong healthcare payer domain knowledge preferred.
Python, Spark, SQL, dotNet, Databricks, SqlServer, Oracle, Postgress, Microsoft Power BI, Tableau, GitOps, Infrastructure as Code, OCR, Windows, Linux, Azure, ADF, ADLS, Synapse, LLM frameworks, NLP, Agentic AI, generative AI