16 data lake engineer jobs at 15 companies in Pennsylvania

1mo
Save
Mark Applied
Hide
Sr. Data Lake Support Engineer
Pennsylvania, United States
RemoteFull Time
Unisys
UnisysNYSE: UIS: Provides enterprise-scale IT services and digital transformation solutions.
Strong SQL Server/T-SQL, production database support, ETL and data integration, Azure cloud experience, Windows Server and Linux support, troubleshooting and problem-solving; US citizenship required for clearance eligibility.
SQL Server, T-SQL, Azure Portal, Azure, Databricks, Kubernetes, PowerShell, ServiceNow, Power BI, Windows Server, Linux
2w
Save
Mark Applied
Hide
Data Engineer
Pittsburgh, Pennsylvania, United States
$90k-$176k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
6+ YOE6+ years data engineering experience; expertise with Apache Spark/PySpark, SQL, Airflow, data ingestion from Oracle/SQL Server/Hive/HDFS/S3, data lake and Hive/Iceberg, CI/CD, shell scripting, and data governance.
Apache Spark, Spark Core, Spark SQL, PySpark, Oracle, SQL Server, Hive, HDFS, S3, Iceberg, SQL, Apache Airflow, CA7, Control M, Jenkins, Python, MongoDB, GraphQL, Azure, LangGraph, Large Language Model (LLM), Machine Learning, CI/CD
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Indiana or Kentucky or Louisiana or Massachusetts or Maine or Maryland or Michigan or Minnesota or Missouri or North Carolina or New Jersey or New York or Oregon or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Wisconsin
$130k-$150k/yr RemoteFull Time
MissionWired
MissionWired: Providing digital fundraising and data-driven marketing for nonprofit organizations.
5+ YOE5+ years professional software engineering experience; hands-on Apache Spark and distributed data pipelines; experience managing data warehouses or lakes; mentoring and guiding technical decisions; strong data modeling and production skills.
Apache Spark, AWS, GitHub Actions, Terraform, Docker
1w
Save
Mark Applied
Hide
Senior Data Engineer
Florida or Montana or Michigan or Massachusetts or Rhode Island or West Virginia or Oregon or Oklahoma or Minnesota or New York or South Carolina or Kentucky or Virginia or Colorado or New Jersey or Wisconsin or Utah or Pennsylvania or Ohio or North Carolina or Nebraska or Mississippi or South Dakota or Maryland or Louisiana or Kansas or Iowa or Illinois or Tennessee or Delaware or Connecticut or California or Hawaii or Arkansas or District of Columbia or Georgia or Missouri or Arizona or Alabama or New Hampshire or Texas or Vermont or Indiana or Washington or Nevada or Idaho or New Mexico or Maine
$143k-$160k/yr RemoteFull Time
AmeriLife
AmeriLife: Distributes insurance, annuities, and retirement solutions for retirees.
7+ YOE7+ years data engineering experience with 3+ years Databricks; strong Spark/PySpark, Delta Lake, SQL, Azure, Git and CI/CD skills; Bachelor's degree required.
Databricks, Apache Spark, Delta Lake, Unity Catalog, Workflows, SQL Warehouses, Delta Live Tables, PySpark, SQL, Azure, Git, dbt, Terraform, Azure DevOps
1mo
Save
Mark Applied
Hide
Sr. Data Engineer
Chicago or California or Colorado or Florida or Georgia or Illinois or Indiana or Minnesota or Missouri or Montana or New Jersey or New York or North Carolina or Ohio or Oregon or Pennsylvania or South Carolina or Texas or Utah or Vermont or Virginia or Washington or District of Columbia or Wisconsin
$100k-$150k/yr HybridFull Time
NinjaTrader
NinjaTrader: Provides futures brokerage services and a trading software platform.
5+ YOEBachelors in CS/Engineering, 5+ years data/platform engineering, strong SQL and Python, hands-on GCP (BigQuery, Cloud SQL, Cloud Storage) and AWS (S3, Glue, Athena, Kinesis), dbt, Airflow/Prefect, Terraform, CI/CD, data lake/file formats, streaming and observability experience.
SQL, Python, GCP, BigQuery, Cloud SQL, Cloud Storage, AWS, S3, Glue, Athena, Kinesis, EMR, Terraform, GitOps, dbt, Airflow, Prefect, Parquet, Avro, Apache Iceberg, Kubernetes, Kafka, Spark Streaming, Flink, Debezium, Kafka Connect, Looker Studio, QuickSight, Datadog, Grafana, Prometheus, CI/CD
1mo
Save
Mark Applied
Hide
Data Engineer
Malvern, Pennsylvania, United States
$120k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
10+ YOE10+ years experience; bachelor of computer science; strong Python, AWS, Glue ETL, PySpark, Attunity; experience with data lakes, ETL pipelines, IAM, Lambda, CloudFormation; CI/CD and stakeholder collaboration.
Python, Glue ETL, Attunity, PySpark, Amazon S3, IAM, AWS Lambda, AWS CloudFormation, CI/CD
3w
Save
Mark Applied
Hide
Data Engineer (Azure & Snowflake) - Remote
Pennsylvania or United States
$90k-$140k/yr RemoteFull Time
Mindex
Mindex: Develops software products and provides cloud engineering services.
3+ YOE3+ years data engineering experience with Snowflake, Azure Data Factory, Azure Data Lake Storage, strong SQL and Python skills, ETL/ELT knowledge, API/SaaS integrations, and dimensional modeling.
Snowflake, Azure Data Factory, Azure Data Lake Storage, SQL, Python, dbt, Salesforce, Workday, GA4, Marketo
1mo
Save
Mark Applied
Hide
Data Engineer - Remote
Virginia Beach or Alabama or Delaware or Florida or Georgia or Idaho or Indiana or Kansas or Louisiana or Maine or Maryland or Minnesota or Nebraska or Nevada or New Hampshire or North Carolina or North Dakota or Ohio or Oklahoma or Pennsylvania or South Carolina or South Dakota or Tennessee or Texas or Utah or Virginia or Washington or West Virginia or Wisconsin or Wyoming
$80k-$134k/yr RemoteFull Time
Sentara Health
Sentara Health: Operates hospitals and provides health insurance and medical services
3+ YOE3+ years relevant experience building scalable data pipelines with PySpark/Databricks, strong SQL, ETL/ELT, Delta Lake, Azure preferred, Fivetran, Git, and metadata-driven ingestion and data quality/governance practices.
PySpark, Databricks, Fivetran, Delta Lake, Azure, Git, SQL, DataHub, ACP
1mo
Save
Mark Applied
Hide
Data Engineer - Databricks - Local to Pittsburgh, PA
Pittsburgh, Pennsylvania, United States
$80k-$139k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years Azure Databricks experience with Unity Catalog, Apache Spark/PySpark, SQL, Delta Lake, Azure data services, data governance, CI/CD, and Investment/Capital Markets domain experience.
Azure Databricks, Unity Catalog, Apache Spark, PySpark, SQL, Delta Lake, Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), Microsoft Azure, Git, Terraform, Bicep, Azure Purview, Microsoft Purview
1mo
Save
Mark Applied
Hide
6424 - Lead Validation Engineer (Data Lake) / CSV Engineer
Conshohocken or Wayne
$88k-$136k/yr OnsiteFull Time
Verista
Verista: Provides compliance, automation, and validation services to life sciences.
8+ YOEBachelor's in CS/Engineering/Info Systems/Life Sciences, 8+ years CSV/CSA/IT compliance experience in regulated industries, cloud platform validation experience, knowledge of GAMP5/21 CFR Part 11/Annex 11, documentation and stakeholder management.
Microsoft Azure, Azure Data Lake Storage, Azure Data Factory, Databricks, Microsoft Fabric, Power BI
4w
Save
Mark Applied
Hide
Senior Azure Integration Engineer (Remote Opportunity)
Atlanta or Philadelphia
RemoteFull Time
VetsEZ
VetsEZ: Digital transformation and healthcare IT services for government agencies.
10+ YOE10+ years software/data engineering experience with 5+ years Azure (Data Factory, Databricks, Data Lake Gen2); expertise in Python, PySpark, SQL, APIs, DevOps; strong technical leadership and federal/regulatory experience preferred.
Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, REST, Python, PySpark, SQL, JSON, Git, Azure DevOps, Azure Monitor, Azure API Management, Azure Functions, Event Grid, Event Hubs, Service Bus
1mo
Save
Mark Applied
Hide
Elasticsearch Lead Engineer - SIEM Platform
Malvern or Charlotte or Dallas or Fort Worth
HybridFull Time
Vanguard
Vanguard: Provides mutual funds, ETFs, and investment management services.
6+ YOE6+ years Elasticsearch experience, undergraduate degree or equivalent, expertise with ECS, AWS, data streaming and data lake integrations, infrastructure-as-code, security principles, and mentoring experience.
Elasticsearch, Elastic Common Schema (ECS), Kibana, AWS S3, Kinesis Data Streams, Lambda, CloudWatch, EC2, IAM, Secrets Manager, AWS CloudFormation, Apache Kafka, Confluent Platform, Apache Iceberg, Terraform, Ansible, CDK, Elastic Security / SIEM, ECK, Kubernetes
1mo
Save
Mark Applied
Hide
Software Engineer Principal - Data and Automation (Sagemaker, AWS CDK, Infrastructure as Code (IaC), Python, Pyspark)
Pittsburgh or Farmers Branch
OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEExperience with AWS services (SageMaker, Bedrock, EMR, Lake Formation, DataZone), Infrastructure as Code (AWS CDK or Terraform), Python and PySpark; bachelor's degree and 5+ years industry experience preferred.
SageMaker, Bedrock, EMR, Lake Formation, DataZone, AWS CDK, Terraform, Python, PySpark, Amazon SageMaker, Amazon Web Services (AWS), Apache Spark
3mo
Save
Mark Applied
Hide
Principal Applications Engineer - Remote, Washington DC / Philadelphia / Wilmington / Chicago (166503)
Washington or Philadelphia or Wilmington or Chicago
$113k-$147k/yr OnsiteFull Time
Amtrak
Amtrak: Operates America's national intercity passenger railroad system.
7+ YOE7+ years experience; Bachelor’s degree or equivalent; lead complex projects; develop and maintain AWS, .NET, X++, payment APIs, and Microsoft Dynamics 365 F&O; DevSecOps and data lake/reporting experience.
AWS, .NET, X++, Microsoft Dynamics 365 F&O, Microsoft Power BI, Databricks, PCI DSS, DevSecOps
2w
Save
Mark Applied
Hide
Sr. Analyst, Platform Standards & API
Radnor or Charlotte or Fort Wayne or Greensboro
$97k-$176k/yr HybridFull Time
Lincoln Financial
Lincoln FinancialNew York Stock Exchange: LNC: Provides life insurance, annuities, and retirement planning services.
5+ YOEBachelor's or equivalent,5+ years in API/platform architecture,experience with data-contracts,versioning/deprecation,REST/GraphQL,Python,cloud data services (Glue, Lake Formation, Athena) and AI stacks (Bedrock, AgentCore, MCP).
Python, Glue, Lake Formation, Athena, Bedrock, AgentCore, MCP, REST, GraphQL
2mo
Save
Mark Applied
Hide
BCG Platinion | Lead AI Tech Architect, Public Sector Industry Leader (Defense & Security, Civil Sector)
Atlanta or Austin or Boston or Brooklyn or Chicago or Dallas or Denver or Detroit or Durham or Houston or Miami or Minneapolis or Nashville or New York or Philadelphia or Pittsburgh or Summit or Washington
$190k/yr OnsiteFull Time
Boston Consulting Group
Boston Consulting Group: Global management consulting firm specializing in business strategy and transformation.
6+ YOEBachelor's in IT or related,6+ years software engineering with 4+ years in architecture,US citizenship or ability to obtain clearance (DoD Secret/Top Secret),gen AI tool fluency,experience with cloud, APIs, data lakes, and large-scale architectures.
ChatGPT, Claude