12 big data engineer jobs at 11 companies in Pennsylvania

4d
Save
Mark Applied
Hide
Data Delivery Senior Engineer
Lancaster or Pennsylvania
$102k-$170k/yr RemoteFull Time
Fulton Bank
Fulton BankNASDAQ: FULT: Regional bank providing personal, commercial, and mortgage banking services.
5+ YOEBachelor's in CS or equivalent,5+ years as DBA/DB developer/Data Engineer,3+ years Azure experience,expertise with SQL,Oracle and Big Data,ability to design ETL/data pipelines and ensure data integrity and compliance.
SQL, Oracle, Azure, Big Data
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
NBME
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
1mo
Save
Mark Applied
Hide
Lead Software Engineer - Big Data
Rockville or Washington or Tysons or Colorado or Florida or Texas or Illinois or Pennsylvania or Massachusetts or Maryland or Virginia or New York or New Jersey
$114k-$249k/yr HybridFull Time
FINRA
FINRA: Regulates brokerage firms and exchange markets in the United States.
7+ YOEBachelor's in CS or related + 7+ years experience; deep Big Data (Hadoop, Spark, Hive, Trino), SQL, AWS (S3, EMR, Glue, Lambda, Athena, EKS), Python/Scala, system design, CI/CD, DevOps, security, and team mentoring experience.
Hadoop, Spark, Hive, Trino, SQL, S3, EMR, Glue, Lambda, Athena, EKS, Python, Scala, GitHub Copilot, Q Developer, ChatGPT, Claude, Scrum, Kanban, CI/CD, DevOps
2mo
Save
Mark Applied
Hide
AWS Data Migration Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Algonomy
Algonomy: AI-powered algorithmic customer engagement platform for retailers.
8+ YOE8+ years software development; experience with Big Data technologies; Scala, PySpark, Python; data pipeline migration, automation, and monitoring; AWS services and Databricks.
Databricks, AWS Glue, EMR, Step Functions, AWS Lambda, PySpark, Hadoop, Scala, Python
1mo
Save
Mark Applied
Hide
Sr. Software Engineer - Big Data, Data Lake
Oregon or Washington or California or Florida or Idaho or Iowa or Kentucky or Maryland or Massachusetts or Michigan or Minnesota or Nevada or New Jersey or Ohio or Pennsylvania or Tennessee or Texas or Arizona or Illinois or Colorado or New Hampshire
$120k-$150k/yr RemoteFull Time
Foureyes
Foureyes: Data platform providing sales intelligence for automotive dealerships.
7+ YOE7+ years software development experience with 5+ years in AWS; hands-on with AWS data services (S3, Glue, Athena, Lake Formation, Step Functions, Lambda, Kinesis), Python, SQL, TypeScript/Node.js, data pipeline design, and on-call experience.
S3, Glue, Data Catalog, DataBrew, Athena, Lake Formation, Step Functions, Lambda, Kinesis Data Stream, API Gateway, Python, SQL, TypeScript, Node.js, Snowflake, Metabase, Redshift, BigQuery, SNS, SQS, EventBridge, Pub/Sub, webhooks, AWS CDK, CI/CD, Spec Kit, Claude Code, Cursor, GitHub Copilot
2w
Save
Mark Applied
Hide
Data Architect
Alabama or Arizona or California or Colorado or Connecticut or Florida or Georgia or Illinois or Iowa or Kentucky or Maryland or Massachusetts or Michigan or Minnesota or Missouri or New Jersey or New York or North Carolina or Ohio or Pennsylvania or South Carolina or Tennessee or Texas or Utah
$100k-$200k/yr RemoteFull Time
RegEd
RegEd: Enterprise software for regulatory compliance and risk management.
10+ YOEBachelor's in CS/Data Science,10+ years data engineering/development experience,expertise in data modeling,warehousing,and integrations,experience with Databricks,Azure/AWS,Big Data and governance tools.
Databricks, Azure Data Lake Storage Gen2, Unity Catalog, Azure Data Factory, Microsoft Purview, Hadoop, Spark, AWS, Azure, Phyton, R, SQL
3mo
Save
Mark Applied
Hide
Data Scientist Senior - Data, Model & Analytics
Pittsburgh or Tysons Corner or Washington
$78k-$187k/yr OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEMaster's degree in data science, computer science, engineering, or related field; 5+ years of data science/ML experience in industry with 2+ years NLP; strong math/stats; expert Python, PyTorch, Spark, SQL; ML deployment and big data/cloud experience.
Python, PyTorch, Spark, SQL, MLOps
3w
Save
Mark Applied
Hide
Senior Software Engineer (Data Engineering and Infrastructure)
Pittsburgh, Pennsylvania, United States
$146k-$234k/yr HybridFull Time
Aurora
AuroraNASDAQ: AUR: Developing autonomous driving technology for trucking and passenger mobility.
5+ YOE5+ years software engineering experience focused on data projects, proficiency in Python/Go/C++, big-data frameworks, cloud data services, SQL, Airflow and DBT; strong communication and cross-functional collaboration skills.
Python, Go, C++, Presto, Trino, EMR, Apache Spark, Flink, Kinesis Data Stream, AWS, GCP, Azure, S3, Redshift, BigQuery, Glue, SQL, DBT, Apache Airflow, Snowflake
1mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer
Denver or Arizona or Arkansas or California or Florida or Georgia or Illinois or Indiana or Iowa or Kansas or Maryland or Massachusetts or Michigan or Minnesota or Missouri or Montana or Nevada or New Jersey or New York or North Carolina or Ohio or Oklahoma or Pennsylvania or Tennessee or Texas or Utah or Virginia or Washington or Wisconsin
$228k-$253k/yr HybridFull Time
Ibotta
IbottaNYSE: IBTA: Provides a cash-back rewards and performance marketing platform.
10+ YOE10+ years building and deploying large-scale ML systems; expertise with cloud (AWS), big-data tools, ML frameworks, and leading ML strategy and mentoring engineers.
Python, Apache Spark, Databricks, AWS, Amazon SageMaker, scikit-learn, TensorFlow, Spark ML, Apache Kafka
2w
Save
Mark Applied
Hide
Production Engineer
Pittsburgh or United States
$60k-$99k/yr RemoteFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
5+ YOE5+ years enterprise web application development and production support experience; strong SQL/SSRS/SSIS, .NET/C#/ReactJS, cloud, big data, and healthcare payer analytics knowledge.
.NET framework 4.0/4.5, C#.NET, ASP.NET, MVC, Web Service, IIS, HTML, CSS, XML, SOAP, JQuery, Ajax, ReactJS, NHibernate, Entity framework, SQL Server 2016, SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), Tortoise HG, SVN, Azure, AWS, Python, PySpark, DTKBarcode, Esker, Biscom, WebStart, 3M, Tableau, APM Tools (Application Performance Management), Microsoft Power BI, Microsoft Excel, CRM Systems
1mo
Save
Mark Applied
Hide
Kafka/Spark Developer
Pittsburgh, Pennsylvania, United States
$71k-$157k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
5+ YOE5+ years in big data development with hands-on Kafka, Spark, Hadoop, Impala, strong Java/Scala/Python skills, SQL proficiency, and experience in Agile teams.
Apache Kafka, Apache Spark, Hadoop Ecosystem (HDFS), Impala, PySpark, Scala, Java, Kafka Connect, Schema Registry, Hive, Oracle, PostgreSQL, Python, SQL, Neo4j
2w
Save
Mark Applied
Hide
Quality Assurance Lead
Pittsburgh or Dallas or Cleveland or Birmingham
$63k-$139k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
8+ YOE8+ years QA experience, lead QA initiatives, strong Python and PySpark skills, big data and Hadoop testing experience, Oracle/SQL validation, Unix/Linux scripting, Jenkins/Git CI/CD, Docker/OpenShift experience.
Python, PySpark, Hadoop, HDFS, Hive, Impala, Sqoop, Oracle PL/SQL, SQL, Jenkins, Git, Docker, OpenShift, Unix/Linux, Control M, MLflow, AWS Glue, AWS Athena, AWS S3, AWS SageMaker