37 pyspark data engineer jobs at 28 companies in Lorane, PA
2w
Save
Mark Applied
Hide
Hadoop PySpark Data Engineer
Charlotte or Jersey City or Newark or Plano
$82k-$127k/yr OnsiteFull Time
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Hadoop, Cloudera, PySpark, Spark, Hive, Python, Unix shell scripting, Autosys, Airflow, SQL, Tableau
1w
Save
Mark Applied
Hide
Sr. Associate, Date Engineer - PySpark
Atlanta or New York City or Philadelphia or Dallas
OnsiteFull Time
5+ YOE5+ Mgmt5+ years leading data science/engineering teams, Master’s degree in CS/DS/Statistics/Engineering, hands-on Python, PySpark, SQL, Databricks, Snowflake, experience with cloud platforms, ability to travel, U.S. work authorization required.
Python, PySpark, SQL, Databricks, Snowflake, Linux, AWS, GCP, Azure, R
2w
Save
Mark Applied
Hide
Data Engineer
Lititz, Pennsylvania, United States
OnsiteFull Time
7+ YOE7+ years data engineering experience delivering Databricks on AWS solutions; strong SQL and Python/PySpark; experience with data pipelines, lakehouse patterns, governance, CI/CD, and production support.
Databricks, AWS, S3, IAM, KMS, VPC, Secrets Manager, CloudWatch, Delta Lake, Spark, SQL, Python, PySpark, Git, CI/CD, Power BI, Unity Catalog, MuleSoft, Salesforce, Epicor, Kantata
3mo
Save
Mark Applied
Hide
Data Warehouse Engineer
Malvern, Pennsylvania, United States
OnsiteFull Time
5+ YOE5+ years data engineering; bachelor's in Computer Science/Data Science/Engineering; Azure data platform; SQL/Python/PySpark; ETL/ELT; DevOps; AI/advanced analytics exposure.
Azure Synapse Analytics, Azure Data Factory, Microsoft Fabric, Azure Data Lake Storage Gen2, Azure SQL Server, SQL, Python, PySpark
4w
Save
Mark Applied
Hide
Senior Data Engineer
Newark, Delaware, United States
$140k-$150k/yr RemoteFull Time
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
4w
Save
Mark Applied
Hide
Data Engineer
Malvern, Pennsylvania, United States
$120k-$130k/yr OnsiteFull Time
10+ YOE10+ years experience; bachelor of computer science; strong Python, AWS, Glue ETL, PySpark, Attunity; experience with data lakes, ETL pipelines, IAM, Lambda, CloudFormation; CI/CD and stakeholder collaboration.
Python, Glue ETL, Attunity, PySpark, Amazon S3, IAM, AWS Lambda, AWS CloudFormation, CI/CD
3mo
Save
Mark Applied
Hide
Software Engineer III-ETL/PySpark
Wilmington, Delaware, United States
OnsiteFull Time
3+ YOE3+ years in data engineering with Python, SQL; experience with PySpark, AWS, Snowflake; SDLC, CI/CD, and data tooling expertise.
Python, SQL, PySpark, AWS, Snowflake, Ab Initio, Teradata, Airflow, DBT
4w
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
2mo
Save
Mark Applied
Hide
Data Engineer - Operational Support (Co-op)
Camden, New Jersey, United States
OnsiteFull Time, Internship
Pursuing a degree in CS/Data Engineering/Data Science, basic SQL, programming in Python or PySpark, familiarity with Databricks, Snowflake, Microsoft Azure, ADF/ADLS and Microsoft Power BI, and strong problem-solving and communication skills.
Databricks, Snowflake, Microsoft Azure, ADLS, ADF, Microsoft Power BI, SAP, Python, PySpark, SQL
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Coopersburg or Philadelphia
OnsiteFull Time
8+ YOERequired bachelor’s or master’s in CS/Data Science/Computer Engineering/Software Engineering, 8+ years related experience, expertise in data modeling, real-time/batch processing, cloud architectures, and SQL.
AWS, S3, Glue, EKS, Lambda, SageMaker, Redshift, Athena, Bedrock, Agentcore, SQL, NoSQL, Microsoft Power BI, Tableau, QuickSight, Python, Pandas, NumPy, PySpark
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
2mo
Save
Mark Applied
Hide
AWS Data Migration Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
8+ YOE8+ years software development; experience with Big Data technologies; Scala, PySpark, Python; data pipeline migration, automation, and monitoring; AWS services and Databricks.
Databricks, AWS Glue, EMR, Step Functions, AWS Lambda, PySpark, Hadoop, Scala, Python
2mo
Save
Mark Applied
Hide
Data Engineer
West Chester, Pennsylvania, United States
HybridFull Time
4+ YOE4+ years software development and data warehousing, ETL, and database design; SQL; Azure tools; large-scale data handling; CI/CD; Agile experience.
Azure Databricks, Azure Data Factory, Delta Lake, Azure Synapse, ADLS, PySpark, SQL Server, Databricks Notebooks
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Philadelphia or Aurora or King of Prussia
$82k-$172k/yr OnsiteFull Time
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Python, NumPy, Pandas, Polars, Git, Docker, Docker Compose, AWS, Spark, PySpark, Linux, CUDA
2mo
Save
Mark Applied
Hide
Senior Data Engineer
King of Prussia or Aurora
$82k-$172k/yr OnsiteFull Time
5+ YOEActive TS/SCI clearance, B.S. in Data Science/AI/CS or related, 5+ years experience, building data pipelines using Python (NumPy, Pandas, Polars), version control (git/GitLab/Bitbucket), and contributing to AI/ML solutions.
NumPy, Pandas, Polars, Python, git, GitLab, Bitbucket, Docker, Docker Compose, AWS, Spark, PySpark, Gymnasium, OpenEnv, TorchRL, RLlib, Stable Baselines, LangFuse, MLFlow, Arize Phoenix, HuggingFace, LangChain, Linux, EC2, S3, Lambda, Bedrock, Java, C++, Rust, Go, C#, CUDA, Podman, Kubernetes, Rancher
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Camden, New Jersey, United States
$105k-$140k/yr OnsiteFull Time
5+ YOE5+ years data engineering experience, advanced T-SQL, PySpark/Python proficiency, Azure Synapse/ADLS/DevOps experience, ETL/ELT pipeline development, and ability to refactor legacy SQL into modern notebook-based pipelines.
T-SQL, PySpark, Python, Azure Synapse Analytics, Azure Pipeline, Azure Data Lake Storage (ADLS Gen2), Microsoft Fabric, OneLake, Lakehouse, Warehouse, Git, CI/CD, GitHub Copilot, Google Gemini
1w
Save
Mark Applied
Hide
Data Solutions Engineer
Cleveland or Cincinnati or Columbus or Philadelphia or Washington or Orlando or Atlanta or Austin or Dallas or Houston or Los Angeles or Seattle
$120k-$165k/yr OnsiteFull Time
5+ YOEBachelor's in CS/IT,5+ years building data solutions; expertise with Azure data platform, Microsoft Fabric, Power Platform, data modeling, medallion architecture, MDM, DevOps, and strong communication skills.
Azure Data Factory, Azure Data Lake, Azure Data Lake Storage, Azure Synapse Analytics, Azure SQL Database, PostgreSQL, Azure Blob Storage, Azure Databricks, Apache Spark, Apache Airflow, Azure Logic Apps, Azure DevOps, Power Automate, REST API, Azure OpenAI, Document Intelligence, Delta Lake, Microsoft Fabric, Lakehouse, Power Apps, Power BI, Git
2mo
Save
Mark Applied
Hide
Manager, Data Engineer (Remote)
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yr RemoteFull Time
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Python, SQL, PySpark, Apache Spark, Databricks, Snowflake, Azure, Data warehousing, ETL, CI/CD
Explore Jobs