45 pyspark data engineer jobs at 33 companies in Brookside, DE
2w
Save
Mark Applied
Hide
Hadoop PySpark Data Engineer
Charlotte or Jersey City or Newark or Plano
$82k-$127k/yr OnsiteFull Time
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Hadoop, Cloudera, PySpark, Spark, Hive, Python, Unix shell scripting, Autosys, Airflow, SQL, Tableau
1w
Save
Mark Applied
Hide
Sr. Associate, Date Engineer - PySpark
Atlanta or New York City or Philadelphia or Dallas
OnsiteFull Time
5+ YOE5+ Mgmt5+ years leading data science/engineering teams, Master’s degree in CS/DS/Statistics/Engineering, hands-on Python, PySpark, SQL, Databricks, Snowflake, experience with cloud platforms, ability to travel, U.S. work authorization required.
Python, PySpark, SQL, Databricks, Snowflake, Linux, AWS, GCP, Azure, R
2w
Save
Mark Applied
Hide
Data Engineer
Lititz, Pennsylvania, United States
OnsiteFull Time
7+ YOE7+ years data engineering experience delivering Databricks on AWS solutions; strong SQL and Python/PySpark; experience with data pipelines, lakehouse patterns, governance, CI/CD, and production support.
Databricks, AWS, S3, IAM, KMS, VPC, Secrets Manager, CloudWatch, Delta Lake, Spark, SQL, Python, PySpark, Git, CI/CD, Power BI, Unity Catalog, MuleSoft, Salesforce, Epicor, Kantata
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Cherry Hill, New Jersey, United States
$125k-$150k/yr OnsiteFull Time
Extensive data engineering experience building cloud data platforms, strong Python/PySpark and SQL skills, dbt and ELT tool experience, data governance and observability knowledge, and bachelor's in a quantitative field.
Python, PySpark, SQL, dbt, Power BI, Snowflake, Databricks, Microsoft Fabric, Fivetran, Airbyte, Collibra, Microsoft Purview, AWS, Azure, Google Cloud Platform
3mo
Save
Mark Applied
Hide
Data Warehouse Engineer
Malvern, Pennsylvania, United States
OnsiteFull Time
5+ YOE5+ years data engineering; bachelor's in Computer Science/Data Science/Engineering; Azure data platform; SQL/Python/PySpark; ETL/ELT; DevOps; AI/advanced analytics exposure.
Azure Synapse Analytics, Azure Data Factory, Microsoft Fabric, Azure Data Lake Storage Gen2, Azure SQL Server, SQL, Python, PySpark
3w
Save
Mark Applied
Hide
Senior Data Engineer
Newark, Delaware, United States
$140k-$150k/yr RemoteFull Time
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp or Aberdeen Proving Ground
$78k-$176k/yr OnsiteFull Time
5+ YOE5+ years building enterprise data applications; 3+ years creating ETL/ELT workflows; experience with PySpark, Spark SQL, Palantir Foundry (Ontology, Workshop, Data Pipeline Builder); scripting, log debugging; Secret clearance; Bachelor’s degree.
PySpark, Spark SQL, Palantir Foundry, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
4w
Save
Mark Applied
Hide
Data Engineer
Malvern, Pennsylvania, United States
$120k-$130k/yr OnsiteFull Time
10+ YOE10+ years experience; bachelor of computer science; strong Python, AWS, Glue ETL, PySpark, Attunity; experience with data lakes, ETL pipelines, IAM, Lambda, CloudFormation; CI/CD and stakeholder collaboration.
Python, Glue ETL, Attunity, PySpark, Amazon S3, IAM, AWS Lambda, AWS CloudFormation, CI/CD
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp, Maryland, United States
$78k-$176k/yr RemoteFull Time
5+ YOE5+ years application development experience, 3+ years building ETL/ELT workflows, experience with PySpark/Spark SQL and Palantir Foundry, ability to build/operate scalable data platforms, Secret clearance, Bachelor's degree.
PySpark, Spark SQL, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Palantir Foundry, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
1mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
Crystal City or Aberdeen
$101k-$175k/yr RemoteFull Time
5+ YOE5–8 years data engineering experience with expert Python, SQL, PySpark; experience with Palantir Foundry (Vantage) and Advana; active DoD Secret clearance; familiarity with Army data sources preferred.
Python, SQL, PySpark, Palantir Foundry, Advana, IPPS-A, GCSS-Army, GFEBS
3mo
Save
Mark Applied
Hide
Software Engineer III-ETL/PySpark
Wilmington, Delaware, United States
OnsiteFull Time
3+ YOE3+ years in data engineering with Python, SQL; experience with PySpark, AWS, Snowflake; SDLC, CI/CD, and data tooling expertise.
Python, SQL, PySpark, AWS, Snowflake, Ab Initio, Teradata, Airflow, DBT
1mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
United States or Belcamp or Crystal City
$101k-$175k/yr RemoteFull Time
5+ YOEActive DoD Secret clearance,5+ years data engineering experience,expert Python,SQL,PySpark,experience with Palantir Foundry/Advana,ability to scale ETL pipelines and manage ontologies.
Python, SQL, PySpark, Palantir Foundry, Advana
4w
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
2mo
Save
Mark Applied
Hide
Data Engineer - Operational Support (Co-op)
Camden, New Jersey, United States
OnsiteFull Time, Internship
Pursuing a degree in CS/Data Engineering/Data Science, basic SQL, programming in Python or PySpark, familiarity with Databricks, Snowflake, Microsoft Azure, ADF/ADLS and Microsoft Power BI, and strong problem-solving and communication skills.
Databricks, Snowflake, Microsoft Azure, ADLS, ADF, Microsoft Power BI, SAP, Python, PySpark, SQL
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Coopersburg or Philadelphia
OnsiteFull Time
8+ YOERequired bachelor’s or master’s in CS/Data Science/Computer Engineering/Software Engineering, 8+ years related experience, expertise in data modeling, real-time/batch processing, cloud architectures, and SQL.
AWS, S3, Glue, EKS, Lambda, SageMaker, Redshift, Athena, Bedrock, Agentcore, SQL, NoSQL, Microsoft Power BI, Tableau, QuickSight, Python, Pandas, NumPy, PySpark
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
1d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
2mo
Save
Mark Applied
Hide
AWS Data Migration Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
8+ YOE8+ years software development; experience with Big Data technologies; Scala, PySpark, Python; data pipeline migration, automation, and monitoring; AWS services and Databricks.
Databricks, AWS Glue, EMR, Step Functions, AWS Lambda, PySpark, Hadoop, Scala, Python
2mo
Save
Mark Applied
Hide
Data Engineer
West Chester, Pennsylvania, United States
HybridFull Time
4+ YOE4+ years software development and data warehousing, ETL, and database design; SQL; Azure tools; large-scale data handling; CI/CD; Agile experience.
Azure Databricks, Azure Data Factory, Delta Lake, Azure Synapse, ADLS, PySpark, SQL Server, Databricks Notebooks
Explore Jobs