62 pyspark developer jobs at 37 companies in Newark, DE

2mo
Save
Mark Applied
Hide
Software Engineer III-ETL/PySpark
Wilmington, Delaware, United States
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
3+ YOE3+ years in data engineering with Python, SQL; experience with PySpark, AWS, Snowflake; SDLC, CI/CD, and data tooling expertise.
Python, SQL, PySpark, AWS, Snowflake, Ab Initio, Teradata, Airflow, DBT
1w
Save
Mark Applied
Hide
Hadoop PySpark Data Engineer
Charlotte or Jersey City or Newark or Plano
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Hadoop ecosystem (Cloudera), PySpark, Spark, Hive, Python, Unix shell scripting, Autosys/Airflow, SQL; Bachelor\u0002s or equivalent experience; ability to work across SDLC and travel/relocate as needed.
Hadoop, Cloudera, PySpark, Spark, Hive, Python, Unix shell scripting, Autosys, Airflow, SQL, Tableau
3d
Save
Mark Applied
Hide
Sr. Analyst, Applied AI Engineer
Radnor or Charlotte or Fort Wayne or Greensboro
$97k-$176k/yr HybridFull Time
Lincoln Financial
Lincoln FinancialNew York Stock Exchange: LNC: Provides life insurance, annuities, and retirement planning services.
5+ YOE5+ years ML/AI engineering experience, strong Python, experience productionizing AI on cloud (AWS), familiarity with Databricks, MLflow, SQL and PySpark, SageMaker Studio/AgentCore a plus, bachelor's degree or equivalent experience.
Python, AWS, Databricks, MLflow, SQL, PySpark, SageMaker Studio, AgentCore
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp, Maryland, United States
$78k-$176k/yr RemoteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
5+ YOE5+ years application development experience, 3+ years building ETL/ELT workflows, experience with PySpark/Spark SQL and Palantir Foundry, ability to build/operate scalable data platforms, Secret clearance, Bachelor's degree.
PySpark, Spark SQL, Foundry Ontology, Foundry Workshop, Palantir Foundry Data Pipeline Builder, Palantir Foundry, Python, SQL, Scala, Java, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Spark, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
1mo
Save
Mark Applied
Hide
Data Engineer
Belcamp or Aberdeen Proving Ground
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
5+ YOE5+ years application development and enterprise-scale data application experience; PySpark, Spark SQL, Palantir Foundry experience; ability to build ETL/ELT workflows, debug Foundry pipelines; Bachelor's degree and Secret clearance required.
PySpark, Spark SQL, Palantir Foundry, Foundry Workshop, Foundry Data Pipeline Builder, Python, SQL, Scala, Java, UNIX, Linux, Shell, Databricks, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake, Microsoft Azure, Google Cloud
3w
Save
Mark Applied
Hide
Senior Data Engineer
Camden, New Jersey, United States
$105k-$140k/yr OnsiteFull Time
NFI Industries
NFI Industries: A logistics and supply chain providing transportation, warehousing, and fulfillment services.
5+ YOE5+ years data engineering experience, advanced T-SQL, PySpark/Python proficiency, Azure Synapse/ADLS/DevOps experience, ETL/ELT pipeline development, and ability to refactor legacy SQL into modern notebook-based pipelines.
T-SQL, PySpark, Python, Azure Synapse Analytics, Azure Pipeline, Azure Data Lake Storage (ADLS Gen2), Microsoft Fabric, OneLake, Lakehouse, Warehouse, Git, CI/CD, GitHub Copilot, Google Gemini
2mo
Save
Mark Applied
Hide
AWS Data Migration Engineer
Philadelphia, Pennsylvania, United States
OnsiteFull Time
Algonomy
Algonomy: AI-powered algorithmic customer engagement platform for retailers.
8+ YOE8+ years software development; experience with Big Data technologies; Scala, PySpark, Python; data pipeline migration, automation, and monitoring; AWS services and Databricks.
Databricks, AWS Glue, EMR, Step Functions, AWS Lambda, PySpark, Hadoop, Scala, Python
1w
Save
Mark Applied
Hide
Data Engineer
Lititz, Pennsylvania, United States
OnsiteFull Time
TAIT
TAIT: Designs and manufactures staging, automation, and show control systems.
7+ YOE7+ years data engineering experience delivering Databricks on AWS solutions; strong SQL and Python/PySpark; experience with data pipelines, lakehouse patterns, governance, CI/CD, and production support.
Databricks, AWS, S3, IAM, KMS, VPC, Secrets Manager, CloudWatch, Delta Lake, Spark, SQL, Python, PySpark, Git, CI/CD, Power BI, Unity Catalog, MuleSoft, Salesforce, Epicor, Kantata
2w
Save
Mark Applied
Hide
Data Engineer
Malvern, Pennsylvania, United States
$120k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
10+ YOE10+ years experience; bachelor of computer science; strong Python, AWS, Glue ETL, PySpark, Attunity; experience with data lakes, ETL pipelines, IAM, Lambda, CloudFormation; CI/CD and stakeholder collaboration.
Python, Glue ETL, Attunity, PySpark, Amazon S3, IAM, AWS Lambda, AWS CloudFormation, CI/CD
5d
Save
Mark Applied
Hide
Data Engineer
Mount Laurel, New Jersey, United States
$60k-$135k/yr HybridFull Time
Wipro
WiproNYSE: WIT: Global technology services and consulting for digital transformation.
5+ YOE5+ years data engineering experience with Azure Databricks, Azure Data Factory, PySpark, SQL, and Azure Data Lake; strong ETL/ELT, performance tuning, CI/CD, and Azure security knowledge.
Azure Databricks, Databricks notebooks, Azure Data Factory, PySpark, Python, Spark SQL, SQL, Azure Data Lake Storage Gen2, Delta Lake, Git, Azure DevOps, Azure Synapse Analytics, Azure SQL Database, SQL Server, Snowflake, Kafka, Event Hubs, Databricks Structured Streaming, Power BI, Key Vault
2w
Save
Mark Applied
Hide
Senior Data Engineer
Newark, Delaware, United States
$140k-$150k/yr RemoteFull Time
Horizon Services
Horizon Services: Provides residential HVAC, plumbing, and electrical repair services.
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
2mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
Crystal City or Aberdeen
$101k-$175k/yr HybridFull Time
LMI
LMI: Provides management consulting and digital solutions to federal government agencies.
5+ YOE5–8 years in Data Engineering; Python, SQL, PySpark; Army Vantage/Palantir Foundry; DoD Secret Clearance; minimal travel.
Python, SQL, PySpark, Palantir Foundry, Advana
3w
Save
Mark Applied
Hide
Senior Data Engineer
Cherry Hill, New Jersey, United States
$125k-$150k/yr OnsiteFull Time
Asset Based Lending
Asset Based Lending: A private lending firm providing bridge financing and lending solutions for real estate investors.
Extensive data engineering experience building cloud data platforms, strong Python/PySpark and SQL skills, dbt and ELT tool experience, data governance and observability knowledge, and bachelor's in a quantitative field.
Python, PySpark, SQL, dbt, Power BI, Snowflake, Databricks, Microsoft Fabric, Fivetran, Airbyte, Collibra, Microsoft Purview, AWS, Azure, Google Cloud Platform
3w
Save
Mark Applied
Hide
Principal Data Engineer
Philadelphia, Pennsylvania, United States
HybridFull Time
Medical Guardian
Medical Guardian: Provides medical alert systems and emergency monitoring for seniors.
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Databricks, PySpark, Spark SQL, Spark, Python, SQL, Delta Lake, Databricks Workflows, CI/CD, Azure, Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid
1mo
Save
Mark Applied
Hide
Application Engineer III - AWS Data Engineer
Malvern, Pennsylvania, United States
HybridFull Time
Vanguard
Vanguard: Provides mutual funds, ETFs, and investment management services.
Experienced AWS data engineer with Python (PySpark, pandas, polars, DuckDB), AWS serverless (Glue, Lambda, Step Functions, CloudFormation, SNS, SQS), SQL, ETL and data lake/warehouse design, Agile experience, and strong communication and operational skills.
Python, PySpark, pandas, polars, DuckDB, AWS Glue, AWS Lambda, AWS Step Functions, AWS CloudFormation, Amazon SNS, Amazon SQS, SQL, JIRA, Confluence
2mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
Crystal City or Aberdeen
$101k-$175k/yr HybridFull Time
LMI
LMI: Delivers management, technology, and analytics solutions for federal agencies.
5+ YOE5–8 years in data engineering; Python, SQL, PySpark; Army Vantage/Palantir Foundry; DoD Secret Clearance; experience with Army data sources.
Python, SQL, PySpark, Palantir Foundry
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Customer Data Products)
Philadelphia, Pennsylvania, United States
$127k-$160k/yr HybridFull Time
NBME
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
AWS, Python, SQL, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, PySpark, AirFlow, KubeFlow, AWS step functions, Luigi, Pinecone, Milvus, pgvector, Git, CI/CD, Feature Stores, Vector Databases, APIs, MLOps
2mo
Save
Mark Applied
Hide
Data Warehouse Engineer
Malvern, Pennsylvania, United States
OnsiteFull Time
ifm electronic
ifm electronic: Manufactures sensors and control systems for industrial automation.
5+ YOE5+ years data engineering; bachelor's in Computer Science/Data Science/Engineering; Azure data platform; SQL/Python/PySpark; ETL/ELT; DevOps; AI/advanced analytics exposure.
Azure Synapse Analytics, Azure Data Factory, Microsoft Fabric, Azure Data Lake Storage Gen2, Azure SQL Server, SQL, Python, PySpark
3w
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
United States or Belcamp or Crystal City
$101k-$175k/yr RemoteFull Time
LMI
LMI: Provides management consulting and digital solutions to government agencies.
5+ YOEActive DoD Secret clearance,5+ years data engineering experience,expert Python,SQL,PySpark,experience with Palantir Foundry/Advana,ability to scale ETL pipelines and manage ontologies.
Python, SQL, PySpark, Palantir Foundry, Advana