46 spark data engineer jobs at 26 companies in Townsend, DE
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Sand Technologies: Develops industrial AI and digital twin solutions for enterprise operations.
3+ YOE3+ years building and operating large-scale cloud or hybrid data platforms; strong Python and SQL skills; experience with Spark/Kafka, cloud (AWS/Azure/GCP), data governance, observability, and ML enablement.
Medical Guardian: Provides medical alert systems and emergency monitoring for seniors.
10+ YOE3+ Mgmt10+ years in data or software engineering, 7+ years building production data pipelines, strong Databricks/Spark/PySpark/SQL experience, Azure and streaming expertise, plus leadership and production operations experience.
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
5+ YOE5+ years building and operationalizing enterprise data applications, 3+ years creating scalable ETL/ELT workflows, experience with PySpark/Spark SQL and Palantir Foundry, bachelor’s degree, and Secret clearance.
Susquehanna International Group: Global quantitative trading firm specializing in proprietary financial markets.
5+ YOE5+ years data engineering experience, capital markets domain knowledge, strong Python skills, experience with Spark/Databricks/Trino/Snowflake/Kafka and large-scale batch/stream processing, ability to support off-hours/weekend needs.
Perpay: Financial platform offering interest-free shopping and credit building via payroll.
2+ YOEMinimum 2 years of production data engineering experience; proficient in Python and SQL; experience with AWS, Redshift, ETL tools; able to design data pipelines and collaborate across teams.
CACINYSE: CACI: Provides information technology and professional services to government clients.
5+ YOE5+ years in data engineering/science with TS/SCI clearance; BS in data science/CS; experience building data pipelines and using Python data libraries; experience with git.
Susquehanna International Group: Global quantitative trading and market making firm.
5+ YOE5+ years in data engineering with strong Python and experience with modern data platforms (Spark, Databricks, Trino, Iceberg, Snowflake, Kafka); capital markets/financial services experience required.
Horizon Services: Provides residential HVAC, plumbing, and electrical repair services.
8+ YOEBachelor's or master's in CS/statistics/analytics, 8+ years data engineering, 5+ years cloud (preferably AWS), strong SQL, Databricks, Snowflake, Python/PySpark, Kafka experience preferred.
Databricks, Spark, Confluent Kafka, Snowflake, AWS, SQL, Python, PySpark, Microsoft Power BI
ChubbNYSE: CB: Provides property, casualty, and life insurance and reinsurance services globally.
12+ YOEBachelor's degree required; 12+ years data engineering with ETL/ELT, data warehouse design, and automated pipelines. Expertise in Informatica/IICS, Azure (Synapse, ADF, Databricks), Snowflake, Databricks, Autosys, Python/Shell. Must be based in NJ or Greater Philadelphia.
Informatica, IICS, Azure, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks, Delta Lake, Spark, Snowflake, Snowpark, Autosys, Python, Shell
AramarkNYSE: ARMK: Provides food and facility management services to diverse organizations.
7+ YOE7+ years in data domain with Python, SQL, Azure/AWS, ETL/ELT, data modeling, Spark, real-time streaming, CI/CD; BS/MS in CS or equivalent experience.
NBME: Develops and manages medical licensing and healthcare professional assessments.
7+ YOEBachelor's degree, 7+ years application development experience, 4+ years in big data and AWS, proficiency in Python/SQL/Scala/Java, distributed data tools, PySpark, NoSQL, Redshift, UNIX/Linux, process orchestration and CI/CD; experience with ML/LLM pipelines and vector DBs preferred.
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, ≥4 years application development, ≥2 years big data technologies, ≥1 year cloud (AWS/Azure/GCP); preferred: 7+ yrs app dev, cloud and distributed systems, streaming, NoSQL, data warehousing, UNIX/Linux, Agile.
Health Union: Operates online health communities and healthcare data platforms.
8+ YOE8+ years in data engineering/platform architecture; 5+ years building unified platforms on AWS and Snowflake; expertise with ingestion, transformation, modeling, dbt, Airflow, Python, Spark, and advanced SQL; CI/CD and data governance experience.
Data & AI Senior Engineer - 90405345 - Washington DC, Philadelphia PA, Wilmington DE or Chicago IL (Washington, DC, US, 20001)
Washington or Philadelphia or Wilmington or Chicago
$87k-$112k/yrOnsiteFull Time
Amtrak: Operates America's national intercity passenger railroad system.
4+ YOE4–6 years in data engineering, software development, or data architecture; Bachelor's in CS/Data Engineering or related field; onsite work across multiple cities.
Delan Associates: Provides engineering and professional services to government agencies.
5+ YOE5+ years ML model development, 3+ years production model operationalization, strong Python and SQL skills, experience with Databricks/Spark/MLflow, model evaluation and MLOps, and stakeholder communication.