10 pyspark data engineer jobs at 7 companies in Brookhaven, NY
2mo
Save
Mark Applied
Hide
2mo
Senior Data Engineer
Rye, New York, United States
$127k-$137k/yrOnsiteFull Time
New York Blood Center: Non-profit organization collecting and distributing blood and stem cells.
6+ YOE6+ years data engineering experience; bachelor’s in CS/Data Science/IT or related; expert SQL and Python (PySpark); deep Azure data platform experience (ADF, Databricks, Synapse, ADLS); data modeling, pipeline ownership, governance, and HIPAA compliance.
SQL, Python, PySpark, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Purview, Microsoft SQL Server, Oracle, CI/CD
D'Addario: Manufacturer of musical instrument strings and accessories.
3+ YOE3+ years data engineering experience; strong Python, PySpark, and SQL; building ELT/ETL pipelines, analytics data modeling, Microsoft Fabric/Power BI familiarity; Bachelor's in CS/Data or equivalent.
Python, PySpark, SQL, Microsoft Fabric, Microsoft Power BI, Azure Synapse, Azure Data Lake, dbt
LovesacNASDAQ: LOVE: Designs and sells modular furniture including sectionals and beanbags.
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
Subway: Global restaurant chain specializing in made-to-order submarine sandwiches.
5+ YOE5+ years building data pipelines and integrations with 3+ years cloud experience; hands-on Databricks or Snowflake, PySpark/SQL, Python, Airflow, Git; bachelor’s degree preferred.
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yrRemoteFull Time
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
New York Blood Center: Community-based nonprofit provider of blood products and research.
6+ YOEBachelor's in CS/Data Science/IT, 6+ years data engineering experience, expert SQL and Python (PySpark), deep Azure data services experience, dimensional modeling, data quality, and relational DB migration experience.
SQL, Python, PySpark, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Purview, SQL Server, Oracle
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yrRemoteFull Time
Arch Capital GroupNASDAQ: ACGL: Global provider of specialty insurance, reinsurance and mortgage insurance.
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Subway: Global quick-service restaurant chain specializing in made-to-order sandwiches.
8+ YOERequires 8–12+ years in data engineering, architecture, or platform engineering; expert SQL and Python/PySpark; Databricks expertise; cloud and distributed-platform experience; and a bachelor's degree or equivalent.
Databricks, Delta Lake, Unity Catalog, MLflow, Databricks Workflows, Delta Live Tables, SQL, Python, PySpark, Scala, Apache Spark, AWS, Azure, GCP, Airflow, Azure Data Factory, Great Expectations, Monte Carlo, Databricks Lakehouse Monitoring, Terraform, Pulumi, Microsoft Purview, Collibra, Alation, Snowflake, Amazon Redshift, Microsoft Excel
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEBachelor's in CS/engineering, 5+ years in application or data technology roles, strong RDBMS and PL/SQL skills, Python and SQL proficiency, AML/KYC domain knowledge, and experience with large-scale data platforms.