12 pyspark data engineer jobs at 10 companies in Fishkill, NY
2mo
Save
Mark Applied
Hide
2mo
Senior Data Engineer
Rye, New York, United States
$127k-$137k/yrOnsiteFull Time
New York Blood Center: Non-profit organization collecting and distributing blood and stem cells.
6+ YOE6+ years data engineering experience; bachelor’s in CS/Data Science/IT or related; expert SQL and Python (PySpark); deep Azure data platform experience (ADF, Databricks, Synapse, ADLS); data modeling, pipeline ownership, governance, and HIPAA compliance.
SQL, Python, PySpark, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Purview, Microsoft SQL Server, Oracle, CI/CD
LovesacNASDAQ: LOVE: Designs and sells modular furniture including sectionals and beanbags.
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
Subway: Global restaurant chain specializing in made-to-order submarine sandwiches.
5+ YOE5+ years building data pipelines and integrations with 3+ years cloud experience; hands-on Databricks or Snowflake, PySpark/SQL, Python, Airflow, Git; bachelor’s degree preferred.
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yrRemoteFull Time
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
Hudson Valley Credit Union: Provides consumer and commercial banking and lending services.
5+ YOEBachelor’s degree in CS or related; Master’s preferred. 5+ years of Data Engineer experience; Databricks Certifications preferred; Azure Data Engineer certification preferred; strong Python, Databricks, and data warehousing experience.
Databricks, Spark, PySpark, Scala, Delta Lake, Azure Data Lake Storage Gen2, CI/CD, ITSM, SDLC, MLOps
New York Blood Center: Community-based nonprofit provider of blood products and research.
6+ YOEBachelor's in CS/Data Science/IT, 6+ years data engineering experience, expert SQL and Python (PySpark), deep Azure data services experience, dimensional modeling, data quality, and relational DB migration experience.
SQL, Python, PySpark, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Purview, SQL Server, Oracle
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yrRemoteFull Time
Arch Capital GroupNASDAQ: ACGL: Global provider of specialty insurance, reinsurance and mortgage insurance.
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Senior Python Engineer - Applications Development Sr Programmer Analyst - C12 - RUTHERFORD
Rutherford, New Jersey, United States
$121k-$182k/yrHybridFull Time
CitiNYSE: C: Providing global banking, investment, and wealth management services.
8+ YOE8+ years large-scale application development; 5+ years Python and PySpark for enterprise ELT/ETL; experience with Databricks, Kafka, microservices, containerization, CI/CD, SQL, data modeling, and agentic AI integrations.
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEBachelor's in CS/engineering, 5+ years in application or data technology roles, strong RDBMS and PL/SQL skills, Python and SQL proficiency, AML/KYC domain knowledge, and experience with large-scale data platforms.
Senior Python Engineer - Applications Development Sr Programmer Analyst - C12 - RUTHERFORD
Rutherford, New Jersey, United States
$121k-$182k/yrHybridFull Time
CitiNYSE: C: Global diversified financial services holding.
8+ YOE8+ years application development experience, 5+ years leading Python/PySpark engineering for ELT/ETL; expertise with Databricks, SQL, data modeling, Data Mesh, microservices, containerization, and agentic AI integrations.
BalchemNASDAQ: BCPC: Develops and manufactures specialty performance ingredients and nutritional solutions.
3+ YOEBachelor's degree and 3+ years experience, advanced Power BI, Microsoft Fabric, strong SQL, DAX, Power Query, analytics platform and data integration experience, strong communication and problem-solving skills.
Microsoft Fabric, Power BI, SQL, DAX, Power Query, PySpark, Spark SQL