49 pyspark data engineer jobs at 27 companies in Cornwall, NY
6d
Save
Mark Applied
Hide
Lead Data Engineer
New York City or United States
HybridFull Time
4+ YOERequires 4+ years in data engineering, a bachelor's or master's degree, SQL, Python, PySpark, cloud data platforms, ETL/ELT pipelines, data modeling, Airflow, cloud ecosystems, and engineering team leadership.
SQL, Python, PySpark, Snowflake, Databricks, Apache Airflow, AWS, Azure, GCP, Tableau, Microsoft Power BI, Looker, Spark, Hadoop, Hive, HBase, Kafka
4w
Save
Mark Applied
Hide
Data Engineer
Albany or Rome or New York
$97k-$126k/yr OnsiteFull Time
5+ YOEDesign and maintain enterprise data pipelines, data warehouses/lakehouses, ETL/ELT, SQL, Python/PySpark, data modeling, governance, and platform optimization; bachelor’s degree and 5 years' related experience.
Microsoft Fabric, Azure Data Factory, Azure Data Lake Storage, Azure SQL, SQL Server Integration Services (SSIS), SQL Server, SQL, Python, PySpark
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Rye, New York, United States
$127k-$137k/yr OnsiteFull Time
6+ YOE6+ years data engineering experience; bachelor’s in CS/Data Science/IT or related; expert SQL and Python (PySpark); deep Azure data platform experience (ADF, Databricks, Synapse, ADLS); data modeling, pipeline ownership, governance, and HIPAA compliance.
SQL, Python, PySpark, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Purview, Microsoft SQL Server, Oracle, CI/CD
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Shelton, Connecticut, United States
$103k-$128k/yr OnsiteFull Time
3+ YOEBachelor's required; 3+ years data engineering experience; hands-on Databricks or Snowflake lakehouse expertise; PySpark, Python, SQL; streaming (DLT/Snowpipe), Airflow, dbt, Git, cloud (AWS/Azure/GCP); strong communication.
Databricks, Snowflake, Delta Lake, Iceberg, Medallion, PySpark, SQL, Python, Databricks Structured Streaming, Databricks DLT, Snowflake Dynamic Tables, Snowpipe, Databricks Mosaic AI, Snowflake Cortex, Airflow, Databricks Lakeflow, Snowflake Openflow, dbt, Unity Catalog, Horizon Catalog, Databricks AI/BI Genie, Unity Catalog Metrics, Snowflake Semantic Views, Cortex Analyst, Git, Databricks Asset Bundles, Snowflake CLI, Schemachange, AWS, S3, Glue, Kinesis, Azure, GCP
2w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
1mo
Save
Mark Applied
Hide
Senior Data Engineer
New York, New York, United States
$140k-$160k/yr HybridFull Time
5+ YOE5+ years building production Spark-based data pipelines in cloud environments; expertise in PySpark and SQL; experience with Databricks, orchestration (Airflow/Dagster), CI/CD, EMR/Dataproc, data governance, and collaboration using Git.
Delta Lake, Databricks Auto Loader, Structured Streaming, Unity Catalog, Photon, Databricks Workflows, Delta Live Tables, Airflow, Dagster, MLflow, Presto, PySpark, Spark, Databricks, EMR, Dataproc, Git, ChatGPT, Lakeflow Spark Declarative Pipelines (SDP)
2mo
Save
Mark Applied
Hide
Data Engineer
Jersey City or Irving or New York or Tampa
$142k-$213k/yr HybridFull Time
5+ YOE5-8 years of data engineering experience; strong ETL, data warehousing, Python, Spark; AWS Glue, Snowflake; SQL databases; project experience.
AWS Glue, AWS Athena, Airflow, Snowflake, MongoDB, Oracle, PostgreSQL, Unix Shell, Python, PySpark, Ab Initio
2d
Save
Mark Applied
Hide
Lead Data Engineer
Jersey City, New Jersey, United States
$143k-$185k/yr OnsiteFull Time
5+ YOE5+ years of applied data engineering experience, strong software engineering and SQL skills, cloud data platform expertise, distributed processing, data modeling, Airflow, and validated enterprise AI use.
Apache Airflow, SQL, Python, PySpark, AWS, Google Cloud, Azure
2mo
Save
Mark Applied
Hide
Senior Data Engineer - PGIM Technology (Hybrid - Newark, NJ)
Newark, New Jersey, United States
$115k-$155k/yr HybridFull Time
3+ YOEBachelor's or Master's in CS/data engineering, 3+ years data/AI engineering, strong Python and SQL, experience with Spark/PySpark, Microsoft Fabric/Azure Data Factory/AWS Glue, ML model deployment, CI/CD and data governance.
Microsoft Fabric, Azure Data Factory, AWS Glue, PySpark, Spark, Python, SQL, REST APIs, GitHub Actions, Azure DevOps, Git, LLM APIs
2w
Save
Mark Applied
Hide
Lead Data Engineer - Data Engineering 4C
New York City, New York, United States
$60k-$75k/yr HybridFull Time
Lead and mentor data engineers; design scalable data pipelines and ETL; ensure data quality, integrity, and security; collaborate with stakeholders; perform data analysis and troubleshooting.
Databricks, Snowflake, Microsoft Azure, Oracle Database 12c, Riversand, Apache Spark
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1mo
Save
Mark Applied
Hide
Senior Data Analytics Developer
Whippany, New Jersey, United States
$170k-$185k/yr HybridFull Time
Design and build reports and dashboards, develop ETL pipelines and data marts, use Tableau/Qlik/Angular/pyspark/SSIS, analyze and cleanse data, and communicate insights to stakeholders.
Tableau, Qlik, Angular, pyspark, SQL Server Integration Services (SSIS)
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
5+ YOEBachelor’s degree in CS or related; Master’s preferred. 5+ years of Data Engineer experience; Databricks Certifications preferred; Azure Data Engineer certification preferred; strong Python, Databricks, and data warehousing experience.
Databricks, Spark, PySpark, Scala, Delta Lake, Azure Data Lake Storage Gen2, CI/CD, ITSM, SDLC, MLOps
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Rye, New York, United States
$127k-$137k/yr OnsiteFull Time
6+ YOEBachelor's in CS/Data Science/IT, 6+ years data engineering experience, expert SQL and Python (PySpark), deep Azure data services experience, dimensional modeling, data quality, and relational DB migration experience.
SQL, Python, PySpark, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Purview, SQL Server, Oracle
2mo
Save
Mark Applied
Hide
Senior Data Engineer - PGIM Technology (Hybrid - Newark, NJ)
Newark, New Jersey, United States
$115k-$155k/yr HybridFull Time
3+ YOE3–6 years data/AI engineering experience; strong Python, SQL, Spark/PySpark; experience with data pipelines (ETL/ELT) and tools like Microsoft Fabric or Azure Data Factory; ML deployment and basic MLOps; knowledge of generative AI (embeddings, RAG).
Microsoft Fabric, Azure Data Factory, PySpark, Spark, SQL, Python, AWS Glue, REST APIs, GitHub Actions, Azure DevOps, Git
1w
Save
Mark Applied
Hide
Senior Data Engineer (Azure & Databricks)
New York, New York, United States
$149k-$190k/yr HybridFull Time
7+ YOE7-10 years data engineering experience with Databricks, Spark, Delta Lake, strong SQL and Python skills, enterprise ETL/ELT, experience with MDM, cloud data platforms, and data architecture.
Databricks, Apache Spark, Delta Lake, Python, SQL, AWS, Azure, GCP, Deltek, SAP, Oracle
1mo
Save
Mark Applied
Hide
Data Engineering Lead
New York, New York, United States
$200k-$280k/yr OnsiteFull Time
15+ YOE5+ Mgmt15+ years in data engineering with 5+ years in senior leadership; deep hands-on expertise in Python, SQL, Spark/PySpark, cloud data platforms (Azure/AWS/GCP), orchestration tooling (Prefect, Airflow, dbt), enterprise security, and large-scale legacy-to-cloud migrations.
Python, SQL, Spark, PySpark, Prefect, Airflow, dbt, Azure, AWS, GCP, Azure API Management, Kong, Collibra, Atlan, Alation, Terraform, CI/CD
1w
Save
Mark Applied
Hide
Intern - Data Engineer
Long Island City, New York, United States
$35/hr OnsiteInternship
1+ YOEDegree in related field or equivalent experience, 1–2 years relevant experience preferred, intermediate SQL and Python, exposure to cloud data warehouses and ETL, strong problem-solving and communication skills.
Google BigQuery, Snowflake, Databricks, AWS Redshift, SQL, Python, PySpark, Spark, Linux, Bash, Git, GitHub
2mo
Save
Mark Applied
Hide
Manager, Data Engineer (Remote)
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yr RemoteFull Time
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Python, SQL, PySpark, Apache Spark, Databricks, Snowflake, Azure, Data warehousing, ETL, CI/CD
1w
Save
Mark Applied
Hide
Director, Data Engineering
New York, New York, United States
$135k-$217k/yr HybridFull Time
7+ YOE7+ years data engineering experience with advanced SQL, Snowflake, Databricks/PySpark, cloud platforms, BI tools, data modeling, and proven team management.
SQL, Snowflake, Databricks, Apache Spark, PySpark, Delta Lake, Unity Catalog, Tableau, Power BI, Redshift, AWS Glue, Python, Git, AWS, Azure, GCP, Microsoft Excel, Microsoft PowerPoint, VBA, CI/CD, REST APIs
Explore Jobs