235 pyspark data engineer jobs at 119 companies in Deer Park, NY
4w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
6+ YOEExpertise in PySpark and Hadoop ecosystem, strong SQL, data modeling, shell/Autosys automation, 6+ years apps development/systems analysis experience, bachelor’s degree or equivalent.
PySpark, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
2w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
4w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
6+ YOEExpertise in PySpark and Hadoop ecosystem, complex SQL, data modeling, Autosys and shell scripting; 6+ years apps development or systems analysis experience; bachelor’s degree preferred.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
4w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
6+ YOERequires 6–10 years of applications development or systems analysis experience, PySpark and Hadoop expertise, complex SQL, distributed systems, data modeling, shell scripting, Autosys, and a bachelor's degree or equivalent.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, shell scripting, Autosys, Apache Kafka
1mo
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano
OnsiteFull Time
Experience with Hadoop, PySpark, Hive, Spark, Python, SQL, Autosys/Airflow, Unix shell; bachelor\u0002s degree or equivalent; strong communication and SDLC experience required.
Hadoop, PySpark, Hive, Spark, Python, SQL, Unix Shell, Autosys, Airflow, Cloudera, Tableau
1mo
Save
Mark Applied
Hide
Data Engineer
Jersey City, New Jersey, United States
HybridFull Time
3+ YOE3+ years data engineering experience; strong SQL, Python or PySpark; basic knowledge of AWS/Azure/GCP; bachelor's or master's in CS/Engineering/IT or related; strong problem-solving and teamwork.
SQL, Python, PySpark, AWS, Azure, GCP
3mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or New York
$142k-$190k/yr HybridFull Time
5+ YOE5+ years in data engineering; strong SQL, PySpark, Databricks; AWS; Airflow; data modeling; BI dashboards; Bachelor in CS/IS or related.
SQL, PySpark, Databricks, Unity Catalog, Snowflake, AWS, Airflow, Git, CI/CD, Delta Lake, S3, IAM, EC2, Glue, Lambda
2mo
Save
Mark Applied
Hide
Data Engineer
New York or Los Angeles or San Francisco
$140k-$175k/yr HybridFull Time
3+ YOEBS or equivalent, 3+ years data engineering experience, Python and SQL proficiency, experience with PySpark and distributed data processing, AWS experience preferred, LLM-assisted development familiarity, and willingness to participate in on-call support.
S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, ClickHouse, PostgreSQL, FastAPI, Metabase, Python, SQL, AWS, AWS Athena, EHR, OMOP CDM, HIPAA, LLM
1mo
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco or New York City
$185k-$195k/yr HybridFull Time
5+ YOE5+ years data engineering experience, strong dbt and Databricks skills, Python/PySpark, streaming and CDC ingestion, data quality and observability, experience with operational integrations.
dbt, Databricks, Python, PySpark, Delta Lake, Delta Live Tables, Airflow, Cloud Run, Cloud Functions, BigQuery, GCP, AWS, Salesforce, NetSuite, Stripe, Mulesoft, Great Expectations, Unity Catalog, Terraform, Spacelift, Boomi
3mo
Save
Mark Applied
Hide
Sr Data Engineer
Santa Monica or Seattle or New York
$142k-$190k/yr HybridFull Time
5+ YOE5+ years in data engineering; SQL expert; PySpark; Databricks; AWS; Airflow; Databricks Unity Catalog; Snowflake; strong data modeling and ETL/ELT design.
Databricks, PySpark, SQL, Unity Catalog, Snowflake, Airflow, AWS, S3, IAM, Delta Lake, Git, CI/CD
3d
Save
Mark Applied
Hide
Senior Data Engineer
Chicago or Austin or Dallas or New York City or San Francisco or Seattle
$147k-$181k/yr RemoteFull Time
5+ YOERequires 5+ years of data engineering experience, Python, SQL, PySpark, cloud data pipelines, data contracts or quality governance, Delta Lake or sharing technologies, API services, and mentoring experience.
Python, SQL, Azure, Delta Lake, Delta Sharing, PySpark, Spark UI, Databricks, Unity Catalog, Azure Data Factory, Event Hubs, CI/CD
1mo
Save
Mark Applied
Hide
Data Engineer
Albany or Rome or New York
$97k-$126k/yr OnsiteFull Time
5+ YOEDesign and maintain enterprise data pipelines, warehouses/lakehouses, ETL/ELT processes using Microsoft data services, SQL, Python/PySpark; implement data governance and optimize platform performance.
Microsoft Fabric, Microsoft Azure Data Factory, Azure Data Lake Storage, Azure SQL, SQL Server Integration Services (SSIS), SQL Server, SQL, Python, PySpark
2mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Rye, New York, United States
$127k-$137k/yr OnsiteFull Time
6+ YOE6+ years data engineering experience; bachelor’s in CS/Data Science/IT or related; expert SQL and Python (PySpark); deep Azure data platform experience (ADF, Databricks, Synapse, ADLS); data modeling, pipeline ownership, governance, and HIPAA compliance.
SQL, Python, PySpark, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Purview, Microsoft SQL Server, Oracle, CI/CD
1w
Save
Mark Applied
Hide
Senior Data Engineer
Westport or United States
$130k-$150k/yr RemoteFull Time
6+ YOE6+ years of data engineering experience; expert Python, SQL, and PySpark; enterprise-scale pipelines; cloud data services, orchestration, Git, CI/CD, containers, dbt, and a relevant bachelor's degree required.
Apache Spark, Kafka, Flink, Delta Lake, Iceberg, SQL, PySpark, Great Expectations, dbt, Terraform, Helm, Python, Apache Airflow, Prefect, Dagster, AWS Glue, Azure Data Factory, GCP Dataflow, Git, CI/CD, Docker, Kubernetes, Databricks, Snowflake, Apache Hudi
4d
Save
Mark Applied
Hide
Senior Data Engineer
Belfast or Toronto or London or New York City or India
HybridFull Time
10+ YOE10+ years in data engineering or related technology roles; hands-on Databricks, Spark/PySpark, Python, SQL, Delta Lake, Azure, and ADLS experience; expertise in scalable pipelines, governed data products, CI/CD, monitoring, and data quality.
Databricks, Python, SQL, Spark, PySpark, Azure, Delta Lake, ADLS, Unity Catalog, CI/CD, AI/ML
3d
Save
Mark Applied
Hide
Specialist Data Engineer
North America or New York City or New York or Connecticut
$114k-$135k/yr HybridFull Time
3+ YOEBachelor's degree or equivalent education and experience, 3+ years of relevant experience, strong data engineering and cloud skills, and proficiency with Azure, Python, PySpark, SQL, and CI/CD practices.
Microsoft Certified: Azure Data Engineer Associate, Microsoft Certified: Azure Data Fundamentals, Azure Databricks, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Store, Microsoft Purview, Power BI, Terraform, Oracle, SQL Server, Python, PySpark, SQL, Airflow, Git Repos, Ansible, AWS, GCP, Jira, Confluence, Agile, Scrum, DevOps, Extreme Programming (XP), Kanban, Lean, Rapid Application Development (RAD), Unit Testing, Integration Testing, System Testing, Acceptance Testing, Regression Testing
2mo
Save
Mark Applied
Hide
Sr Data Engineer
Shelton, Connecticut, United States
$103k-$128k/yr OnsiteFull Time
3+ YOEBachelor's degree in computer science, engineering, or related field; 3–5 years of data engineering experience; expertise in Databricks or Snowflake, PySpark or advanced SQL, Python, lakehouse architecture, streaming, governance, cloud, and CI/CD.
Snowflake, Databricks, Delta Lake, Iceberg Tables, PySpark, SQL, Python, Databricks Structured Streaming, Databricks DLT, Snowflake Dynamic Tables, Snowpipe Streaming, Airflow, Databricks Lakeflow, Snowflake Openflow, dbt, Unity Catalog, Horizon Catalog, Databricks AI/BI Genie, Unity Catalog Metrics, Snowflake Semantic Views, Cortex Analyst, Databricks Mosaic AI, Snowflake Cortex, Git, Databricks Asset Bundles, Snowflake CLI, Schemachange, AWS, Amazon S3, AWS Glue, Amazon Kinesis, Azure, GCP
1mo
Save
Mark Applied
Hide
Data Engineer
New York, New York, United States
$72k-$97k/yr OnsiteFull Time
Design Lakehouse architectures on Databricks, develop PySpark jobs, implement governance with Unity Catalog, work with Airflow and CI/CD; strong data governance and streaming knowledge.
Databricks, Pyspark, CI/CD, Airflow, Unity Catalog, Databricks Apps, Delta Sharing
1mo
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
Explore Jobs