33 pyspark data engineer jobs at 16 companies in Middlebury, CT
1w
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent experience; experience with PySpark, AWS Redshift, AWS Glue and Gen AI; ability to work across SDLC, support production systems; US work authorization required; relocation/travel possible.
PySpark, AWS Redshift, Gen AI, AWS Glue
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Rye, New York, United States
$127k-$137k/yr OnsiteFull Time
6+ YOE6+ years data engineering experience; bachelor’s in CS/Data Science/IT or related; expert SQL and Python (PySpark); deep Azure data platform experience (ADF, Databricks, Synapse, ADLS); data modeling, pipeline ownership, governance, and HIPAA compliance.
SQL, Python, PySpark, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Purview, Microsoft SQL Server, Oracle, CI/CD
1mo
Save
Mark Applied
Hide
Sr Data Engineer
Shelton, Connecticut, United States
$103k-$128k/yr OnsiteFull Time
3+ YOEBachelor's required; 3+ years data engineering experience; hands-on Databricks or Snowflake lakehouse expertise; PySpark, Python, SQL; streaming (DLT/Snowpipe), Airflow, dbt, Git, cloud (AWS/Azure/GCP); strong communication.
Databricks, Snowflake, Delta Lake, Iceberg, Medallion, PySpark, SQL, Python, Databricks Structured Streaming, Databricks DLT, Snowflake Dynamic Tables, Snowpipe, Databricks Mosaic AI, Snowflake Cortex, Airflow, Databricks Lakeflow, Snowflake Openflow, dbt, Unity Catalog, Horizon Catalog, Databricks AI/BI Genie, Unity Catalog Metrics, Snowflake Semantic Views, Cortex Analyst, Git, Databricks Asset Bundles, Snowflake CLI, Schemachange, AWS, S3, Glue, Kinesis, Azure, GCP
3w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
1mo
Save
Mark Applied
Hide
Data Engineer II - Databricks Platform
Hartford or Hunt Valley or Saint Paul
$127k-$209k/yr HybridFull Time
8+ YOEBachelor’s in STEM or equivalent, ~8 years related experience with additional data engineering experience, strong Databricks/PySpark/AWS skills, data governance and quality experience, stakeholder communication and leadership.
Databricks, Unity Catalog, Pyspark, AWS, Genie
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
2d
Save
Mark Applied
Hide
Data Engineer
Hartford, Connecticut, United States
$79k-$159k/yr OnsiteFull Time
5+ YOERequires 5+ years in data engineering, 3+ years with GCP and large-scale pipelines, Python, SQL, Spark, Apache Beam, BigQuery, Dataflow, Pub/Sub, Cloud Composer, Terraform, Git, and a bachelor's degree or equivalent.
Google Cloud Platform (GCP), BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Functions, Cloud Run, Cloud Storage, Cloud Monitoring, Python, SQL, PySpark, Apache Spark, Apache Beam, Apache Kafka, Apache NiFi, StreamSets, Hadoop, Snowflake, Redshift, Teradata, PostgreSQL, SQL Server, Oracle, PL/SQL, Hive, MongoDB Atlas, Apache Airflow, Git, GitHub Actions, GitLab CI/CD, Terraform, Collibra, Privacera, Unity Catalog, AWS, Power BI, Tableau, QlikView, Looker
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Underwriting Technical Lead
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
10+ YOEBachelor's in STEM or equivalent; ~10 years related experience with 6+ years in data engineering; expertise with AWS (S3, Glue, Redshift, Lambda, EMR), Databricks, dbt, PySpark; AI/ML knowledge; technical leadership and mentoring experience.
AWS, S3, Glue, Redshift, Lambda, EMR, Databricks, dbt, PySpark, Azure Data Factory, Synapse Analytics, Azure Databricks
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
5+ YOEBachelor’s degree in CS or related; Master’s preferred. 5+ years of Data Engineer experience; Databricks Certifications preferred; Azure Data Engineer certification preferred; strong Python, Databricks, and data warehousing experience.
Databricks, Spark, PySpark, Scala, Delta Lake, Azure Data Lake Storage Gen2, CI/CD, ITSM, SDLC, MLOps
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Rye, New York, United States
$127k-$137k/yr OnsiteFull Time
6+ YOEBachelor's in CS/Data Science/IT, 6+ years data engineering experience, expert SQL and Python (PySpark), deep Azure data services experience, dimensional modeling, data quality, and relational DB migration experience.
SQL, Python, PySpark, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Purview, SQL Server, Oracle
2d
Save
Mark Applied
Hide
Data Engineer
Yorktown Heights or Charlotte or Austin or United States
$90k-$168k/yr OnsiteFull Time
Bachelor's degree required; experience designing ETL/ELT pipelines with SQL, Python, PostgreSQL, Presto, Apache Airflow, streaming platforms, Git, and distributed data environments.
PostgreSQL, Presto, Apache Airflow, Python, pandas, Apache Kafka, IBM Event Streams, IBM watsonx.data, Trino, Apache Spark, Git, SQL, ETL, ELT
2mo
Save
Mark Applied
Hide
Data Engineer (CT, Newington)
Newington, Connecticut, United States
OnsiteFull Time
Bachelor's in a technical field (or equivalent), extensive data engineering experience with SQL and Python, BI and ETL tool proficiency, experience deploying ML models, and familiarity with CMMC/NIST SP 800-171 and ITAR eligibility requirements.
SQL, Python, Microsoft SQL Server, Oracle, PostgreSQL, Microsoft Power BI, SSRS, PowerShell, C#, Perl, Microsoft SharePoint, ASP.NET Core, PHP, Bootstrap, HTML5, React.js, Node.js, Django, Microsoft Graph API, Microsoft Power Platform, Power Apps, Power Automate, Tableau, Qlik, Looker, MicroStrategy, Oracle Analytics, Microsoft Power Query, SSIS, Talend, Boomi, Apache Airflow, Prefect, Dagster, Apache Spark, Databricks, MLOps
2mo
Save
Mark Applied
Hide
Manager, Data Engineer (Remote)
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yr RemoteFull Time
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Python, SQL, PySpark, Apache Spark, Databricks, Snowflake, Azure, Data warehousing, ETL, CI/CD
2d
Save
Mark Applied
Hide
Data Architect
Shelton, Connecticut, United States
$138k-$173k/yr OnsiteFull Time
8+ YOERequires 8–12+ years in data engineering, architecture, or platform engineering; expert SQL and Python/PySpark; Databricks expertise; cloud and distributed-platform experience; and a bachelor's degree or equivalent.
Databricks, Delta Lake, Unity Catalog, MLflow, Databricks Workflows, Delta Live Tables, SQL, Python, PySpark, Scala, Apache Spark, AWS, Azure, GCP, Airflow, Azure Data Factory, Great Expectations, Monte Carlo, Databricks Lakehouse Monitoring, Terraform, Pulumi, Microsoft Purview, Collibra, Alation, Snowflake, Amazon Redshift, Microsoft Excel
3d
Save
Mark Applied
Hide
Data Engineer (Hybrid)
Cedar Rapids or Charlotte or Windsor Locks or Richardson
$87k-$165k/yr HybridFull Time
5+ YOEUniversity degree and 5 years of relevant experience, or advanced degree and 3 years. Requires U.S. citizenship, Python, SQL, data frameworks, cloud platforms, ETL/ELT, distributed systems, and secure data architecture.
Python, SQL, Spark, PySpark, Databricks, EMR, Glue, AWS, Microsoft Azure, GCP, SharePoint, Terraform, CloudFormation, GitHub Actions, Jenkins
1w
Save
Mark Applied
Hide
Director of Retail Actuarial Data
Hartford or New York City or Charlotte
$165k-$180k/yr HybridFull Time
6+ YOEBachelor's degree in a quantitative field and 6+ years in actuarial data, data engineering, data science, or related insurance fields. Requires SQL, databases, data engineering, ETL, AI tools, and strong communication.
SQL, Python, PySpark, Power BI, ETL, AI
1w
Save
Mark Applied
Hide
AML Technology Data Analyst – Vice President
Stamford, Connecticut, United States
$130k-$220k/yr OnsiteFull Time
5+ YOEBachelor's in CS/engineering, 5+ years in application or data technology roles, strong RDBMS and PL/SQL skills, Python and SQL proficiency, AML/KYC domain knowledge, and experience with large-scale data platforms.
Oracle PL/SQL, SQL, Python, Apache Spark, AWS, Databricks
2d
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$54k-$235k/yr HybridFull Time
3+ YOERequires 3+ years in data engineering, cloud platforms, and Python, PySpark, or Java; 1+ year with Palantir Foundry and AIP; bachelor's degree or equivalent experience.
Palantir Foundry, Palantir Gotham, Palantir Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Git, GitHub, GitLab, Jenkins, JavaScript
2mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1mo
Save
Mark Applied
Hide
AVP, Data Platform Engineering
Charlotte or Hartford
$178k-$266k/yr HybridFull Time
12+ YOERequires 12+ years in data platform engineering or related disciplines, enterprise-scale platform leadership, cloud and analytics expertise, third-party data capabilities, executive communication, team leadership, and a bachelor's degree.
Snowflake, Apache Spark, Google BigQuery, Google Cloud Dataproc, Google Cloud Dataflow, Informatica Intelligent Data Management Cloud (IDMC), Tableau, ThoughtSpot, Snowflake Cortex, Gemini Enterprise, vector search, Retrieval-Augmented Generation (RAG), API, CI/CD, infrastructure-as-code
Explore Jobs