34 pyspark data engineer jobs at 15 companies in Foster, RI

1w
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global provider of digital services, consulting, and technology solutions.
Bachelor's degree or equivalent experience; experience with PySpark, AWS Redshift, AWS Glue and Gen AI; ability to work across SDLC, support production systems; US work authorization required; relocation/travel possible.
PySpark, AWS Redshift, Gen AI, AWS Glue
2w
Save
Mark Applied
Hide
Data Engineer Senior Developer, AVP
Quincy or Boston
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Apache Spark, Scala, Hadoop, Hive, AWS, Databricks, Terraform, CloudFormation, Amazon S3, Glue, Lambda, EMR, Redshift, Athena, Kinesis, PL/SQL, Python, PERL, Delta Lake, Unity Catalog, Databricks Workflows, Git, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Data Engineer II - Databricks Platform
Hartford or Hunt Valley or Saint Paul
$127k-$209k/yr HybridFull Time
Travelers
TravelersNew York Stock Exchange: TRV: Provider of commercial and personal property casualty insurance.
8+ YOEBachelor’s in STEM or equivalent, ~8 years related experience with additional data engineering experience, strong Databricks/PySpark/AWS skills, data governance and quality experience, stakeholder communication and leadership.
Databricks, Unity Catalog, Pyspark, AWS, Genie
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
2d
Save
Mark Applied
Hide
Data Engineer
Hartford, Connecticut, United States
$79k-$159k/yr OnsiteFull Time
CVS Health
CVS HealthNYSE: CVS: Provides retail pharmacy, health insurance, and pharmacy benefit management services.
5+ YOERequires 5+ years in data engineering, 3+ years with GCP and large-scale pipelines, Python, SQL, Spark, Apache Beam, BigQuery, Dataflow, Pub/Sub, Cloud Composer, Terraform, Git, and a bachelor's degree or equivalent.
Google Cloud Platform (GCP), BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Functions, Cloud Run, Cloud Storage, Cloud Monitoring, Python, SQL, PySpark, Apache Spark, Apache Beam, Apache Kafka, Apache NiFi, StreamSets, Hadoop, Snowflake, Redshift, Teradata, PostgreSQL, SQL Server, Oracle, PL/SQL, Hive, MongoDB Atlas, Apache Airflow, Git, GitHub Actions, GitLab CI/CD, Terraform, Collibra, Privacera, Unity Catalog, AWS, Power BI, Tableau, QlikView, Looker
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Underwriting Technical Lead
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
10+ YOEBachelor's in STEM or equivalent; ~10 years related experience with 6+ years in data engineering; expertise with AWS (S3, Glue, Redshift, Lambda, EMR), Databricks, dbt, PySpark; AI/ML knowledge; technical leadership and mentoring experience.
AWS, S3, Glue, Redshift, Lambda, EMR, Databricks, dbt, PySpark, Azure Data Factory, Synapse Analytics, Azure Databricks
1mo
Save
Mark Applied
Hide
Data Engineer II
Providence, Rhode Island, United States
$104k/yr OnsiteFull Time
International Game Technology
International Game Technology: Global provider of gaming, digital entertainment, and fintech solutions.
3+ YOEBachelor's or equivalent, 3+ years data engineering, strong SQL and Python, Databricks/Spark experience, cloud (AWS) familiarity, data modeling and ETL/ELT experience.
Databricks, Apache Spark, Delta Lake, Python, SQL, Amazon S3, Git, REST APIs, Apache Airflow, Databricks Workflows, CI/CD pipelines
3d
Save
Mark Applied
Hide
Data Engineer (Hybrid)
Cedar Rapids or Charlotte or Windsor Locks or Richardson
$87k-$165k/yr HybridFull Time
RTX
RTXNYSE: RTX: Provides advanced aerospace and defense systems and services.
5+ YOEUniversity degree and 5 years of relevant experience, or advanced degree and 3 years. Requires U.S. citizenship, Python, SQL, data frameworks, cloud platforms, ETL/ELT, distributed systems, and secure data architecture.
Python, SQL, Spark, PySpark, Databricks, EMR, Glue, AWS, Microsoft Azure, GCP, SharePoint, Terraform, CloudFormation, GitHub Actions, Jenkins
1w
Save
Mark Applied
Hide
Director of Retail Actuarial Data
Hartford or New York City or Charlotte
$165k-$180k/yr HybridFull Time
Talcott Financial Group
Talcott Financial Group: International life insurance group providing risk and retirement solutions.
6+ YOEBachelor's degree in a quantitative field and 6+ years in actuarial data, data engineering, data science, or related insurance fields. Requires SQL, databases, data engineering, ETL, AI tools, and strong communication.
SQL, Python, PySpark, Power BI, ETL, AI
18h
Save
Mark Applied
Hide
BI / Data Architect
Marlborough, Massachusetts, United States
$150k-$160k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
12+ YOERequires 12–15 years of experience with lakehouse architecture, Apache Iceberg, Spark, Flink, Kafka, cloud platforms, data engineering tools, programming languages, containers, and infrastructure automation.
Apache Iceberg, Apache Spark, Apache Flink, Apache Kafka, dbt, Trino, Snowflake, Databricks, AWS, Microsoft Azure, Google Cloud, Python, Scala, SQL, Java, Kubernetes, Docker, Terraform, Apache Airflow, Dagster, Prefect, Polaris, Unity Catalog, Glue Catalog, Apache Nessie
2d
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOERequires 3+ years in data engineering, cloud platforms, and Python, PySpark, or Java; 1+ year with Palantir Foundry and AIP; bachelor's degree or equivalent experience.
Palantir Foundry, Palantir Gotham, Palantir Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Git, GitHub, GitLab, Jenkins, JavaScript
2mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
2d
Save
Mark Applied
Hide
Sr. AI Analytics Engineer
Marlborough or El Paso or Dallas or Arlington or Plano
HybridFull Time
Helen of Troy
Helen of TroyNASDAQ: HELE: Designs and markets branded consumer housewares and personal care products.
8+ YOEBachelor's degree and 8+ years delivering enterprise analytics, BI, data, cloud, software, automation, or AI solutions; 2+ years hands-on GenAI delivery; Python, SQL, Azure AI, and Power BI expertise.
Azure AI Foundry, Copilot Studio, Azure OpenAI, Microsoft 365, Microsoft Graph, Azure AI Search, Power BI, Python, SQL, Snowflake, Model Context Protocol (MCP), Semantic Kernel, LangChain, LangGraph, Microsoft Fabric, Power Platform, Power Automate, Logic Apps, Azure DevOps, CI/CD, MLOps, LLMOps, Jupyter Notebooks, Microsoft Fabric Notebooks, PySpark, Spark, Cortex, Cortex Analyst, Cortex Search, Snowpark, Snowflake ML, Snowflake Intelligence
1mo
Save
Mark Applied
Hide
AVP, Data Platform Engineering
Charlotte or Hartford
$178k-$266k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides property and casualty insurance and financial products.
12+ YOERequires 12+ years in data platform engineering or related disciplines, enterprise-scale platform leadership, cloud and analytics expertise, third-party data capabilities, executive communication, team leadership, and a bachelor's degree.
Snowflake, Apache Spark, Google BigQuery, Google Cloud Dataproc, Google Cloud Dataflow, Informatica Intelligent Data Management Cloud (IDMC), Tableau, ThoughtSpot, Snowflake Cortex, Gemini Enterprise, vector search, Retrieval-Augmented Generation (RAG), API, CI/CD, infrastructure-as-code
2mo
Save
Mark Applied
Hide
Lead Machine Learning Engineer (Manager IC)
McLean or Cambridge or New York City or San Jose
$197k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
6+ YOE2+ MgmtBachelor's degree, 6+ years building data-intensive distributed systems, 4+ years programming in Python, Scala, or Java, and 2+ years building scalable ML systems. People leadership preferred.
Python, Scala, Java, scikit-learn, PyTorch, Dask, Apache Spark, TensorFlow, AWS, Microsoft Azure, Google Cloud Platform
1mo
Save
Mark Applied
Hide
Lead Machine Learning Engineer (Finance Tech - AI Enablement)
Cambridge or McLean or New York City
$197k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
6+ YOE2+ MgmtBachelor’s degree, 6+ years designing data-intensive distributed systems, 4+ years programming in Python, Scala, or Java, and 2+ years building and optimizing machine learning systems.
Python, Scala, Java, scikit-learn, PyTorch, Dask, Apache Spark, TensorFlow, AWS Bedrock, Google Cloud, Azure, Retrieval Augmented Generation (RAG)
4d
Save
Mark Applied
Hide
Principal Analyst, Operations and Health Systems Research
Cambridge or Research Triangle Park
$141k-$188k/yr HybridFull Time
Biogen
BiogenNASDAQ: BIIB: Develops therapies for neurological and neurodegenerative diseases.
5+ YOERequires 5+ years in pharma, biotech, technology, or healthcare, with expertise in data science, machine learning, operations research, data engineering, Python/R, clinical data, modeling, and software development practices.
Electronic Health Records (EHR), Python, R, NumPy, pandas, SciPy, statsmodels, scikit-learn, Google OR-Tools, TensorFlow, PyTorch, PySpark, tidyverse, sparklyr, mlr, tidymodels