HiringCafe
Join our community

33 pyspark developer jobs at 17 companies in Connecticut

9h
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global provider of digital services, consulting, and technology solutions.
Experience with PySpark and AWS Redshift; Databricks/Glue/Gen AI preferred. Bachelor's degree or equivalent (or relevant experience in lieu); ability to work US projects without employer sponsorship; relocation/travel possible.
PySpark, AWS Redshift, Databricks, Glue, Gen AI, AWS
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Data Engineer
Shelton, Connecticut, United States
$119k-$149k/yr OnsiteFull Time
Subway
Subway: Global restaurant chain specializing in made-to-order submarine sandwiches.
5+ YOE5+ years building data pipelines and integrations with 3+ years cloud experience; hands-on Databricks or Snowflake, PySpark/SQL, Python, Airflow, Git; bachelor’s degree preferred.
Snowflake, Databricks, Delta Lake, Unity Catalog, Iceberg Tables, Horizon Catalog, Databricks Structured Streaming, DLT, Snowflake Dynamic Tables, Snowpipe Streaming, Databricks AI/BI Genie, Unity Catalog Metrics, Snowflake Semantic Views, Cortex Analyst, Airflow, Databricks Lakeflow, Snowflake Openflow, dbt, PySpark, SQL, Python, Git, Databricks Asset Bundles, Snowflake CLI, Schemachange, AWS, S3, Glue, Kinesis, Azure, GCP, Databricks Mosaic AI, Snowflake Cortex
Job PostingView all
21h
Save
Mark Applied
Hide
Senior Data Engineer
Florida or Montana or Michigan or Massachusetts or Rhode Island or West Virginia or Oregon or Oklahoma or Minnesota or New York or South Carolina or Kentucky or Virginia or Colorado or New Jersey or Wisconsin or Utah or Pennsylvania or Ohio or North Carolina or Nebraska or Mississippi or South Dakota or Maryland or Louisiana or Kansas or Iowa or Illinois or Tennessee or Delaware or Connecticut or California or Hawaii or Arkansas or District of Columbia or Georgia or Missouri or Arizona or Alabama or New Hampshire or Texas or Vermont or Indiana or Washington or Nevada or Idaho or New Mexico or Maine
$143k-$160k/yr RemoteFull Time
AmeriLife
AmeriLife: Distributes insurance, annuities, and retirement solutions for retirees.
7+ YOE7+ years data engineering experience with 3+ years Databricks; strong Spark/PySpark, Delta Lake, SQL, Azure, Git and CI/CD skills; Bachelor's degree required.
Databricks, Apache Spark, Delta Lake, Unity Catalog, Workflows, SQL Warehouses, Delta Live Tables, PySpark, SQL, Azure, Git, dbt, Terraform, Azure DevOps
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Staff Data Engineer
Hartford or Chicago or Columbus or Charlotte
$135k-$203k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides property and casualty insurance, group benefits, and wealth management.
8+ YOE8+ years data engineering experience with Snowflake, Oracle, Informatica, GitHub, AWS/Azure, Python/PySpark, EMR, Kafka; certifications in cloud/Snowflake preferred; US work authorization required.
Snowflake, Oracle, Informatica Cloud, PowerCenter, GitHub, Qlik, Shareplex, DMS, Python, PySpark, Spark, Hadoop, EMR, S3, Lambda, AWS, Azure, Kafka, Google Vertex, AWS Bedrock
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer II - Databricks Platform
Hartford or Hunt Valley or Saint Paul
$127k-$209k/yr HybridFull Time
Travelers
TravelersNew York Stock Exchange: TRV: Provider of commercial and personal property casualty insurance.
8+ YOEBachelor’s in STEM or equivalent, ~8 years related experience with additional data engineering experience, strong Databricks/PySpark/AWS skills, data governance and quality experience, stakeholder communication and leadership.
Databricks, Unity Catalog, Pyspark, AWS, Genie
Job PostingView all
1w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
Lovesac
LovesacNASDAQ: LOVE: Designs and sells modular furniture including sectionals and beanbags.
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Navitus Health Solutions
Navitus Health Solutions: Transparent pharmacy benefit management and specialty pharmacy provider.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer, Underwriting Technical Lead
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
10+ YOEBachelor's in STEM or equivalent; ~10 years related experience with 6+ years in data engineering; expertise with AWS (S3, Glue, Redshift, Lambda, EMR), Databricks, dbt, PySpark; AI/ML knowledge; technical leadership and mentoring experience.
AWS, S3, Glue, Redshift, Lambda, EMR, Databricks, dbt, PySpark, Azure Data Factory, Synapse Analytics, Azure Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Staff Data Engineer
Hartford or Chicago or Columbus or Charlotte
$135k-$203k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
8+ YOE8+ years data engineering experience; hands-on with Snowflake, Oracle, Informatica, GitHub, Qlik, SharePlex, DMS; AWS/Azure, EMR, S3, Lambda; Python/PySpark, SQL/NoSQL, CI/CD, ETL; authorized to work in the US without sponsorship.
AWS, Azure, Amazon EMR, Amazon S3, AWS Lambda, Hadoop, Apache Spark, Apache Kafka, Snowflake, Oracle, Informatica Cloud, Informatica PowerCenter, GitHub, Qlik, SharePlex, OpenFlow, DMS, PySpark, Python, SQL, NoSQL, CI/CD, Google Cloud Platform (GCP), AWS Bedrock, Vertex AI
Job PostingView all
1mo
Save
Mark Applied
Hide
Retail Actuarial Data Engineer
Charlotte or Hartford
$100k-$130k/yr HybridFull Time
Talcott Financial Group
Talcott Financial Group: International life insurance group providing risk and retirement solutions.
3+ YOEBachelor's in a quantitative field, minimum 3 years actuarial/data engineering/data science experience in insurance, strong SQL, ETL knowledge, experience with Python/PySpark and Power BI preferred, experience using AI tools, strong problem-solving and communication.
SQL, Python, PySpark, Power BI, ETL, AI tools and models
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Software Engineer (Python, LLM) - AskGartner
Irving or Stamford
$116k-$170k/yr HybridFull Time
Gartner
GartnerNYSE: IT: Provides research and advisory services for business leaders.
Expert-level Python; backend services; FastAPI; AWS/Azure; SageMaker Pipelines; Pytest; PostgreSQL; Pandas; Git.
Python, Python FastAPI, AWS, Azure, AWS SageMaker Pipelines, pytest, Git, PostgreSQL, Parquet, JSON, CSV, Pandas, LangGraph, LangChain, OpenAI, Anthropic, Google, Locust, JMeter, AWS Athena, AWS S3, IAM, Splunk, AWS Secrets Manager, PySpark, Docker, Kubernetes, Terraform, OpenSearch, RAG systems, Cache technologies
Job PostingView all
1w
Save
Mark Applied
Hide
Solutions Engineer - East Coast
Georgia or Massachusetts or New Jersey or Connecticut or Pennsylvania or New York
$150k-$180k/yr RemoteFull Time
Cloudera
Cloudera: Provides hybrid data platforms for enterprise analytics and AI.
5+ YOE5+ years pre-sales experience, technical discovery, solution design, demos/POCs; experience with public cloud, Hadoop ecosystem, SQL, streaming, and basic software development; Bachelor’s degree or equivalent.
AWS, Azure, GCP, IBM Cloud, Apache Spark, Iceberg, NiFi, Kafka, Flink, Apache Hadoop, HDFS, YARN, Hive, Impala, Kudu, Solr, Java, Scala, Python, Kubernetes, OpenShift, Teradata, Netezza, GreenPlum, Exadata, HBase, Phoenix, Accumlo, Druid, Cassandra, MongoDB, Talend, DataStage, Informatica BDM, Qlik, Tableau, Zoomdata, Tibco, MuleSoft, IBM, Oracle, Spring Integration, R, Anaconda, Jupyter
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Indiana or Kentucky or Louisiana or Massachusetts or Maine or Maryland or Michigan or Minnesota or Missouri or North Carolina or New Jersey or New York or Oregon or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Wisconsin
$130k-$150k/yr RemoteFull Time
MissionWired
MissionWired: Providing digital fundraising and data-driven marketing for nonprofit organizations.
5+ YOE5+ years professional software engineering experience; hands-on Apache Spark and distributed data pipelines; experience managing data warehouses or lakes; mentoring and guiding technical decisions; strong data modeling and production skills.
Apache Spark, AWS, GitHub Actions, Terraform, Docker
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior GCP Data Engineer
Hartford, Connecticut, United States
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
9+ YOE8+ years in Data Engineering with leadership; strong GCP, SQL, Python; ETL and Spark; data modeling; cross-functional collaboration; leadership.
BigQuery, Cloud Composer (Airflow), Cloud Storage, Dataproc, Apache Spark, SQL, Python, Scala
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer (CT, Newington)
Newington, Connecticut, United States
OnsiteFull Time
Applied Aerospace & Defense
Applied Aerospace & Defense: Manufactures precision flight-critical hardware for aerospace and defense.
Bachelor's in a technical field (or equivalent), extensive data engineering experience with SQL and Python, BI and ETL tool proficiency, experience deploying ML models, and familiarity with CMMC/NIST SP 800-171 and ITAR eligibility requirements.
SQL, Python, Microsoft SQL Server, Oracle, PostgreSQL, Microsoft Power BI, SSRS, PowerShell, C#, Perl, Microsoft SharePoint, ASP.NET Core, PHP, Bootstrap, HTML5, React.js, Node.js, Django, Microsoft Graph API, Microsoft Power Platform, Power Apps, Power Automate, Tableau, Qlik, Looker, MicroStrategy, Oracle Analytics, Microsoft Power Query, SSIS, Talend, Boomi, Apache Airflow, Prefect, Dagster, Apache Spark, Databricks, MLOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Sales Engineer - Hadoop Observability & Open Data Platform
United States or Washington or Connecticut or Georgia or Florida or Maryland or Virginia
RemoteFull Time
Acceldata
Acceldata: Software for monitoring and managing enterprise data pipelines.
12+ YOE12+ years in SaaS/data sales engineering, Bachelor's degree required, hands-on experience with cloud platforms (AWS/GCP/Azure), Databricks or Snowflake, Hadoop components and data observability tools; strong presentation and technical proposal skills; travel up to 50%.
HDFS, Yarn, Apache Spark, Hive, HBase, Ranger, Kerberos, Kafka, Zookeeper, Trino, Jupyter, Airflow, AWS, GCP, Azure, Databricks, Snowflake
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Director, Data Development
New York City or San Francisco or Knoxville or Arizona or California or Colorado or Connecticut or Florida or Georgia or Illinois or Louisiana or Massachusetts or Minnesota or North Carolina or New Jersey or Nevada or New York or Ohio or Pennsylvania or South Carolina or Tennessee or Texas or Washington or Virginia or District of Columbia
$245k-$275k/yr RemoteFull Time
Verana Health
Verana Health: Curates real-world clinical data to accelerate medical research and insights.
10+ YOE5+ Mgmt10+ years applying machine learning to clinical datasets, 5+ years managing technical teams, experience with foundation models, EHR data, Python/SQL/PySpark/R, cloud ML platforms, and strong communication skills.
Python, SQL, PySpark, R, Databricks, SageMaker, MLflow, EHR
Job PostingView all

Explore Jobs

Expand Your Job Search