29 pyspark developer jobs at 14 companies in Raleigh, NC

2mo
Save
Mark Applied
Hide
Senior Algorithm Developer - PySpark / SQL (Durham, NC, US)
Durham, North Carolina, United States
OnsiteFull Time
ACA Group
ACA Group: Regulatory compliance and risk management solutions for financial services.
5+ YOE3+ years PySpark/Python in production; 5+ years SQL; Spark ecosystem; AWS; CI/CD; Git/JIRA; agile teams.
PySpark, Python, SQL, Apache Spark, AWS, Git, JIRA, CI/CD, Iceberg, EMR, S3, CloudWatch
6d
Save
Mark Applied
Hide
Databricks Engineer
Raleigh, North Carolina, United States
$100k-$140k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
4+ YOEExperience with Databricks, Apache Spark/PySpark, SQL, ETL/ELT development, data modeling, Python or Scala, Azure, production support, and CI/CD for data pipelines.
Databricks, Apache Spark, PySpark, SQL, Python, Scala, Delta Lake, CI/CD, Microsoft Azure
2w
Save
Mark Applied
Hide
Senior Software Engineer/Developer
Durham, North Carolina, United States
OnsiteFull Time
Fidelity Investments
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
1+ YOEExperience building large-scale database and ETL batch applications using PySpark, SQL, shell scripting, AWS Glue/DMS, Terraform/CloudFormation, CI/CD tooling, and Oracle; bachelor's or master's degree as specified.
PySpark, SQL, Shell Scripting, AWS Glue, AWS DMS, JUnit, Terraform, CloudFormation, EMR, AWS CloudWatch, Splunk, Datadog, GitHub, BitBucket, Jenkins, OpenShift, Lambda, Step Functions, SNS, SQS, Tableau, Oracle, Amazon Web Services (AWS), Microsoft Azure
3mo
Save
Mark Applied
Hide
AI Engineer
Cary, North Carolina, United States
$110k-$150k/yr OnsiteFull Time
GEI Consultants
GEI Consultants: Provides multi-disciplinary engineering and environmental consulting services.
4+ YOE4+ years software engineering; 1 year Generative AI; Python/PySpark/R/SQL; Azure AI; Databricks; TensorFlow/PyTorch; LLMs; security and ethics; Azure/Databricks certifications a plus.
Python, PySpark, R, SQL, Azure AI Platform, Azure Data Factory, Azure Synapse, Azure Cognitive Services, Databricks, TensorFlow, PyTorch, GPT, Codex, DALL-E, Databricks Mosaic
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
1w
Save
Mark Applied
Hide
Lead Principal Data Engineer
Research Triangle Park or Durham or Raleigh
OnsiteFull Time
Peter Millar
Peter MillarSIX Swiss Exchange: CFR: Designs and sells luxury lifestyle apparel and performance sportswear.
8+ YOE2+ Mgmt8+ years data engineering/architecture experience with 2+ years in a lead/principal capacity; expert SQL and Python, strong Spark/PySpark, Fabric/OneLake platform experience, CI/CD and governance skills.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflows Gen2, Spark, PySpark, SQL, Python, Git, Azure AI, Microsoft Foundry (Azure AI Foundry), Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, Microsoft Purview
1mo
Save
Mark Applied
Hide
Software Engineer
Morrisville, North Carolina, United States
$100k-$110k/yr HybridFull Time
Xylem
XylemNYSE: XYL: Manufacturer of water transport, treatment, and testing technologies.
3+ YOEBachelor's in CS or related field, 3+ years working with ETL and data integration, scripting (Python, Bash, Groovy), relational and NoSQL DBs, messaging (Kafka, RabbitMQ), REST/SOAP integration, Git, and strong communication skills.
Xylem Vue, ETL, Python, Bash, Groovy, MySQL, PostgreSQL, MongoDB, Cassandra, Kafka, RabbitMQ, REST, SOAP, Git, Apache NiFi, Apache Spark, Airflow, AWS, Azure, GCP, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
Senior Bioinformatics Data Engineer (Consultant)
Raleigh, North Carolina, United States
HybridFull Time
ProPharma
ProPharma: Provides clinical, regulatory, and compliance services to life sciences.
5+ YOE5+ years data engineering on AWS with Python/SQL; strong dbt, Dagster/Airflow; experience with AI-native engineering; PHI-adjacent data handling; legacy R/PySpark code familiarity; excellent communication.
Python, SQL, dbt, Dagster, Airflow, Prefect, AWS, S3, ECS/Fargate, Redshift, Apache Iceberg, Docker, ECS
2mo
Save
Mark Applied
Hide
Databricks Engineer
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, Auto Loader, Airflow, dbt, Great Expectations, Collibra, Apache Spark, Presto, Amazon EMR, Amazon Redshift, Snowflake, Google BigQuery, SQL, Stored Procedures, Java, Python, PySpark, Databricks Asset Bundles, Terraform, NoSQL Databases, Container Management Systems, GitHub Copilot, Codex, Claude, Cursor, Windsurf
3mo
Save
Mark Applied
Hide
Data Engineer
Wakefield or Denver or New York or Atlanta or Cary or Dallas or Pasadena or Rancho Cordova or West Palm Beach
$90k-$150k/yr HybridFull Time
GEI Consultants
GEI Consultants: Professional engineering and environmental consulting services.
4+ YOE4+ years of data engineering; Python and SQL; Azure data services; ETL/ELT; data governance; supports AI/RAG and analytics.
Python, SQL, PySpark, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Cosmos DB, Databricks, Delta Lake, Unity Catalog, Power BI, API, Graph connectors, CI/CD, Terraform
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
6d
Save
Mark Applied
Hide
Technology Consultant 1
Dallas or Raleigh
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Databricks, PySpark and SQL; bachelor's degree or equivalent; ability to work across SDLC, monitor and troubleshoot production systems; US work authorization required.
Databricks, Pyspark, SQL, Machine learning
1mo
Save
Mark Applied
Hide
Manager, Data Engineer (Remote)
Raleigh or Jersey City or New York or White Plains or Washington D.C. or Home Base, PA or Home Base, NY or Raleigh or Home Base, DC or Home Base, NJ or Home Base, VA or Home Base, FL or Home Base, NC
$101k-$174k/yr RemoteFull Time
Arch Capital Group
Arch Capital GroupNASDAQ: ACGL: Global provider of specialty insurance, reinsurance and mortgage insurance.
6+ YOE3+ Mgmt6+ years Python and distributed processing; 2-3+ years technical leadership; Databricks; college degree in CS/Engineering/Math/Data analytics
Python, SQL, PySpark, Apache Spark, Databricks, Snowflake, Azure, Data warehousing, ETL, CI/CD
3w
Save
Mark Applied
Hide
Principal AI Architect (NJ, US)
Raleigh or New Jersey
OnsiteFull Time
Indegene
IndegeneNational Stock Exchange of India: INDGN: Digital-led commercialization and clinical solutions for life sciences.
10+ YOE10+ years software experience with 3+ years in AI/ML or GenAI; Bachelor's or Master's in CS/AI/Data Science; proficiency in Python/PySpark/Java/JavaScript/TypeScript; experience with LLM Mesh, Dataiku, LLMs, vector DBs, cloud AI services, LangChain/LlamaIndex.
Dataiku LLM Mesh, Dataiku, OpenAI, Claude, Mistral, LangChain, LlamaIndex, Pinecone, FAISS, pgvector, ChromaDB, TensorFlow, PyTorch, Python, PySpark, Java, JavaScript, TypeScript, AWS, GCP, Azure, Amazon SageMaker, Amazon Bedrock, Vertex AI, React, Angular, LLaMA
4w
Save
Mark Applied
Hide
Member of Technical Staff 2
San Jose or Durham or Mexico City or Bangalore or Pune or Hoofddorp or Belgrade or Barcelona or Singapore or Sydney or Tokyo
$110k-$218k/yr HybridFull Time
Nutanix
NutanixNASDAQ: NTNX: Sells cloud software and hyperconverged infrastructure for enterprises.
0+ YOEBachelor's or Master's in CS or related; 2+ years experience (Bachelors) or 0+ (Masters). Experience with Python/Scala/Java/Golang/C++, databases, message queues, API gateways, Kubernetes, microservices; Apache Spark and data warehousing knowledge a plus.
Nutanix Cloud Manager (NCM), Python, Scala, Java, Golang, C++, Message queues, API gateways, Kubernetes, Apache Spark
1mo
Save
Mark Applied
Hide
Specialist Programmer
Austin or Bridgewater or Charlotte or Phoenix or Raleigh or Richardson or Arizona or New Jersey or North Carolina or Texas or United States
$90k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides global IT consulting and digital transformation services.
Bachelor's degree in CS/IT/Software Engineering or related field required; strong programming skills across modern stacks (Java, Python, JS, cloud); campus hiring for recent grads; US work authorization required; assessment required.
Java, Spring Boot, Microservices, Angular, React JS, Docker, K8S, Next.js, Vue.js, MongoDB, NodeJS, JavaScript, Typescript, C#, .NET, ASP.NET .NET Core, ExpressJS, Hadoop, Spark, PySpark, Hive, PostgreSQL, Python, Kafka, Airflow, Beam, Agentic AI, LangChain, LangGraph, NLP, MCP, Prompt/Context Engineering, AWS, Azure, GCP