285 pyspark developer jobs at 122 companies in Berkeley Heights, NJ

1mo
Save
Mark Applied
Hide
Pyspark Architect
Jersey City or Plano
$96k-$125k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience in enterprise/solution architecture, PySpark and Hadoop ecosystem, cloud and integration technologies, ETL design, strong communication; bachelor\u0002s or equivalent required; authorized to work in the US without sponsorship.
PySpark, Cloudera, Hadoop, Hive, Scala, Spark, Sqoop, Flume, Kafka, Python, NoSQL, REST APIs, JSON, XML, AWS, Azure, GCP, Databricks, Snowflake, Starburst
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
6+ YOEExpertise in PySpark and Hadoop ecosystem, complex SQL, data modeling, Autosys and shell scripting; 6+ years apps development or systems analysis experience; bachelor’s degree preferred.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: A global financial services providing banking and credit services.
6+ YOERequires 6–10 years of applications development or systems analysis experience, PySpark and Hadoop expertise, complex SQL, distributed systems, data modeling, shell scripting, Autosys, and a bachelor's degree or equivalent.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, shell scripting, Autosys, Apache Kafka
3d
Save
Mark Applied
Hide
Java Pyspark Developer
Jersey City, New Jersey, United States
$110k-$135k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
6+ YOERequires 6+ years of experience, a bachelor's degree in computer science, and expertise in Java, Spark, Python, PySpark, Angular or React, full-stack development, APIs, and AI technologies.
Java, Angular, React, Spark, Python, PySpark
3w
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOEExpertise in PySpark and Hadoop ecosystem, strong SQL, data modeling, shell/Autosys automation, 6+ years apps development/systems analysis experience, bachelor’s degree or equivalent.
PySpark, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
1w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global provider of digital services, consulting, and technology solutions.
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
2w
Save
Mark Applied
Hide
Sr. Associate, Date Engineer - PySpark
Atlanta or New York City or Philadelphia or Dallas
OnsiteFull Time
KPMG
KPMG: Global professional services network providing audit, tax, and advisory.
5+ YOE5+ Mgmt5+ years leading data science/engineering teams, Master’s degree in CS/DS/Statistics/Engineering, hands-on Python, PySpark, SQL, Databricks, Snowflake, experience with cloud platforms, ability to travel, U.S. work authorization required.
Python, PySpark, SQL, Databricks, Snowflake, Linux, AWS, GCP, Azure, R
3w
Save
Mark Applied
Hide
Sr. Software Engineer - PySpark
Scottsdale or San Francisco or Chicago or New York City
$118k-$152k/yr HybridFull Time
Early Warning Services
Early Warning Services: Operates payment and risk solutions for the financial industry.
5+ YOEBachelor's-level education typical; minimum 5 years software engineering experience; strong with Git, Spring/Spring Boot, SQL, REST, Docker/Kubernetes, Kafka, automated testing and DevOps practices.
Git, Git flow, Spring, Spring Boot, SQL, Confluence, CI/CD, Docker, Kubernetes, Kafka, Hadoop, Hive, XML, JSON, YAML, Redis, HBASE, AeroSpike, REST
1mo
Save
Mark Applied
Hide
Lead Software Engineer- Python / Pyspark / Java / BigData / Data Modernization / AI
Jersey City, New Jersey, United States
$152k-$215k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience delivering AI-first analytics and data engineering at scale; strong Python/PySpark/Java skills; big-data platform and governance expertise; experience with Databricks, Spark, Snowflake, Iceberg, CI/CD and ML/LLM pipelines.
Python, PySpark, Java, Spark, Databricks, Snowflake, Iceberg
4d
Save
Mark Applied
Hide
Lead Software Engineer
New York City or Glendale
$163k-$219k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces media content and operates global theme parks.
7+ YOE7+ years in backend development and AI/data applications; Python, Spark/PySpark, scalable APIs, distributed systems, AI/ML, foundation models, cloud deployments, GitHub, Docker, and AWS/EKS experience.
FastAPI, Flask, Spark, PySpark, Python, Claude, GPT-4, OpenAI, Qwen, LangChain, LangGraph, PyTorch, TensorFlow, Cursor, Claude Code, GitHub, Docker, AWS, EKS, Datadog, Grafana, Conviva, Pandas, Databricks, Snowflake
2d
Save
Mark Applied
Hide
Senior Forward Deployment Engineer
New York City or San Francisco or Princeton
RemoteFull Time
Quantiphi
Quantiphi: Provides applied AI research and data engineering services.
9+ YOERequires 9+ years of software engineering experience, expertise in full-stack development, data architecture, React, JavaScript/TypeScript, Python, FastAPI, PostgreSQL, Redis, PySpark, AWS, and technical leadership.
React, JavaScript, TypeScript, Python, FastAPI, PostgreSQL, RDS, Aurora, Redis, PySpark, Kestra, AWS, EKS, Kubernetes, GitHub Copilot, Cursor, LLM
1w
Save
Mark Applied
Hide
Databricks Senior Developer
New York City, New York, United States
OnsiteFull Time
CRISIL
CRISILNational Stock Exchange (NSE) / Bombay Stock Exchange (BSE): CRISIL: Global provider of credit ratings, research, and analytics services.
5+ YOERequires 5–7 years of data engineering experience, 3+ years with Databricks in production, cloud migration expertise, and proficiency in Python, PySpark, SQL, Azure, CI/CD, and orchestration tools.
Databricks, Python, PySpark, SQL, Spark SQL, Azure, CI/CD, Databricks Workflows, Airflow, dbt
2mo
Save
Mark Applied
Hide
Lead Software Engineer - Parametric
New York, New York, United States
$115k-$225k/yr HybridFull Time
Morgan Stanley
Morgan StanleyNYSE: MS: Global financial services firm providing investment and wealth management.
8+ YOE8+ years software engineering; Bachelor’s in CS or related; expert Python; 5+ years cloud-native AWS development; experience with distributed, event-driven systems, Apache Kafka, PySpark, data modeling, Terraform, Snowflake, and leading engineering teams.
Python, Apache Kafka, PySpark, AWS Lambda, AWS Batch, AWS Glue, Amazon Athena, Amazon S3, Amazon DynamoDB, AWS Step Functions, Terraform, Snowflake, C#, .NET, SQL, NoSQL, CI/CD, Serverless, AI/GenAI, Agile, Scrum
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Pricing & Promotions Analytics
New York City, New York, United States
$111k-$222k/yr HybridFull Time
CVS Health
CVS HealthNYSE: CVS: Provides retail pharmacy, health insurance, and pharmacy benefit management services.
3+ YOE3+ years software development experience building cloud-based customer-facing analytic solutions; experience with Palantir Foundry or similar, Python/PySpark, SQL, LLM modeling, cloud platforms (Azure/GCP/AWS); BA/BS required; strong communication and collaboration skills.
Palantir Foundry, Workshop, Pipeline Builder, TypeScript, Python, PySpark, SQL, LLM, Azure, GCP, AWS
3mo
Save
Mark Applied
Hide
Principal Backend Engineer
New York, New York, United States
$135k-$217k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
10+ YOE10+ years backend or distributed systems experience; expert Python backend; Databricks/PySpark; AWS serverless; multi-tenant SaaS design; leadership without people management.
Python, SQL, Databricks, PySpark, AWS, API Design, DynamoDB, S3, Lambda, IAM, CloudFormation, SAM
1mo
Save
Mark Applied
Hide
Staff Software Engineer - DSM
Spain or Brazil or Stockholm or London or New York City or New Orleans or Singapore or Tokyo or Sydney
RemoteFull Time
Cint
CintNasdaq Stockholm: CINT: Operates a digital platform for programmatic market research surveys.
10+ YOE10+ years backend engineering experience; strong algorithms and architecture knowledge; experience with high-throughput, low-latency systems; familiarity with Java, Python/PySpark, Spark, Kafka, Docker, SQL/NoSQL.
Java, Python, PySpark, Spark, Delta Lake, Parquet, Kafka, Avro, Docker, SQL, NoSQL, REST APIs, Pandas, Spring, AWS, GCP
4d
Save
Mark Applied
Hide
Senior Databricks Developer – Data Engineering & GenAI
Mississauga or Toronto or Teaneck or North America
$11k-$125k/yr HybridFull Time
Cognizant
CognizantNasdaq: CTSH: Provides IT consulting and digital business process services.
8+ YOEBachelor's degree and 8+ years in data engineering and analytics. Requires Databricks, Python, PySpark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Databricks CLI, Amazon S3, and cloud data platform expertise.
Databricks, Python, PySpark, SQL, Delta Lake, Unity Catalog, Databricks Workflows, Databricks CLI, Amazon S3
2mo
Save
Mark Applied
Hide
Lead Software Engineer - Parametric
New York, New York, United States
$115k-$225k/yr HybridFull Time
Morgan Stanley
Morgan StanleyNYSE: MS: Provides global investment banking, wealth management, and advisory services.
8+ YOE8+ years software engineering experience, Bachelor’s in CS or related, expert Python, 5+ years cloud-native AWS (Lambda, Step Functions, Batch, S3, Athena, Glue), Kafka, SQL/NoSQL, PySpark, Terraform, Snowflake, leadership and Agile experience.
Python, Apache Kafka, PySpark, AWS Lambda, AWS Step Functions, AWS Batch, S3, AWS Athena, AWS Glue, DynamoDB, Terraform, Snowflake, SQL, C#, .NET, CI/CD, AI/GenAI
3w
Save
Mark Applied
Hide
Data Engineer
New York, New York, United States
$72k-$97k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Design Lakehouse architectures on Databricks, develop PySpark jobs, implement governance with Unity Catalog, work with Airflow and CI/CD; strong data governance and streaming knowledge.
Databricks, Pyspark, CI/CD, Airflow, Unity Catalog, Databricks Apps, Delta Sharing
2mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins