2,007 pyspark developer jobs at 734 companies in United States

3w
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global leader in next-generation digital services and consulting.
Experience with PySpark and AWS Redshift; Databricks/Glue/Gen AI preferred. Bachelor's degree or equivalent (or relevant experience in lieu); ability to work US projects without employer sponsorship; relocation/travel possible.
PySpark, AWS Redshift, Databricks, Glue, Gen AI, AWS
4w
Save
Mark Applied
Hide
Senior PySpark Data Developer
Irving, Texas, United States
$100k-$125k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesBSE: 532540: Global leader in IT services, consulting, and business solutions.
6+ YOE6+ years experience designing and building scalable PySpark/Spark data pipelines, cloud big-data tooling, Hive/SQL, optimized storage formats, and performance tuning.
Apache Spark, PySpark, Hive, Spark SQL, Spark UI, Parquet, ORC, Avro, Python, HiveQL, ANSI SQL, Amazon Web Services (AWS), AWS EMR, AWS Glue, Microsoft Azure, Azure Databricks, Azure Synapse, Google Cloud Platform (GCP), Apache Airflow, Git, Jenkins, Ansible, HBase, Cassandra, MongoDB
1mo
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global financial services organization enabling growth and economic progress.
6+ YOEExpertise in PySpark and Hadoop ecosystem, complex SQL, data modeling, Autosys and shell scripting; 6+ years apps development or systems analysis experience; bachelor’s degree preferred.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
1mo
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global financial services organization enabling growth and economic progress.
6+ YOERequires 6–10 years of applications development or systems analysis experience, PySpark and Hadoop expertise, complex SQL, distributed systems, data modeling, shell scripting, Autosys, and a bachelor's degree or equivalent.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, shell scripting, Autosys, Apache Kafka
1mo
Save
Mark Applied
Hide
Big Data PySpark Lead Engineer - Vice President
Jersey City, New Jersey, United States
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Global financial services organization enabling growth and economic progress.
6+ YOEExpertise in PySpark and Hadoop ecosystem, strong SQL, data modeling, shell/Autosys automation, 6+ years apps development/systems analysis experience, bachelor’s degree or equivalent.
PySpark, Hive, HDFS, Sqoop, Spark, Impala, Scala, SQL, Autosys, Apache Kafka, Shell scripting
2mo
Save
Mark Applied
Hide
Mid Software Developer (Pig/Pyspark)
Linthicum, Maryland, United States
$137k-$147k/yr OnsiteFull Time
Lentech
Lentech: Employee-owned federal IT and mission-technical services contractor supporting civil, defense, and intelligence agencies.
7+ YOEActive TS/SCI with FSP through MD, 7 years software development experience, strong analytics background, experience with Pig and PySpark, Bachelor\u0002s in CS (or 4 additional years SWE experience), familiarity with Python/Java/Scala.
Pig, PySpark, Python, Java, Scala, NiFi, Ansible
1mo
Save
Mark Applied
Hide
Data Engineer - PySpark
Tampa or Irving
$60k-$135k/yr HybridFull Time
Wipro
WiproNYSE: WIT: Global information technology, consulting, and business process services.
5+ YOE5+ years experience with PySpark in Big Data environments, Hadoop ecosystem, shell scripting, Autosys, complex SQL, streaming platforms, data modeling, and strong analytical and communication skills.
PySpark, Hadoop, Hive, HDFS, Sqoop, Spark, Impala, Scala, Autosys, SQL
3w
Save
Mark Applied
Hide
Data Engineer (PySpark)
Tampa, Florida, United States
$80k-$90k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Global leader in consulting, digital transformation, and engineering services.
5+ YOERequires a bachelor's degree or equivalent, 5–8 years of relevant experience, systems analysis and programming expertise, project implementation experience, and advanced HDFS, Spark, Python, PySpark, SQL, and data-platform skills.
HDFS, YARN, MapReduce, Spark, Flink, Zookeeper, Spark Core, Spark SQL, Spark Streaming, Spark GraphX, Python, PySpark, Pandas, NumPy, SQL, HBase, Cassandra, MongoDB, RDBMS
1d
Save
Mark Applied
Hide
Software Engineer III-Python/PySpark
Wilmington, Delaware, United States
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services and investment banking firm.
2+ YOERequires software engineering training or certification, 2+ years of applied experience, Python/PySpark, Iceberg, AI, AWS, ETL, data lakes, system design, testing, automation, and continuous delivery experience.
Python, PySpark, Iceberg, AI, AWS, Data Pipeline, Airflow, Snowflake, Databricks, SQL, Java, CI/CD
2w
Save
Mark Applied
Hide
Hadoop and PySpark Data Engineer
Charlotte or Jacksonville or Jersey City or Newark or Plano or Delaware or Florida or New Jersey or North Carolina or Texas or United States
$82k-$127k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Global leader in next-generation digital services and consulting.
Bachelor's degree or equivalent experience; Hadoop, Hive, Spark, PySpark, Python, Unix shell scripting, SQL, data warehousing, orchestration tools, Agile, and production Big Data experience required.
Hadoop, PySpark, Cloudera, Hive, Spark, Python, Unix, Autosys, Airflow, SQL, Agile, Tableau, AI, cloud, containerization
2w
Save
Mark Applied
Hide
Platform Data Engineer - (DataBricks, PySpark, AWS)
West Chester, Pennsylvania, United States
OnsiteFull Time
Comcast
ComcastNASDAQ: CMCSA: A global media and technology.
5+ YOEBachelor's degree or equivalent experience, 5+ years in data engineering, and hands-on AWS, PySpark, and Databricks experience. Requires Python, ETL/ELT, distributed systems, Airflow, Kubernetes, and production support expertise.
Amazon Web Services (AWS), PySpark, Databricks, Kafka, Kubernetes, Apache Airflow, Managed Workflows for Apache Airflow (MWAA), Python, Snowflake, Amazon EKS (Elastic Kubernetes Service)
1mo
Save
Mark Applied
Hide
Sr. Software Engineer - PySpark
Scottsdale or San Francisco or Chicago or New York City
$118k-$152k/yr HybridFull Time
Early Warning Services
Early Warning Services: U.S. bank-owned fintech and consumer reporting agency providing identity, fraud-risk, and real-time payment solutions to financial institutions.
5+ YOEBachelor's-level education typical; minimum 5 years software engineering experience; strong with Git, Spring/Spring Boot, SQL, REST, Docker/Kubernetes, Kafka, automated testing and DevOps practices.
Git, Git flow, Spring, Spring Boot, SQL, Confluence, CI/CD, Docker, Kubernetes, Kafka, Hadoop, Hive, XML, JSON, YAML, Redis, HBASE, AeroSpike, REST
3w
Save
Mark Applied
Hide
Software Engineer 2 - Python/PySpark/AWS
Annapolis Junction, Maryland, United States
$130k-$270k/yr OnsiteFull Time
Captivation Software
Captivation Software: Software engineering creating innovative software solutions for the Armed Forces and Intelligence Community.
14+ YOERequires 14 years of software engineering experience, a bachelor's degree in computer science or related field, or approved experience substitution, plus Top Secret/SCI clearance and favorable polygraph.
Python, PySpark, AWS, AWS Lambda, AWS Glue, Amazon DynamoDB
1mo
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; preferred Python, SQL, Scala, Java, AWS, and distributed data tools.
Python, PySpark, AWS, Java, Scala, RDBMS, NoSQL, Redshift, Snowflake, machine learning, distributed microservices, SQL, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, Agile
1mo
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years application development experience, 2+ years big data experience, 1+ year cloud experience (AWS/Azure/GCP); preferred: extensive Python, SQL, Scala/Java, distributed data and cloud tooling.
Python, PySpark, Java, Scala, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: An American general merchandise retailer.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
1mo
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: An American general merchandise retailer.
7+ YOE7+ years data engineering experience; BS/MS preferred; expertise with Hadoop/Spark, PySpark/Scala/Java, cloud platforms (AWS/GCP/Azure), APIs, streaming (Kafka/Flink/Kinesis), and data modeling.
Hadoop, Spark, Scala, Java, PySpark, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
2mo
Save
Mark Applied
Hide
Software Engineer Principal - Data and Automation (Sagemaker, AWS CDK, Infrastructure as Code (IaC), Python, Pyspark)
Pittsburgh or Farmers Branch
OnsiteFull Time
PNC Financial Services Group
PNC Financial Services GroupNYSE: PNC: Diversified financial services providing banking and investment solutions.
5+ YOEExperience with AWS services (SageMaker, Bedrock, EMR, Lake Formation, DataZone), Infrastructure as Code (AWS CDK or Terraform), Python and PySpark; bachelor's degree and 5+ years industry experience preferred.
SageMaker, Bedrock, EMR, Lake Formation, DataZone, AWS CDK, Terraform, Python, PySpark, Amazon SageMaker, Amazon Web Services (AWS), Apache Spark
1w
Save
Mark Applied
Hide
Sr. Developer
United States
HybridFull Time
Cognizant
CognizantNASDAQ: CTSH: Global professional services providing technology and consulting services.
12+ YOERequires 12+ years in data engineering, analytics, or development; advanced Python and PySpark; extensive Databricks experience; GenAI, cloud storage, Amazon S3, and Databricks CLI expertise.
Databricks, Delta Lake, Databricks SQL, Python, Delta Live Pipelines, Unity Catalog, PySpark, Amazon S3, AI BI Genie, AgentBricks, Mosaic AI, Databricks Workflows, Databricks CLI
1w
Save
Mark Applied
Hide
Sr. Developer
United States
HybridFull Time
Cognizant
CognizantNASDAQ: CTSH: Global professional services providing technology and consulting services.
12+ YOERequires 12+ years in data engineering, analytics, or development; advanced Python and PySpark; extensive Databricks expertise; GenAI knowledge; Amazon S3 integration; and Databricks CLI automation experience.
Databricks, Delta Lake, Databricks SQL, Python, Delta Live Pipelines, Unity Catalog, PySpark, Amazon S3, AI BI Genie, AgentBricks, Mosaic AI, Databricks Workflows, CLI, Databricks CLI