2,391 pyspark jobs at 900 companies in United States

2d
Save
Mark Applied
Hide
Pyspark Architect
Jersey City or Plano
$96k-$125k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience in enterprise/solution architecture, PySpark and Hadoop ecosystem, cloud and integration technologies, ETL design, strong communication; bachelor\u0002s or equivalent required; authorized to work in the US without sponsorship.
PySpark, Cloudera, Hadoop, Hive, Scala, Spark, Sqoop, Flume, Kafka, Python, NoSQL, REST APIs, JSON, XML, AWS, Azure, GCP, Databricks, Snowflake, Starburst
2w
Save
Mark Applied
Hide
Pyspark Developer
Irving, Texas, United States
$100k-$130k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years experience building scalable data pipelines with PySpark/Spark, Hive/SQL, cloud big-data tools, Python, and data modeling; strong performance tuning and ETL/ELT skills.
Apache Spark, PySpark, Hive, Amazon Web Services (AWS), EMR, Glue, Microsoft Azure, Databricks, Synapse, Google Cloud Platform (GCP), Spark UI, Apache Airflow, Parquet, ORC, Avro, Python, HiveQL, ANSI SQL, Git, Jenkins, Ansible, HBase, Cassandra, MongoDB
1w
Save
Mark Applied
Hide
BigData PySpark Consultant
Tampa, Florida, United States
OnsiteFull Time
Virtusa
Virtusa: Global provider of digital engineering and IT outsourcing services.
Design, build and deploy big data solutions using Spark, Hive, Hadoop and UNIX; follow SDLC and best practices; strong analytical, problem-solving and communication skills.
Bigdata, HIVE, UNIX, Spark SQL, Hadoop, Spark, HiveQL
1w
Save
Mark Applied
Hide
BigData PySpark Consultant
Tampa, Florida, United States
$90k-$105k/yr OnsiteFull Time
Virtusa
Virtusa: Digital engineering and IT business transformation services provider.
Experience designing, building, and deploying big data solutions using Spark, Hive/HiveQL, Hadoop and UNIX; strong analytical, communication and problem-solving skills.
Bigdata, HIVE, UNIX, Spark SQL, Hadoop, Spark, HiveQL
5d
Save
Mark Applied
Hide
Big Data/PySpark Engineering Lead - Vice President
Tampa, Florida, United States
$114k-$171k/yr OnsiteFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
6+ YOE6+ years data engineering experience in financial services; strong Python,Spark,SQL skills; experience migrating legacy ETL to modern data lakehouse; leadership and stakeholder management.
Spark, Flink, Kafka, Python, Starburst, Trino, Spark SQL, SQL, Avro, Parquet, Iceberg, Hadoop, YARN, Hive, Impala, Unix, Bitbucket, Git, Presto, MongoDB, HBase, Collibra, Informatica
5d
Save
Mark Applied
Hide
Big Data/PySpark Engineering Lead - Vice President
Tampa, Florida, United States
$114k-$171k/yr OnsiteFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOE6+ years in financial services applications development or data engineering; expert Python and Spark; experience with big data ecosystems, ETL/ELT migrations, SQL, Unix, and stakeholder leadership.
Spark, Flink, Kafka, Python, SQL, Starburst, Trino, Hadoop, YARN, Hive, Impala, Spark SQL, Avro, Parquet, Iceberg, Bitbucket, Git, MongoDB, HBase, Presto, Collibra, Informatica, Unix, Shell scripting
2d
Save
Mark Applied
Hide
Manager, Data Engineer - PySpark
Dallas, Texas, United States
OnsiteFull Time
KPMG
KPMG: Global professional services network providing audit, tax, and advisory.
5+ YOE5+ MgmtMaster's in CS/Statistics/Data Science or related; 5+ years leading data & analytics teams; hands-on experience with Python, PySpark, SQL, Databricks, Snowflake, MLOps; strong communication and problem-solving.
Python, PySpark, SQL, Databricks, Snowflake, R, Linux, AWS, GCP, Azure
2mo
Save
Mark Applied
Hide
Software Engineer III-ETL/PySpark
Wilmington, Delaware, United States
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
3+ YOE3+ years in data engineering with Python, SQL; experience with PySpark, AWS, Snowflake; SDLC, CI/CD, and data tooling expertise.
Python, SQL, PySpark, AWS, Snowflake, Ab Initio, Teradata, Airflow, DBT
2mo
Save
Mark Applied
Hide
Lead Software Engineer - Python + PySpark
Richmond or McLean or Cambridge
$179k-$225k/yr HybridFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOE1+ MgmtLead software engineer with 4+ years of software engineering experience and 1+ year cloud experience (AWS/Azure/GCP); proficient in Python, PySpark, JavaScript, TypeScript, SQL, Java, and Go; strong leadership and collaboration skills.
Python, PySpark, JavaScript, TypeScript, SQL, Java, Go, Docker, Kubernetes, AWS, Azure, GCP, HTML/CSS, Open Source RDBMS, NoSQL
1mo
Save
Mark Applied
Hide
Mid Software Developer (Pig/Pyspark)
Linthicum, Maryland, United States
$137k-$147k/yr OnsiteFull Time
Lentech
Lentech: Provides mission-critical IT and engineering solutions for government agencies.
7+ YOEActive TS/SCI with FSP through MD, 7 years software development experience, strong analytics background, experience with Pig and PySpark, Bachelor\u0002s in CS (or 4 additional years SWE experience), familiarity with Python/Java/Scala.
Pig, PySpark, Python, Java, Scala, NiFi, Ansible
1w
Save
Mark Applied
Hide
Software Engineer 2 - Python/PySpark/AWS
Annapolis Junction, Maryland, United States
$130k-$270k/yr OnsiteFull Time
Captivation Software
Captivation Software: Provides specialized software engineering for the intelligence and defense communities.
14+ YOETop Secret/SCI with favorable polygraph and U.S. citizenship required; 14 years SWE experience; Bachelor’s in CS or related (or 4 years substitute); proficiency in Python, PySpark, and AWS.
Python, PySpark, AWS Lambda, AWS Glue, DynamoDB
3w
Save
Mark Applied
Hide
Data Engineer (Python/PySpark) (Puerto Rico)
Santa Isabel or Aguadilla
HybridFull Time
RTX
RTXNYSE: RTX: RTX provides advanced aerospace and defense systems and services.
U.S. citizenship and Puerto Rico residency required. Strong Python and PySpark experience, advanced SQL, production Apache Spark experience, cloud data platform experience (AWS/Azure/GCP), Snowflake/Big Query/Redshift/Synapse familiarity, and proficiency with Git and Docker.
Python, PySpark, Apache Spark, Delta Lake, Iceberg, Hudi, Apache Airflow, Fast API, Flask, EMR, Glue, Databricks, AWS, Azure, GCP, Snowflake, Big Query, Redshift, Synapse, Git, Docker, Apache Kafka, PySpark MLlib, SQL, Spark SQL
3mo
Save
Mark Applied
Hide
Senior Algorithm Developer - PySpark / SQL (Durham, NC, US)
Durham, North Carolina, United States
OnsiteFull Time
ACA Group
ACA Group: Regulatory compliance and risk management solutions for financial services.
5+ YOE3+ years PySpark/Python in production; 5+ years SQL; Spark ecosystem; AWS; CI/CD; Git/JIRA; agile teams.
PySpark, Python, SQL, Apache Spark, AWS, Git, JIRA, CI/CD, Iceberg, EMR, S3, CloudWatch
1w
Save
Mark Applied
Hide
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yr HybridFull Time
Target
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Hadoop, Spark, PySpark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, REST, GraphQL, gRPC, Kafka, Flink, Kinesis
2mo
Save
Mark Applied
Hide
Data Engineer Consultant-Azure Databricks, SQL, Pyspark
United States
HybridFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
7+ YOE7+ years in Azure-based data engineering; Databricks/Spark; SQL; Python/Scala; Power BI or similar; cloud security and governance.
Azure Data Factory, Azure Data Lake, Azure Synapse, Azure Databricks, Apache Spark, Scala, Python, SQL, Power BI
1mo
Save
Mark Applied
Hide
Software Engineer Principal - Data and Automation (Sagemaker, AWS CDK, Infrastructure as Code (IaC), Python, Pyspark)
Pittsburgh or Farmers Branch
OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEExperience with AWS services (SageMaker, Bedrock, EMR, Lake Formation, DataZone), Infrastructure as Code (AWS CDK or Terraform), Python and PySpark; bachelor's degree and 5+ years industry experience preferred.
SageMaker, Bedrock, EMR, Lake Formation, DataZone, AWS CDK, Terraform, Python, PySpark, Amazon SageMaker, Amazon Web Services (AWS), Apache Spark
1mo
Save
Mark Applied
Hide
Application Architect
Montvale, New Jersey, United States
OnsiteFull Time
Orion Innovation
Orion Innovation: Provides digital transformation, software engineering, and cloud services.
8+ YOE8+ years in application support or technical lead roles; hands-on Azure, Databricks, PySpark/Pyspark, T-SQL/TSQL, Python, and large-scale data platform troubleshooting experience; strong communication skills.
Azure, Databricks, TSQL, Data Warehousing, Pyspark, Python, SQL Database, PySpark, T SQL, SQL Server, MSBI, Azure Data Factory (ADF), ADLS, Parquet, Delta, CSV, Power BI, Alteryx, Excel, SSIS, ABAP, UNIX
2mo
Save
Mark Applied
Hide
Research Scientist
Carlsbad, California, United States
OnsiteFull Time
NTENT
NTENT: Develops semantic search and natural language processing technology platforms.
3+ YOEPhD preferred; 3+ years in NLP/ML; Python or R; Spark/PySpark; strong communication.
Python, R, Spark, PySpark
2mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
Englewood or Denver
$117k-$158k/yr OnsiteFull Time
EchoStar
EchoStarNasdaq: SATS: Global provider of satellite solutions and wireless communications services.
5+ YOEDatabricks AI enablement, Python/PySpark, Unity Catalog governance, cloud security, FinOps, and cross‑functional collaboration.
Databricks, Delta Lake, Unity Catalog, Python, PySpark, Terraform, GitLab, Genie, Mosaic AI
2mo
Save
Mark Applied
Hide
Resident Solutions Architect - Spark & Databricks Expert
United States
RemoteFull Time
Koantek
Koantek: Systems integrator delivering Databricks-powered data and AI solutions.
5+ YOE5–10 years data engineering or analytics delivery; Spark/Databricks expertise; PySpark; DBSQL; Delta Lake.
Apache Spark, Databricks, PySpark, Databricks SQL, Delta Lake, Structured Streaming, Delta Live Tables, Unity Catalog