2,391 pyspark jobs at 900 companies in United States
2d
Save
Mark Applied
Hide
2d
Pyspark Architect
Jersey City or Plano
$96k-$125k/yrOnsiteFull Time
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience in enterprise/solution architecture, PySpark and Hadoop ecosystem, cloud and integration technologies, ETL design, strong communication; bachelor\u0002s or equivalent required; authorized to work in the US without sponsorship.
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years experience building scalable data pipelines with PySpark/Spark, Hive/SQL, cloud big-data tools, Python, and data modeling; strong performance tuning and ETL/ELT skills.
Virtusa: Global provider of digital engineering and IT outsourcing services.
Design, build and deploy big data solutions using Spark, Hive, Hadoop and UNIX; follow SDLC and best practices; strong analytical, problem-solving and communication skills.
Virtusa: Digital engineering and IT business transformation services provider.
Experience designing, building, and deploying big data solutions using Spark, Hive/HiveQL, Hadoop and UNIX; strong analytical, communication and problem-solving skills.
Big Data/PySpark Engineering Lead - Vice President
Tampa, Florida, United States
$114k-$171k/yrOnsiteFull Time
CitiNYSE: C: Global diversified financial services holding.
6+ YOE6+ years data engineering experience in financial services; strong Python,Spark,SQL skills; experience migrating legacy ETL to modern data lakehouse; leadership and stakeholder management.
Big Data/PySpark Engineering Lead - Vice President
Tampa, Florida, United States
$114k-$171k/yrOnsiteFull Time
CitiNYSE: C: Providing global banking, investment, and wealth management services.
6+ YOE6+ years in financial services applications development or data engineering; expert Python and Spark; experience with big data ecosystems, ETL/ELT migrations, SQL, Unix, and stakeholder leadership.
KPMG: Global professional services network providing audit, tax, and advisory.
5+ YOE5+ MgmtMaster's in CS/Statistics/Data Science or related; 5+ years leading data & analytics teams; hands-on experience with Python, PySpark, SQL, Databricks, Snowflake, MLOps; strong communication and problem-solving.
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOE1+ MgmtLead software engineer with 4+ years of software engineering experience and 1+ year cloud experience (AWS/Azure/GCP); proficient in Python, PySpark, JavaScript, TypeScript, SQL, Java, and Go; strong leadership and collaboration skills.
Lentech: Provides mission-critical IT and engineering solutions for government agencies.
7+ YOEActive TS/SCI with FSP through MD, 7 years software development experience, strong analytics background, experience with Pig and PySpark, Bachelor\u0002s in CS (or 4 additional years SWE experience), familiarity with Python/Java/Scala.
Captivation Software: Provides specialized software engineering for the intelligence and defense communities.
14+ YOETop Secret/SCI with favorable polygraph and U.S. citizenship required; 14 years SWE experience; Bachelor’s in CS or related (or 4 years substitute); proficiency in Python, PySpark, and AWS.
RTXNYSE: RTX: RTX provides advanced aerospace and defense systems and services.
U.S. citizenship and Puerto Rico residency required. Strong Python and PySpark experience, advanced SQL, production Apache Spark experience, cloud data platform experience (AWS/Azure/GCP), Snowflake/Big Query/Redshift/Synapse familiarity, and proficiency with Git and Docker.
Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Brooklyn Park, Minnesota, United States
$132k-$238k/yrHybridFull Time
TargetNYSE: TGT: Operates a chain of general merchandise stores and supermarkets.
7+ YOE7+ years data engineering experience with Hadoop/Spark, PySpark, Scala/Java, cloud data services, API and streaming architectures; strong problem solving and leadership skills.
Software Engineer Principal - Data and Automation (Sagemaker, AWS CDK, Infrastructure as Code (IaC), Python, Pyspark)
Pittsburgh or Farmers Branch
OnsiteFull Time
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEExperience with AWS services (SageMaker, Bedrock, EMR, Lake Formation, DataZone), Infrastructure as Code (AWS CDK or Terraform), Python and PySpark; bachelor's degree and 5+ years industry experience preferred.
SageMaker, Bedrock, EMR, Lake Formation, DataZone, AWS CDK, Terraform, Python, PySpark, Amazon SageMaker, Amazon Web Services (AWS), Apache Spark
Orion Innovation: Provides digital transformation, software engineering, and cloud services.
8+ YOE8+ years in application support or technical lead roles; hands-on Azure, Databricks, PySpark/Pyspark, T-SQL/TSQL, Python, and large-scale data platform troubleshooting experience; strong communication skills.
Azure, Databricks, TSQL, Data Warehousing, Pyspark, Python, SQL Database, PySpark, T SQL, SQL Server, MSBI, Azure Data Factory (ADF), ADLS, Parquet, Delta, CSV, Power BI, Alteryx, Excel, SSIS, ABAP, UNIX