214 pyspark data engineer jobs at 107 companies in Triangle, VA
3w
Save
Mark Applied
Hide
3w
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development experience, 2+ years big data experience, 1+ year cloud experience (AWS/Azure/GCP); preferred: extensive Python, SQL, Scala/Java, distributed data and cloud tooling.
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
3+ YOEBachelor’s degree and 3+ years with PySpark, SQL, and Azure Databricks; data engineering, analytics, technical collaboration, public health data, and Public Trust eligibility required.
Axle Informatics: Provides bioscience and IT solutions for biomedical research.
Bachelor's in CS/data-related field or equivalent experience; proven data engineering experience with Python, SQL, ETL/ELT, Spark/PySpark, data modeling, data quality, and Git; familiarity with cloud data platforms and biomedical data is a plus.
ECSNYSE: ASGN: Provides advanced technology and engineering services to government agencies.
2+ YOEUS citizen able to obtain TS/SCI, Bachelor’s in a related field, 2+ years data engineering experience, advanced proficiency with Python,Pyspark and/or SQL, data parsing, ETL, and database principles.
Python, Pyspark, SQL, Databricks, Amazon Web Services, Microsoft Azure
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yrHybridFull Time
Beghou Consulting: Strategic consulting and data analytics for life sciences companies.
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Navy Federal Credit Union: Offers banking and financial services to the military community.
5+ YOEBachelor's in CS/Engineering/Information Systems, 5+ years data engineering, strong SQL, xml/JSON, SSIS, Microsoft Azure (Synapse, Data Factory, Databricks), PySpark, ETL, scripting, query optimization, Azure DevOps, SQL Server, and Power BI familiarity.
SQL, xml/JSON, SSIS, Microsoft Azure Synapse, Microsoft Azure Data Factory, Databricks, PySpark, Microsoft Azure DevOps (ADO), SQL Server, Microsoft Power BI
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years data engineering; experience with Maven Smart System (MSS); TS/SCI clearance and bachelor’s degree required; strong data integration and pipeline development skills.
M9 Solutions: Provides IT modernization and technology services to federal agencies.
10+ YOEActive TS/SCI clearance; BS/MS in CS/Engineering or related field; 10+ years in data engineering or software development; strong Python (pandas, PySpark, FastAPI); cloud experience (AWS/Azure); Kafka, Airflow; database internals; data governance and AI/ML integration.
Bixal: Provides digital transformation and consulting services for government agencies.
5+ YOEBachelor's degree, 5+ years data engineering experience, expertise with PySpark/Databricks/AWS/Kafka, Python and SQL proficiency, Terraform and Git familiarity, ability to obtain Public Trust clearance.
United States or Minnetonka or Minneapolis or Washington
$73k-$130k/yrRemoteFull Time
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
3+ YOE3+ years data engineering experience; strong SQL, Python, and PySpark skills; 1+ year with Azure/Databricks; experience with streaming, ETL, CDC, data quality and Medallion architecture.
Azure, Azure Data Factory, Databricks, Databricks Delta Live Tables, Delta Lake, Parquet, PySpark, Spark, Spark Structured Streaming, Spark Declarative Lakeflow Pipelines, Kafka, Azure Event Hubs, Great Expectations, SQL, Python
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yrRemoteFull Time
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
EagleBankNASDAQ: EGBN: Provides personalized commercial and consumer banking and lending services.
2+ YOEMaster's in information systems or related, 2+ years as Data Engineer, experience with Python, SQL, Snowflake, AWS services, CI/CD (GitLab), PySpark, and SnowPro certification.
BDR Solutions: Provider of IT, engineering, and consulting for federal agencies.
8+ YOEActive MBI and U.S. citizenship required; 8+ years cloud data engineering; 3–5 years Databricks; current Databricks Data Engineer and AWS certifications; proficiency with Python, PySpark, SQL, Databricks, and AWS services; bachelor’s degree required.
Databricks, Unity Catalog, Delta Live Tables, Auto Loader, Genie, Delta Lake, Python, PySpark, SQL, S3, IAM, VPC, CloudWatch, Glue, Athena, AWS Lake Formation, Terraform, GitHub Actions, Microsoft Azure DevOps, Kafka, MSK, dbt, Great Expectations, Splunk, Datadog, Collibra, Alation, RBAC, ABAC
Bespoke Technologies: Provides technical engineering and data solutions for national security.
4+ YOEActive TS or TS/SCI clearance required,4+ years data engineering experience,proficiency with Python,SQL,Spark/PySpark,ETL development,cloud data platforms (AWS/Azure),Databricks;Terraform and data quality tooling experience preferred.
Steampunk: Provides digital transformation and IT consulting for federal agencies.
2+ YOEAbility to obtain Public Trust,2+ years data engineering experience,Databricks,SQL,PySpark/Python,AWS experience,ETL/pipeline migration,agile and CI/CD experience.
Forge Group: Provides professional consulting and IT solutions for federal agencies.
4+ YOEU.S. citizen with 4+ years data engineering experience, advanced Python, AWS Lambda, PySpark, ETL/ELT, data modeling, CI/CD, Git, and ability to obtain CompTIA Security+ and pass Tier 2 background investigation.
Acuity: Provides digital strategy and technology consulting for federal agencies.
5+ YOE5+ years data engineering experience building scalable ETL/ELT pipelines, cloud data solutions on AWS/Databricks, PySpark/Spark, Delta Lake, and strong data quality and governance practices.
540: Builds mission-critical software and cloud systems for government agencies.
9+ YOE9+ years data engineering experience; Databricks, Python, SQL, PySpark, Apache Spark, Delta Lake; cloud experience (AWS/Azure/GCP); US citizen with active DoW Secret clearance required.
The Washington Post: Provides daily newspaper publishing and digital news reporting services.
3+ YOESenior Data Engineer with 3+ years in ETL/ELT, data modeling, and SQL; strong Python, PySpark, and AWS data lakehouse experience; knowledge of data pipelines, AI/ML tooling, and collaboration with cross-functional teams.
Python, PySpark, Spark, Flink, AWS, Redshift, Athena, EMR, Glue, Pub/Sub, Airflow, Iceberg, Postgres, MySQL, DynamoDB, Tableau, Superset, Google Ad Manager