205 pyspark data engineer jobs at 104 companies in Frederick, MD

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
3d
Save
Mark Applied
Hide
Lead Data Engineer (Python, PySpark, AWS)
McLean or Richmond
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years application development experience, 2+ years big data experience, 1+ year cloud experience (AWS/Azure/GCP); preferred: extensive Python, SQL, Scala/Java, distributed data and cloud tooling.
Python, PySpark, Java, Scala, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud
1mo
Save
Mark Applied
Hide
Data Engineer
Rockville, Maryland, United States
OnsiteFull Time
Axle Informatics
Axle Informatics: Provides bioscience and IT solutions for biomedical research.
Bachelor's in CS/data-related field or equivalent experience; proven data engineering experience with Python, SQL, ETL/ELT, Spark/PySpark, data modeling, data quality, and Git; familiarity with cloud data platforms and biomedical data is a plus.
Python, SQL, Spark, PySpark, Git, Snowflake, Databricks, Posit Connect, R/Shiny, Streamlit, Jupyter, Galaxy, Code Ocean, S3, Postgres, APIs
1w
Save
Mark Applied
Hide
Data Engineer
Springfield or Fairfax
$110k-$165k/yr HybridFull Time
ECS
ECSNYSE: ASGN: Provides advanced technology and engineering services to government agencies.
2+ YOEUS citizen able to obtain TS/SCI, Bachelor’s in a related field, 2+ years data engineering experience, advanced proficiency with Python,Pyspark and/or SQL, data parsing, ETL, and database principles.
Python, Pyspark, SQL, Databricks, Amazon Web Services, Microsoft Azure
1w
Save
Mark Applied
Hide
Data Engineer
Fort Meade, Maryland, United States
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years in data engineering; experience with Maven Smart System (MSS); TS/SCI clearance; bachelor’s degree.
Python, PySpark, SQL, Databricks, Maven Smart System (MSS), Advana, Qlik, DAVE
1w
Save
Mark Applied
Hide
Data Engineer
Fort Meade, Maryland, United States
$78k-$176k/yr OnsiteFull Time
Booz Allen Hamilton
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
4+ YOE4+ years with Python, PySpark, SQL, Databricks; 2+ years data engineering; experience with Maven Smart System (MSS); TS/SCI clearance and bachelor’s degree required; strong data integration and pipeline development skills.
Python, PySpark, SQL, Databricks, Maven Smart System (MSS), Advana, Qlik, Defense Acquisition Visibility Environment (DAVE)
2mo
Save
Mark Applied
Hide
Data Engineer - Databricks
McLean, Virginia, United States
OnsiteFull Time
Steampunk
Steampunk: Design-led federal technology consulting and innovation services firm.
3+ YOE2-4 years data engineering experience; strong Databricks, SQL, PySpark/Python; AWS; ability to hold public trust; experience with data pipelines and data lakes.
Databricks, SQL, PySpark, Python, AWS, Delta Lake, Airflow, S3, EC2
1mo
Save
Mark Applied
Hide
Data Engineer
Springfield, Virginia, United States
$60k-$180k/yr OnsiteFull Time
M9 Solutions
M9 Solutions: Provides IT modernization and technology services to federal agencies.
10+ YOEActive TS/SCI clearance; BS/MS in CS/Engineering or related field; 10+ years in data engineering or software development; strong Python (pandas, PySpark, FastAPI); cloud experience (AWS/Azure); Kafka, Airflow; database internals; data governance and AI/ML integration.
Python, Pandas, PySpark, FastAPI, AWS, Azure, Kafka, Airflow, PostgreSQL, MySQL, ElasticSearch, DynamoDB, Redis, S3, Lambda, Glue, Step Functions, Redshift, BigQuery, Kubernetes, Docker
3w
Save
Mark Applied
Hide
Data Engineer
Fairfax or United States
$130k-$135k/yr RemoteFull Time
Bixal
Bixal: Provides digital transformation and consulting services for government agencies.
5+ YOEBachelor's degree, 5+ years data engineering experience, expertise with PySpark/Databricks/AWS/Kafka, Python and SQL proficiency, Terraform and Git familiarity, ability to obtain Public Trust clearance.
PySpark, Databricks Intelligence Platform, AWS, S3, IAM, Kafka, Delta Share, Terraform, Python, Git, Linux, SQL, Apache Hive, Apache Hadoop, Apache Spark, QuickSight, Power BI
2w
Save
Mark Applied
Hide
Data Engineer
Columbia, Maryland, United States
$93k-$136k/yr HybridFull Time
eSimplicity
eSimplicity: Provides digital and data services to federal government agencies.
5+ YOE5+ years data engineering experience building AWS ETL pipelines using Glue, Spark/PySpark, Lambda and S3; strong Python and SQL skills; ability to obtain Moderate Risk Public Trust clearance.
AWS Glue, PySpark, Python, Lambda, EMR, Amazon Managed Workflows for Apache Airflow (MWAA), S3, Parquet, ORC, Iceberg, PostgreSQL, Redshift, Oracle, SNS, XML, JSON, CSV, Avro, Git, GitHub, Amazon Bedrock, OpenSearch, CloudFormation, Airflow, SQL
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
Samsara
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
1mo
Save
Mark Applied
Hide
Data Engineer – Senior
Hyattsville or Landover
$140k-$180k/yr RemoteFull Time
BDR Solutions
BDR Solutions: Provider of IT, engineering, and consulting for federal agencies.
8+ YOEActive MBI and U.S. citizenship required; 8+ years cloud data engineering; 3–5 years Databricks; current Databricks Data Engineer and AWS certifications; proficiency with Python, PySpark, SQL, Databricks, and AWS services; bachelor’s degree required.
Databricks, Unity Catalog, Delta Live Tables, Auto Loader, Genie, Delta Lake, Python, PySpark, SQL, S3, IAM, VPC, CloudWatch, Glue, Athena, AWS Lake Formation, Terraform, GitHub Actions, Microsoft Azure DevOps, Kafka, MSK, dbt, Great Expectations, Splunk, Datadog, Collibra, Alation, RBAC, ABAC
2mo
Save
Mark Applied
Hide
Data Engineer
Chantilly, Virginia, United States
OnsiteFull Time
GRVTY
GRVTY: Develops defense technology, cyber, and intelligence software solutions.
Active TS/SCI with Polygraph; strong SQL, Python, PySpark; AWS; Linux; ETL; data ingestion/transform; quick learner; good communicator.
SQL, Python, PySpark, AWS, Linux, APIs, Geospatial tools, ETL
5d
Save
Mark Applied
Hide
Mid Data Engineer
Reston, Virginia, United States
$130k-$155k/yr RemoteFull Time
Forge Group
Forge Group: Provides professional consulting and IT solutions for federal agencies.
4+ YOEU.S. citizen with 4+ years data engineering experience, advanced Python, AWS Lambda, PySpark, ETL/ELT, data modeling, CI/CD, Git, and ability to obtain CompTIA Security+ and pass Tier 2 background investigation.
Python, AWS, AWS Lambda, PySpark, MariaDB, PostgreSQL, Git, Appian, Palantir Foundry, CI/CD, SQL, REST API
1d
Save
Mark Applied
Hide
Senior Data Engineer - Databricks
McLean, Virginia, United States
$140k-$180k/yr OnsiteFull Time
Steampunk
Steampunk: Federal digital transformation and consulting services provider.
5+ YOE5+ years data engineering experience with Databricks, SQL, PySpark/Python, and AWS; ability to architect and migrate data platforms, work in Agile/SDLC, and hold public trust.
Databricks, SQL, PySpark, Python, AWS, Apache Spark, Delta Lake, T-SQL, pgSQL, MySQL, Databricks Workflows, Airflow, Step Functions, S3, EC2, RDS, Java, C++, Scala, Apache Iceberg, CI/CD, Informatica EDC, Unity Catalog, Collibra, Alation, Purview, DataZone
4w
Save
Mark Applied
Hide
Sr. Data Engineer
Bethesda, Maryland, United States
$122k-$165k/yr OnsiteFull Time
Total Wine & More
Total Wine & More: Large independent retailer of wine, spirits, and beer.
3+ YOEBachelor's preferred, 3+ years data engineering experience; expert SQL, Python, Spark/PySpark; experience with cloud data platforms, streaming (Kafka, Pub/Sub), ELT/ETL, observability, CI/CD, Git, dbt, and Great Expectations.
SQL, Python, Spark, PySpark, Airflow, BigQuery, Microsoft Fabric, Snowflake, Databricks, Delta Lake, Parquet, Kafka, Pub/Sub, Git, Great Expectations, dbt, Power BI, CI/CD
2mo
Save
Mark Applied
Hide
Senior Data Engineer
Washington, District of Columbia, United States
$120k-$199k/yr OnsiteFull Time
The Washington Post
The Washington Post: Provides daily newspaper publishing and digital news reporting services.
3+ YOESenior Data Engineer with 3+ years in ETL/ELT, data modeling, and SQL; strong Python, PySpark, and AWS data lakehouse experience; knowledge of data pipelines, AI/ML tooling, and collaboration with cross-functional teams.
Python, PySpark, Spark, Flink, AWS, Redshift, Athena, EMR, Glue, Pub/Sub, Airflow, Iceberg, Postgres, MySQL, DynamoDB, Tableau, Superset, Google Ad Manager
2mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
Crystal City or Aberdeen
$101k-$175k/yr HybridFull Time
LMI
LMI: Delivers management, technology, and analytics solutions for federal agencies.
5+ YOE5–8 years in data engineering; Python, SQL, PySpark; Army Vantage/Palantir Foundry; DoD Secret Clearance; experience with Army data sources.
Python, SQL, PySpark, Palantir Foundry
2w
Save
Mark Applied
Hide
Senior Data Engineer
Washington, District of Columbia, United States
OnsiteFull Time
Analytica
Analytica: Provides data analytics and IT solutions for federal government agencies.
8+ YOE8+ years data engineering experience, 3+ years supporting CMS/federal healthcare, Databricks and cloud (AWS/Azure) expertise, strong Spark/PySpark/Python/SQL, DataOps and CI/CD experience, healthcare compliance knowledge.
Databricks Lakehouse Platform, Databricks, Apache Spark, PySpark, SQL, Python, AWS, Azure, Git, Delta Lake, Unity Catalog, Collibra, Informatica
1w
Save
Mark Applied
Hide
Data Engineer
McLean, Virginia, United States
$130k-$145k/yr OnsiteFull Time
Edgesource Corporation
Edgesource Corporation: Providing mission-ready national security and IT solutions.
5+ YOE5+ years experience building production data pipelines, advanced Python, Spark/PySpark, EMR/DB tuning, workflow orchestration, containerization, AWS, SQL and Git; active TS/SCI Full Scope Polygraph required.
Python, Java, Apache Spark, PySpark, Pandas, NumPy, Step Functions, Airflow, Docker, Podman, AWS, S3, Lambda, MySQL, PostgreSQL, SQL, Git, Bash, Apache Ranger, Trino, Unity Catalog OSS, Apache Polaris, Apache Superset, Terraform, CloudFormation, DynamoDB, Open lineage
2mo
Save
Mark Applied
Hide
Data Engineer (Vantage) - Clearance Required
Crystal City or Aberdeen
$101k-$175k/yr HybridFull Time
LMI
LMI: Provides management consulting and digital solutions to federal government agencies.
5+ YOE5–8 years in Data Engineering; Python, SQL, PySpark; Army Vantage/Palantir Foundry; DoD Secret Clearance; minimal travel.
Python, SQL, PySpark, Palantir Foundry, Advana