330 spark data engineer jobs at 138 companies in Frederick, MD
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Absolute Business Solutions Corp: Provides technology and intelligence services to the US government.
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
SZNS Solutions: Provides specialized Google Cloud engineering and AI consulting services.
5+ YOEBachelor’s in CS/Engineering or equivalent; 5+ years data engineering in cloud; SQL and Python/Rust/Java; data pipelines (Kafka, Flink, Beam, Spark); data stores for AI; Google Cloud certs; US citizen.
Axle Informatics: Provides bioscience and IT solutions for biomedical research.
Bachelor's in CS/data-related field or equivalent experience; proven data engineering experience with Python, SQL, ETL/ELT, Spark/PySpark, data modeling, data quality, and Git; familiarity with cloud data platforms and biomedical data is a plus.
ManTech: Provides technology solutions for defense and intelligence agencies.
7+ YOE7+ years data engineering experience; expertise in distributed processing (Spark), ETL/ELT, SQL and Python; Azure ecosystem experience; data governance and preparing data for AI/ML; TS/SCI clearance required.
Applied Information Sciences: Delivers cloud transformation and software engineering services to organizations.
5+ YOEBachelor's in CS (or related), 5+ years data engineering, strong Python (pandas, pandera), SQL/Postgres, Databricks, Spark, experience with messy/disparate data, schema design and data validation, working with large workflows, active Secret Clearance.
Booz Allen HamiltonNYSE: BAH: Consulting and technology services for government and commercial clients
5+ YOEBachelor's degree, 5+ years professional experience (3+ years in enterprise data engineering); Secret clearance required. Experience with Palantir Foundry, Databricks (Delta Lake, Spark), ETL/ELT, and GitLab CI/CD.
Palantir Foundry, Databricks, Delta Lake, Spark, GitLab, CI/CD, UNIX, Linux, Shell scripting, AWS, Microsoft Azure, Google Cloud, Hadoop, Hive, AWS EMR, Kafka, MongoDB, Cassandra, AWS Redshift, MySQL, Snowflake
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yrRemoteFull Time
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Accenture Federal ServicesNYSE: ACN: Provides technology and consulting services to U.S. federal agencies.
7+ YOE5-10+ years experience in data engineering, ETL, cloud/on-prem processing, Python/SQL/Spark, ElasticSearch/NiFi, Agile/Scrum; Active TS/SCI with Poly clearance.
MastercardNYSE: MA: Global payment processing and financial technology service provider.
Senior-level data engineering experience with strong SQL and RDBMS skills (Microsoft SQL Server), ETL and data pipeline design, data modeling, Databricks/Spark familiarity preferred; bachelor's in a quantitative field or equivalent experience; authorized to work in the U.S. without sponsorship.
SQL, Microsoft SQL Server, Databricks, Spark, GitHub Copilot
Sand Technologies: Develops industrial AI and digital twin solutions for enterprise operations.
3+ YOE3+ years building and operating large-scale cloud or hybrid data platforms; strong Python and SQL skills; experience with Spark/Kafka, cloud (AWS/Azure/GCP), data governance, observability, and ML enablement.
ICFNASDAQ: ICFI: Provides strategic consulting and technology services to global organizations.
5+ YOE5+ years in data engineering with Databricks expertise, Bachelor’s degree, U.S. citizenship, ability to obtain Public Trust clearance, Databricks certification preferred, strong Python/SQL/Spark skills.
Databricks, Delta Lake, Delta Sharing, Azure, SQL, Python, Spark, Tableau, Git, Jira, Jenkins, CodeBuild, Confluence, SharePoint, Mural, Miro, Synapse, Data Factory, Power BI, Terraform, Scala
Total Wine & More: Large independent retailer of wine, spirits, and beer.
3+ YOEBachelor's preferred, 3+ years data engineering experience; expert SQL, Python, Spark/PySpark; experience with cloud data platforms, streaming (Kafka, Pub/Sub), ELT/ETL, observability, CI/CD, Git, dbt, and Great Expectations.
SQL, Python, Spark, PySpark, Airflow, BigQuery, Microsoft Fabric, Snowflake, Databricks, Delta Lake, Parquet, Kafka, Pub/Sub, Git, Great Expectations, dbt, Power BI, CI/CD
Booz Allen HamiltonNYSE: BAH: Provides technology and management consulting services to diverse organizations.
SQL, Java, or Python and Spark; highly structured data; data modeling; Bachelor's degree; TS/SCI clearance with polygraph; experience with data pipelines and big data platforms.
Washington or Arlington or Austin or Atlanta or United States
RemoteFull Time
VetsEZ: Digital transformation and healthcare IT services for government agencies.
4+ YOEBachelor's degree, 4+ years data engineering experience; proficiency with Python, Spark, SQL, ETL, Azure Synapse, Azure Data Factory, Power BI, GitHub, and Jira; experience with federal healthcare/VA programs and ability to obtain Public Trust.
Azure Synapse, Azure Data Factory, Power BI, Python, Spark, SQL, GitHub, Microsoft Word, Microsoft Excel, Microsoft PowerPoint, Microsoft Visio, Jira, CX Insights, Lighthouse APIs, Medallia, Azure
Unissant: Delivers data analytics and cybersecurity services to government agencies.
3+ YOE3+ years data engineering experience, ETL/ELT pipeline design, batch and streaming (Kafka, Spark), cloud data platforms (AWS/GCP/Azure), SQL/Python/R, Databricks/OBIEE/UiPath familiarity, and ability to obtain/maintain ICE clearance.
eSimplicity: Provides digital and data services to federal government agencies.
5+ YOE5+ years data engineering experience building AWS ETL pipelines using Glue, Spark/PySpark, Lambda and S3; strong Python and SQL skills; ability to obtain Moderate Risk Public Trust clearance.
GRVTY: Develops defense technology, cyber, and intelligence software solutions.
5+ YOEActive TS/SCI+Poly,5+ years data engineering experience,STEM degree required,ETL on large unstructured datasets,Kafka,Spark,Prefect,Docker,Kubernetes,CI/CD,Linux and DevOps familiarity.
ECSNYSE: ASGN: Provides advanced technology and engineering services to government agencies.
3+ YOEUS citizen able to obtain Public Trust; Bachelor's in STEM required; 3+ years data engineering or related experience; working knowledge of Python and/or SQL; familiarity with Airflow, Spark, or AWS Glue; strong communication skills.
Apache Airflow, AWS Glue, Apache Spark, Kafka, Python, SQL, SharePoint, Confluence, GitLab, AWS, Microsoft Azure, Google Cloud Platform (GCP)
JTEC Consulting: A veteran-owned technology solutions provider.
5+ YOE5+ years in data engineering, ADVANA platform experience, ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL; US citizenship; current Secret clearance; 2-3 days/week on-site; DoD environment.