Infinitive
Posted 2y ago

Data Engineer (Databricks Experience)

Infinitive
McLean, Virginia, United States
OnsiteFull Time
Responsibilities
  • design pipelines
  • build pipelines
  • model data
Requirements
  • Senior Data Engineer with Databricks
  • DevOps (Jenkins
  • Terraform), and data modeling (3NF
  • Dimensional
  • Data Vault) experience
Technical tools mentioned
DatabricksJenkinsTerraformSQLPythonScalaAWSAzureGoogle Cloud Platform

Job description

*Candidates must be local to the Washington D.C. metro area. 

About Infinitive:

Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.

Infinitive has been named “Best Small Firms to Work For” by Consulting Magazine 8 times most recently in 2025. Infinitive has also been named a Washington Post “Top Workplace”, Washington Business Journal “Best Places to Work”, and Virginia Business “Best Places to Work.”


About the Role:
We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with expertise in Databricks, DevOps tools (Jenkins/Terraform), and data modeling concepts (3NF, Dimensional, Data Vault). As a Senior Data Engineer, you will play a critical role in designing, implementing, and maintaining our client's data infrastructure while ensuring scalability, reliability, and efficiency.
 

Responsibilities:

  1. Data Engineering: Design, build, and maintain scalable data pipelines and ETL processes using Databricks and other relevant technologies.

  2. DevOps Integration: Implement continuous integration and continuous deployment (CI/CD) pipelines using Jenkins and Terraform to automate deployment, monitoring, and scaling of data infrastructure.

  3. Data Modeling: Develop and implement data models based on business requirements, including 3NF, Dimensional, and Data Vault models. Ensure data models adhere to best practices for efficiency, scalability, and maintainability.

  4. Performance Optimization: Identify and address performance bottlenecks in data pipelines and queries. Optimize data processing and storage to improve overall system performance.

  5. Data Quality Assurance: Implement data quality checks and monitoring processes to ensure data accuracy, completeness, and consistency.

  6. Collaboration: Work closely with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and deliver high-quality solutions.

  7. Documentation and Best Practices: Document data pipelines, infrastructure configurations, and data models. Define and enforce best practices for data engineering and DevOps processes.

  8. Training and Mentorship: Provide guidance and mentorship to junior team members. Conduct training sessions to promote knowledge sharing and skill development within the team.

Qualifications:

  • Bachelor’s degree in Computer Science, Engineering, or related field. Master’s degree preferred.
  • Proven experience as a Data Engineer, preferably in a cloud-based environment.
  • Strong proficiency in Databricks for data processing and analytics.
  • Hands-on experience with DevOps tools such as Jenkins and Terraform for infrastructure automation.
  • In-depth knowledge of data modeling concepts including 3NF, Dimensional, and Data Vault.
  • Proficiency in SQL and programming languages such as Python or Scala.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.


Applicants for employment in the U.S. must possess work authorization which does not require sponsorship by the employer for a visa.

Infinitive is an Equal Opportunity Employer.

About Infinitive

Consultancy for modernizing and monetizing enterprise data through AI.

Similar jobs

Data Engineer roles near McLean, Virginia
2d
Save
Mark Applied
Hide
Senior Data Engineer (AWS, Azure, GCP)
Reston, Virginia, United States
$90k-$200k/yr HybridFull Time
CapTech
CapTech: Provides technology and management consulting services to large enterprises.
5+ YOERequires 5+ years delivering cloud data engineering solutions, expertise in SQL and databases, programming, ETL/orchestration, cloud platforms, data warehousing, distributed systems, and technical leadership.
AWS, Azure, GCP, Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion, Snowflake, Redshift, Databricks, PostgreSQL, MySQL, SQL Server, Oracle, Aurora, Presto, BigQuery, SQL, NoSQL, Python, Java, R, C, C#, C++, Shell, Git, Jenkins, CI/CD, Jira
2d
Save
Mark Applied
Hide
Data Engineer
Fairfax or United States
$95k-$115k/yr RemoteFull Time, Contract
Bixal
Bixal: Provides digital transformation and consulting services for government agencies.
4+ YOEBachelor’s degree and 4+ years of data engineering experience with Python, PySpark, Databricks, AWS, SQL, Git, Terraform, Linux, data pipelines, and cross-functional engineering; must obtain Public Trust clearance.
PySpark, Databricks Intelligence Platform, AWS, Amazon S3, Apache Kafka, Terraform, Git, Linux, SQL, Apache Hive, Apache Hadoop, Apache Spark, QuickSight, Microsoft Power BI
3d
Save
Mark Applied
Hide
Data Engineer - Axion
Sunnyvale or Washington or San Diego or Fort Walton Beach or Ann Arbor or London or Stuttgart or Munich or Stockholm or Bangalore or Seoul or Tokyo
$200k-$275k/yr OnsiteFull Time
Applied Intuition
Applied Intuition: Developing software and simulation infrastructure for autonomous vehicles.
5+ YOERequires 5+ years of relevant experience, modern ML infrastructure, large-scale GPU jobs, data software, microservices or databases, U.S. citizenship, and eligibility for security clearance.
React, TypeScript, Python, Golang, Docker, Kubernetes, Opensearch, Postgres, LLMs, VLMs, GPU
3d
Save
Mark Applied
Hide
Senior Data Engineer - TS/SCI
Bethesda, Maryland, United States
$131k-$237k/yr HybridFull Time
Sunayu
Sunayu: Engineering technology and DevSecOps solutions for defense and intelligence missions.
10+ YOEBachelor's with 12–15 years or master's with 10–13 years of relevant experience; active TS/SCI and polygraph eligibility; expertise in Elasticsearch, graph databases, data pipelines, Kubernetes, Python or Java.
Elasticsearch, OpenSearch, JanusGraph, Neo4j, TigerGraph, Amazon Neptune, Memgraph, Kubernetes, Python, Java, Apache Kafka, Linux, Keycloak, CloudFormation, Terraform, Pulumi, Microsoft Excel
3d
Save
Mark Applied
Hide
Data Engineer
Bethesda, Maryland, United States
OnsiteFull Time
Analytica
Analytica: Provides data analytics and IT solutions for federal government agencies.
5+ YOEBachelor's degree in a quantitative field, 5+ years in data modeling, strategic data planning, governance, and enterprise data warehousing; ETL, SQL Server, communication skills, and ability to obtain Secret clearance required.
Microsoft SQL Server, Amazon Redshift, DBeaver, Microsoft Visual Studio, AWS Glue, AWS Lambda, Git, GitHub, CI/CD, ETL
3d
Save
Mark Applied
Hide
Senior Data Engineer
Ashburn, Virginia, United States
$104k-$173k/yr HybridFull Time
ManTech
ManTech: Provides technology solutions for defense and intelligence agencies.
12+ YOERequires extensive data engineering experience, including data warehousing, relational databases, ETL, cloud migration, communication, and problem-solving. U.S. citizenship and DHS CBP suitability required.
GitLab, Oracle, MySQL, Postgres, SQL Server, Extract-Transform-Load (ETL), Amazon Web Services (AWS), Microsoft Azure, Power BI, OBIEE, Hadoop, HDFS, YARN, Hive, Pig, Spark, Kafka, Storm, Jira, Confluence
4d
Save
Mark Applied
Hide
Data Engineer – Data Architecture for Data Science & Machine Learning
State College or Reston
$122k-$266k/yr OnsiteFull Time
Penn State University
Penn State University: Provides higher education and conducts extensive academic research programs.
5+ YOERequires a bachelor's degree in engineering, science, computer science, data engineering, or related field; 5+ years of relevant experience; PostgreSQL, SQL, database architecture, scripting, cloud databases, and non-relational database expertise.
PostgreSQL, MongoDB, Neo4j, Redis, Cassandra, DynamoDB, AWS RDS, Aurora, GCP Cloud SQL, Azure Database, SQL, Python, Snowflake, Redshift, BigQuery, Feast, Airflow, dbt
4d
Save
Mark Applied
Hide
Lead Data Engineer
New York City or McLean or Richmond
$179k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor's degree; 4+ years application development, 2+ years big data, and 1+ year cloud computing experience. Preferred: Python, SQL, Scala, Java, distributed data, streaming, NoSQL, warehousing, Linux, and Agile.
Java, Scala, Python, SQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, shell scripting, Agile