HiringCafe
Save Job
Posted 4mo ago

Software Data Engineer / Apache Airflow

@ Gigatec
View All Jobs
Annapolis Junction, Maryland, United States
OnsitePart Time
Responsibilities:Build pipelines, Orchestrate workflows, Monitor pipelines
Requirements Summary:Build Apache Airflow pipelines; Python/Java software; Bash scripting; Linux CLI; Spark; Docker; Git; AWS; Airflow; TS clearance required.
Technical Tools Mentioned:Linux, Bash, Python, Java, Apache Airflow, Apache Spark, Docker, containerd, Podman, Git, AWS
Save
Mark Applied
Hide Job
Report & Hide
Job Description

Perks and Benefits

  • 100% Paid Healthcare
  • 10% 401k in every paycheck
  • 100% Fully Vested!

NOTE – Our positions require a Top Secret clearance, as well as the favorable completion of a polygraph. Applicants must be authorized to work in the U.S. We are unable to sponsor an employment Visa.


What You’ll Be Doing (We don’t love the bullet points, but we love the work!)

In this key SW Data Engineering role, you'll get to build the workflow engines behind the curtain, designing reliable Apache Airflow pipelines that keep data moving cleanly, efficiently, and on schedule for analytics and operational needs.

Required Skills

  • Experience using the Linux CLI and Linux tools
  • Experience developing Bash scripts to automate manual processes
  • Recent software development experience using Python and Java
  • Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
  • Experience using Distributed Big Data processing engines including Apache Spark
  • Experience with containerization technologies such as Docker, containerd, and Podman
  • Experience with Git Source Control System


Desired Skills

  • Experience using the Atlassian Tool Suite (JIRA, Confluence)
  • Familiar with AWS Cloud Services and Infrastructure
  • Appreciates a sense of humor and the occasional well-timed joke. 😄