Target
Posted 1mo ago

Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)

Target
Brooklyn Park, Minnesota, United States
$132k-$238k/yrHybridFull Time
Responsibilities
  • architecting pipelines
  • optimizing performance
  • mentoring engineers
Requirements
  • 7+ years data engineering experience
  • BS/MS preferred
  • Expertise with Hadoop/Spark
  • PySpark/Scala/Java
  • Cloud platforms (AWS/GCP/Azure), APIs
  • Streaming (Kafka/Flink/Kinesis), and data modeling
Technical tools mentioned
HadoopSparkScalaJavaPySparkAWSGCPAzureS3BigQueryDatabricksEMRSnowflakeRESTGraphQLgRPCKafkaFlinkKinesis

Job description


Job Id: R0000444860

The pay range is $132,000.00 - $238,000.00

Pay is based on several factors which vary based on position. These include labor markets and in some instances may include education, work experience and certifications. In addition to your pay, Target cares about and invests in you as a team member, so that you can take care of yourself and your family. Target offers eligible team members and their dependents comprehensive health benefits and programs, which may include medical, vision, dental, life insurance and more, to help you and your family take care of your whole selves. Other benefits for eligible team members include 401(k), employee discount, short term disability, long term disability, paid sick leave, paid national holidays, and paid vacation. Find competitive benefits from financial and education to well-being and beyond at https://corporate.target.com/careers/benefits.

JOIN TARGET AS A LEAD DATA ENGINEER – FINANCE TECHNOLOGY SOLUTIONS

About Us:

Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture. Learn more about Target here.

About the Team:
Finance Technology within Core Retail Services powers the financial backbone of Target's enterprise operations. We build and support platforms that enable critical business capabilities across Accounts Payable, Accounts Receivable, Vendor Income, Treasury, Financial Planning, Core Accounting, Revenue & Receivables, and Enterprise Financial Controls. Our financial reporting platform brings these data domains together to deliver near real-time insights, enabling accurate financial reporting and faster, data-driven decision-making. Join our global in-house technology team of more than 5,000 engineers, data scientists, architects, and product managers who are striving to make Target the most convenient, safe, and joyful place to shop. We use agile practices and leverage open-source technologies to build best-in-class solutions for our team members and guests.

About the Role:
As a Lead Data Engineer, you will serve as the technical lead for the engineering team, designing and developing scalable, high-performance data solutions. You will drive the evolution of our data architecture, ensuring it meets both functional and non-functional business requirements while delivering reliability, efficiency, and scalability. Your expertise in big data technologies, distributed systems, and cloud platforms will help shape the engineering roadmap and establish best practices for data processing, analytics, and real-time data services. You will play a key role in architecting and optimizing data pipelines using Hadoop, Spark, Scala/Java, and cloud technologies to support enterprise-wide data initiatives.

Key Responsibilities

  • Architect and build scalable, high-performance data pipelines and distributed data processing solutions using Spark, Scala/Java and cloud platforms (AWS, GCP, or Azure)
  • Design and implement real-time and batch data processing solutions, ensuring data is efficiently processed and readily available for analytical and operational use
  • Develop APIs and data services that provide low-latency, high-throughput access to data for downstream applications, enabling real-time decision-making
  • Optimize and enhance data models, workflows, and processing frameworks to improve performance, scalability, and cost efficiency
  • Drive data governance, security, and compliance best practices
  • Collaborate with product teams and business stakeholders to understand requirements and deliver data-driven solutions
  • Lead the design, implementation, and lifecycle management of data services and platforms
  • Stay current with emerging technologies and promote the adoption of best practices in big data engineering, cloud computing, and API development
  • Provide technical leadership and mentor engineers to foster engineering excellence and best practices

Core responsibilities of this job are articulated within this job description. Job duties may change at any time due to business needs.

About You

  • BS or MS in Computer Science, Machine Learning, Artificial Intelligence, Applied Mathematics or a related technical field preferred
  • 7plus years of experience in data engineering, software development, or distributed systems
  • Expertise in Big Data technologies such as Hadoop, Spark, and distributed processing frameworks
  • Strong programming skills in PySpark, Scala, and/or Java
  • Experience with cloud platforms (AWS, GCP, or Azure) and associated data services (e.g. S3, BigQuery, Databricks, EMR, Snowflake)
  • Proficiency in API development using REST, GraphQL, or gRPC to support real-time and batch data access
  • Experience with real-time and streaming data architectures like Kafka, Flink or Kinesis
  • Strong knowledge of data modeling, ETL pipeline design and performance optimization
  • Understanding of data governance, security, and compliance in large-scale data environments
  • Strong problem-solving skills and the ability to thrive in complex, evolving environments
  • Excellent communication and collaboration skills, with experience working across cross-functional teams

This position will operate as a Hybrid/Flex for Your Day work arrangement based on Target’s needs. A Hybrid/Flex for Your Day work arrangement means the team member’s core role will need to be performed both onsite at the Target HQ MN location the role is assigned to and virtually, depending upon what your role, team and tasks require for that day. Work duties cannot be performed outside of the country of the primary work location, unless otherwise prescribed by Target. Click here if you are curious to learn more about Minnesota.

Benefits Eligibility

Please paste this url into your preferred browser to learn about benefits eligibility for this role: https://tgt.biz/BenefitsForYou_E

Americans with Disabilities Act (ADA)

In compliance with state and federal laws, Target will make reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to [email protected]. Non-accommodation-related requests, such as application follow-ups or technical issues, will not be addressed through this channel.  

Application deadline is : 08/20/2026


About Target

General merchandise retailer operating physical stores and e-commerce.

Year founded
1902
Employees
415000
Organization type
Public
Headquarters
US

Similar jobs

Data Engineer roles near Brooklyn Park, Minnesota
3h
Save
Mark Applied
Hide
Senior Data Engineer
Eden Prairie or United States
$92k-$164k/yr RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
5+ YOEBachelor's degree or 5+ years' data engineering experience; 5+ years building ETL/ELT and data systems; 4+ years with Azure, Data Factory, Databricks, Spark, and Scala/Python; 2+ years with healthcare data.
Microsoft Azure, Azure Data Factory, Databricks, Apache Spark, Scala, Python, SQL, PL/SQL, T-SQL, Informatica, DataStage, Terraform, Snowflake, DevOps, CI/CD, GitHub, GitHub Actions, RAG, LLM, Generative AI
3d
Save
Mark Applied
Hide
Data Engineer
Blaine or Plano or Teaneck
$65k/yr HybridFull Time
Cognizant
CognizantNasdaq: CTSH: Provides IT consulting and digital business process services.
Requires a bachelor's degree, Python and SQL programming, analytical and communication skills, and familiarity with orchestration, cloud, data architecture, containers, and CI/CD tools.
Python, SQL, Spark, AWS, Azure, GCP, Airflow, Prefect, Snowflake, Databricks, BigQuery, Docker, Kubernetes, GitHub, ETL, ELT, CI/CD
4d
Save
Mark Applied
Hide
Sr. Data Engineer, EDM
Minnetonka, Minnesota, United States
$100k-$172k/yr HybridFull Time
Medica
Medica: Provides health insurance coverage and health plan administration services.
7+ YOEBachelor's degree or equivalent experience, 7+ years of experience, advanced SQL, ETL/ELT pipelines, data modeling, complex datasets, and strong troubleshooting and communication skills.
Snowflake, SQL, dbt, Python, CI/CD
5d
Save
Mark Applied
Hide
Google Senior Data Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
5+ YOERequires 5+ years in data engineering, analytics, or ML; 4+ years with GCP; 5+ years with SQL and pipelines; 3+ years with Python or AI tools; and a bachelor's degree or equivalent.
Google Cloud Platform (GCP), BigQuery, Looker, Vertex AI, Gemini Foundation Models, Gemini Enterprise, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Looker Studio, Model APIs, Embeddings, Dataplex, IAM, SQL, Python, Git
5d
Save
Mark Applied
Hide
Data Engineer
Saint Paul, Minnesota, United States
$92k-$128k/yr HybridFull Time
Trane Technologies
Trane TechnologiesNYSE: TT: Global provider of heating, ventilation, and air conditioning solutions.
6+ YOEBachelor's degree in computer science, computer engineering, or equivalent; 6+ years in data or database engineering; strong NoSQL, cloud-native, Python, SQL, distributed systems, and data pipeline experience.
NoSQL, SQL, Python, AWS DynamoDB, BigQuery, Bigtable, AWS, GCP, Microsoft SQL Server, CI/CD, MLOps
6d
Save
Mark Applied
Hide
Data Engineer II - Snowflake, dbt, AWS
Hartford or Saint Paul or Richardson
$127k-$209k/yr HybridFull Time
Travelers
TravelersNew York Stock Exchange: TRV: Provider of commercial and personal property casualty insurance.
8+ YOEBachelor’s degree in computer science or STEM, eight years of related experience, Snowflake, SQL, dbt, data warehousing, pipelines, migration, integration, data mapping, and strong communication skills.
Snowflake, SQL, dbt
6d
Save
Mark Applied
Hide
Google Senior Data Engineer
Albany or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego or United States
$80k-$266k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOERequires 5+ years in data engineering, analytics, or ML; 4+ years on GCP; 5+ years with SQL, modeling, and pipelines; 3+ years with Python or AI tools; bachelor's degree or equivalent.
Google Cloud Platform (GCP), BigQuery, Looker, Vertex AI, Gemini Foundation Models, Gemini Enterprise, Model APIs, Embeddings, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Looker Studio, Dataplex, IAM, SQL, Python, CI/CD, Git, RAG
6d
Save
Mark Applied
Hide
Branch Operations Data Engineer
Irving or Hopkins or Cincinnati or United States
$93k-$109k/yr OnsiteFull Time
U.S. Bank
U.S. BankNYSE: USB: Provider of personal, business, and institutional financial services.
4+ YOEBachelor's degree in a related field or equivalent experience, plus 4–5 years of statistical or data analytics experience; requires advanced analytics, predictive modeling, communication, and project management skills.
E-Verify