DRW
Posted 2mo ago

Equities Data Engineer

DRW
Chicago or New York City
$175k-$200k/yrOnsiteFull Time
Responsibilities
  • onboarding data
  • building pipelines
  • ensuring quality
Requirements
  • 5+ years designing ingestion pipelines for batch and real-time market data
  • Experience with equities/futures data
  • Data quality frameworks
  • Observability
  • On-prem Linux and cloud
  • CI/CD and MLOps
  • Parquet/Iceberg familiarity
Technical tools mentioned
ParquetIcebergLinuxCI/CDMLOps

Job description

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.

Headquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets. We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets.

We operate with respect, curiosity and open minds. The people who thrive here share our belief that it’s not just what we do that matters–it's how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.

We are seeking an Equities Data Engineer to join the MASS (Multi-asset Systematic Strategies) trading team. In this role, you will be responsible for onboarding, transforming, and managing diverse financial datasets. You will collaborate closely with traders, researchers, and quantitative developers to analyze equity and futures data, identify alphas, and develop global delta-one trading strategies.

Key Responsibilities:

  • Partner with traders, researchers, and analysts to deliver well-structured data that powers trading strategies, predictive models, and AI/ML applications.
  • Build, automate, and maintain resilient pipelines for cleaning, validating, and transforming batch and streaming data that feed into medallion architectures.
  • Develop observability, monitoring, and alerting tools to provide complete visibility into pipeline reliability and performance.
  • Optimize tiered data storage and elastic processing across on-prem, cloud, and hybrid environments to ensure scalable and cost-effective solutions.
  • Enforce data governance, controls, and security standards to preserve confidentiality and operational integrity.
  • Implement data quality frameworks (validation, reconciliation, anomaly detection) to detect gaps, staleness, and corporate action/market data inconsistencies.
  • Maintain point-in-time correctness across datasets used for research and live trading; ensure reproducibility of signals and backtests.
  • Collaborate with platform/infrastructure teams to productionize pipelines, improve runtime efficiency, and meet latency and availability requirements.

Qualifications:

  • Over five years of demonstrated experience designing ingestion pipelines.
  • Familiarity with equities, equity indices, futures, or delta one trading data preferred.
  • Experience processing real-time and batch financial market data.
  • Proven ability to work in an agile, fast-paced environment and handle trading environment demands.
  • Strong understanding of financial point-in-time and time-series data and analysis.
  • Proven expertise in developing data quality control processes to detect gaps or inaccuracies.
  • Experience with monitoring, observability, and alerting systems for data pipelines.
  • Competent in both on-premise Linux systems and cloud platforms.
  • Proficient in automated testing, CI/CD practices, and MLOps.
  • Well-versed in compressed and optimized file formats such as Parquet and Iceberg.

The annual base salary range for this position is $175,000 to $200,000 depending on the candidate’s experience, qualifications, and relevant skill set. The position is also eligible for an annual discretionary bonus. In addition, DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance, 401k (with discretionary employer match), short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts.

For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at https://drw.com/privacy-notice.

California residents, please review the California Privacy Notice for information about certain legal rights at https://drw.com/california-privacy-notice.

#LI-GV1

About DRW

Global proprietary trading firm investing across diverse asset classes.

Similar jobs

Data Engineer roles near Chicago, Illinois
8h
Save
Mark Applied
Hide
Derived Data Engineer
Chicago or New York City
$200k-$250k/yr OnsiteFull Time
Jump Trading
Jump Trading: Privately held proprietary trading firm using research and technology to trade global financial markets.
7+ YOERequires 7+ years of software engineering experience, 5+ years working with derived data, Python, Rust, C++, market-data analytics, Linux, testing, and strong communication skills.
Python, Rust, C++, Linux
15h
Save
Mark Applied
Hide
Data Engineer
Chicago or Peoria
$89k-$145k/yr OnsiteFull Time
Caterpillar Inc.
Caterpillar Inc.NYSE: CAT: Global manufacturer of construction and mining equipment and engines.
Software development experience, Python and OOP knowledge, Git, CI/CD, AWS, database experience, testing skills, strong learning ability, and cross-functional communication skills.
Python, Git, Jenkins, GitHub Actions, Azure DevOps, AWS Lambda, DynamoDB, AWS Fargate, Amazon S3, Amazon SageMaker, AWS IAM, Amazon RDS, PostgreSQL, MongoDB, Oracle
1d
Save
Mark Applied
Hide
Data Engineer
Peoria or Chicago
$89k-$145k/yr OnsiteFull Time
Caterpillar Inc.
Caterpillar Inc.NYSE: CAT: Global manufacturer of construction and mining equipment and engines.
Experience with Python software development, OOP, Git, CI/CD, AWS, relational or NoSQL databases, software testing, and cross-functional collaboration.
Python, Git, Jenkins, GitHub Actions, Azure DevOps, AWS Lambda, DynamoDB, AWS Fargate, Amazon S3, Amazon SageMaker, AWS IAM, Amazon RDS, PostgreSQL, MongoDB, Oracle
1d
Save
Mark Applied
Hide
Senior Data Engineer, gTech Risk
Chicago, Illinois, United States
$156k-$226k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOG, GOOGL: Global technology specializing in internet-related services and products.
5+ YOEBachelor's degree or equivalent practical experience; 5 years designing data pipelines and dimensional data models; Python or R, SQL, and data visualization experience required.
Flume, Dataflow, Apache Spark, Python, R, SQL, Tableau, Looker
1d
Save
Mark Applied
Hide
Data Engineer, Transplant/DOS
Chicago, Illinois, United States
$45-$67/hr HybridFull Time
Northwestern Medicine
Northwestern Medicine: Academic healthcare system providing comprehensive medical services.
5+ YOEBachelor's degree or four additional years of experience; 5+ years querying, analyzing, modeling, or architecting data; advanced SQL, ETL, data warehousing, Python, visualization, and Agile experience.
SQL, Microsoft SSIS, Azure Data Factory, OLAP, Microsoft Power BI, Tableau, Crystal Reports, SSRS, Python, R, Epic Clarity, AI
2d
Save
Mark Applied
Hide
Senior Lead Data Engineer
Chicago, Illinois, United States
$209k-$239k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
6+ YOEBachelor's degree and 6+ years of application development, 2+ years of big data, and 1+ year of cloud computing experience required; leadership and distributed data experience required for preferred qualifications.
Java, Scala, Python, Open Source RDBMS, NoSQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, SQL, Agile
2d
Save
Mark Applied
Hide
Senior Lead Data Engineer
Chicago, Illinois, United States
$209k-$239k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
6+ YOEBachelor's degree, 6+ years of application development, 2+ years of big data technologies, and 1+ year of cloud computing experience required; leadership and advanced data engineering experience preferred.
Java, Scala, Python, Open Source RDBMS, NoSQL, Redshift, Snowflake, AWS, Microsoft Azure, Google Cloud, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, Agile
2d
Save
Mark Applied
Hide
Senior Lead Data Engineer
Chicago, Illinois, United States
$209k-$239k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
6+ YOEBachelor's degree, 6+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing required; leadership and advanced data engineering experience preferred.
Java, Scala, Python, SQL, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX/Linux, AWS, Microsoft Azure, Google Cloud, RDBMS, NoSQL