IBM
Posted 2w ago

Data Engineer-Data Platforms-Databricks

IBM
Pune or Bengaluru
HybridFull Time
Responsibilities
  • implementing usecases
  • enhancing platform
  • supporting clients
Requirements
  • Databricks platform expertise
  • Data engineering and cloud experience
  • Implement Data and AI use cases
  • Bachelor's degree required
  • Master's preferred
Technical tools mentioned
DatabricksRed HatIBM Cloud

Job description

In this role, you'll work in one of our IBM Consulting FutureNow Centers, where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your role and responsibilities

As a Data Engineer specializing in Data Platforms-Databricks, you will play a critical role in building and enhancing the Databricks platform for client's Data and AI use cases. This role involves implementing Data and AI use cases on the Databricks platform, requiring strong technical expertise and collaboration. Your primary responsibilities will include: • Implement Data and AI use cases: Implement data and AI use cases on the Databricks platform, ensuring seamless integration and optimal performance. • Enhance Databricks Platform: Build and enhance the Databricks platform to meet client needs, leveraging expertise in data engineering and cloud technologies. • Support Client Use Cases: Collaborate with clients to understand their data and AI requirements, providing technical expertise to implement use cases on the Databricks platform.

ABOUT BUSINESS UNIT

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

YOUR LIFE @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

ABOUT IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

ABOUT IBM

IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

OTHER RELEVANT JOB DETAILS

When applying to jobs of your interest, we recommend that you do so for those that match your experience and expertise. Our recruiters advise that you apply to not more than 3 roles in a year for the best candidate experience. For additional information about location requirements, please discuss with the recruiter following submission of your application.

About IBM

Global technology providing enterprise software, cloud, and consulting.

Similar jobs

Data Engineer roles near Pune, Maharashtra
6h
Save
Mark Applied
Hide
Senior Associate - Data / AI
Pune, Maharashtra, India
HybridFull Time
Davies
Davies: Insurance claims management and legal professional services provider.
3+ YOE3+ MgmtBachelor's degree in computer science or related field; 3–5 years managing BI or data teams; experience building data pipelines and architectures with ADF; strong communication and process improvement skills.
Microsoft Azure Data Factory, Microsoft Fabric, SQL Server, Power BI
6h
Save
Mark Applied
Hide
Apprentice - Data Engineer
Pune or United States or India or Poland
HybridFull Time, Internship
StoneX Group
StoneX GroupNASDAQ: SNEX: Provides global financial services and market access.
Completing a bachelor's degree in computer science, engineering, mathematics, or related field by July/August 2027; available for a full-time six-month apprenticeship; familiarity with Python, SQL, PySpark, Azure, and Databricks.
Python, SQL, PySpark, Microsoft Azure, Databricks, Power BI, React.js, .NET, SQL Server, Profisee, RedPanda, Kafka, OpenAPI, Airflow, Dynamics, Jenkins, GitHub, Docker, Kubernetes
12h
Save
Mark Applied
Hide
Data Engineer
Pune or India
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOERequires 3+ years of AWS BigData experience, 15 years of full-time education, cloud data storage and processing knowledge, ETL and pipeline expertise, data quality skills, troubleshooting, scripting, and automation.
AWS BigData, ETL
20h
Save
Mark Applied
Hide
DE&A - Sr. Data Engineer - Databricks
Pune, Maharashtra, India
RemoteFull Time
Zensar
ZensarNational Stock Exchange of India: ZENSARTECH: Global technology firm providing digital transformation and infrastructure services.
7+ YOERequires 7–9 years of data engineering experience, including 3–4 years with Databricks, plus Python or Scala, PySpark, Spark SQL, Delta Lake, cloud platforms, streaming, CI/CD, and strong SQL skills.
Databricks, Python, Scala, PySpark, Spark SQL, Delta Lake, Lakeflow, Delta Live Tables (DLT), Unity Catalog, Databricks Workflows, Databricks Jobs, AWS, Azure, GCP, Structured Streaming, Kafka, Event Hubs, Kinesis, S3, ADLS, GCS, Glue, ADF, IAM, Entra ID, Databricks Asset Bundles, Databricks Repos, Git, Terraform, Great Expectations, Lakehouse Monitoring, MLflow, Mosaic AI, Lakebase, Genie, Agent Bricks, AI/BI dashboards, dbt, Airflow, Postgres
21h
Save
Mark Applied
Hide
Senior Data Engineer
Pune, Maharashtra, India
HybridFull Time
Principal Financial Group
Principal Financial GroupNASDAQ: PFG: A global financial investment management and insurance.
4+ YOERequires 4–7 years of AWS data engineering and ETL experience, actuarial tools knowledge, AWS cloud services, Python, PySpark, CI/CD, IaC, data lakes, and cloud deployment expertise.
Milliman, AWS Glue, Amazon Athena, AWS Lambda, Amazon S3, AWS CloudFormation, AWS CDK, Amazon SNS, AWS IAM, Amazon RDS, Amazon DynamoDB, Amazon CloudWatch, Boto3, Python, PySpark, GitHub Actions, Docker, AWS SAM, PyTest, CI/CD, Infrastructure as Code (IaC), Agile, Lean, DevOps
1d
Save
Mark Applied
Hide
Application Development
Pune, Maharashtra, India
OnsiteFull Time
Fujitsu
FujitsuTokyo Stock Exchange: 6702: Global provider of IT services and computing hardware products.
Basic SQL, ETL/ELT concepts, data validation, pipeline monitoring, incident management, production support, ServiceNow updates, documentation, troubleshooting, and operational reporting.
SQL, ServiceNow, SFTP, AWS S3, AWS Glue, Snowflake, Databricks, Python, CloudWatch
1d
Save
Mark Applied
Hide
Data Engineer
Mumbai or Pune
OnsiteFull Time
Dentsu
DentsuTokyo Stock Exchange: 4324: Providing global advertising, digital marketing, and media communications services.
3+ YOERequires 3–7 years of data engineering experience, strong AWS, SQL, and Python skills, ETL pipeline expertise, and a bachelor's or master's degree in a related field.
Amazon S3, AWS Glue, Amazon Athena, Amazon Redshift, Amazon EMR, SQL, Python, PySpark, Spark, Terraform, CloudFormation, CI/CD, AWS CloudWatch, Amazon Kinesis, Kafka, Snowflake
1d
Save
Mark Applied
Hide
Senior Data Engineer - AWS, Spark, Scala, Big Data & GenAI
Bengaluru or Pune
OnsiteFull Time
Synechron
Synechron: Providing digital transformation and technology consulting for financial services.
9+ YOERequires 9+ years in data engineering, analytics, or data warehousing, with expertise in Spark, Scala, AWS, big data, ETL, Oracle SQL/PL-SQL, Teradata, Hadoop, and Hive.
Apache Spark, Scala, AWS, ETL, Oracle SQL, PL/SQL, Teradata, Hadoop, Hive, Python, LangChain, Llama, Hugging Face, Agile