NielsenIQ
Posted 9h ago

Backend Engineer with Python, PHP along with web scrapping

NielsenIQ
Chennai or Pune
HybridFull Time
Responsibilities
  • building web crawlers
  • developing microservices
  • managing databases
Requirements
  • Requires 3+ years of software engineering experience
  • Python and PHP expertise
  • Web scraping
  • Browser automation
  • CodeIgniter
  • PostgreSQL
  • Microservices
  • RESTful APIs, and strong collaboration skills
Technical tools mentioned
PythonPHPPostgreSQLScrapyBeautifulSoupLXMLRequestsSeleniumPlaywrightPyppeteerCodeIgniterMicroservicesRESTful APIsAWSAzureGCPCI/CDDockerKubernetesGitJIRA

Job description

Job Description:

Software Engineer – Pune/Chennai 

We are seeking an experienced and highly motivated Mid Software Engineer based in Pune/Chennai. In this role, you will take end-to-end ownership of scalable backend architectures, web scraping pipelines, and core web applications. You will balance data extraction engineering with robust backend development using Python, PHP and PostgreSQL. If you thrive in a fast-paced environment and love solving complex data challenges, this role is for you. 

Responsibilities 

Data Extraction & Web Scraping 

  • Build scalable web crawlers to harvest structured and unstructured web data using custom and enterprise frameworks. 
  • Manage dynamic content extraction using advanced browser automation tools for JavaScript-heavy, AJAX, and infinite-scroll sites. 
  • Optimize crawling performance through concurrent execution, asynchronous programming, and container multi-threading. 

Backend & Application Engineering 

  • Design, develop, and maintain scalable backend microservices using Python and PHP. 
  • Build web applications and custom internal tools using the PHP CodeIgniter framework. 
  • Design Python based RESTful APIs to ensure seamless data integration across cross-functional platforms. 

Database Management & Operations 

  • Write efficient, optimized SQL queries and manage schema design within PostgreSQL. 
  • Troubleshoot, debug, and resolve complex production issues to maintain system stability. 
  • Collaborate closely with cross-functional teams including Product, QA, DevOps, and other engineering units. 
Qualifications:
  • Must Have Experience: 3+ years of professional software engineering experience. 
  • Web Scraping: Deep proficiency with Python parsing packages (Scrapy, BeautifulSoup, LXML, Requests). 
  • Browser Automation: Hands-on experience handling browser execution via Selenium, Playwright, or Pyppeteer. 
  • PHP: Strong development experience in PHP and the CodeIgniter framework. 
  • Database: Solid understanding of PostgreSQL database schema design, query optimization, and performance tuning. 
  • Architecture: Strong foundation in designing Microservices and building robust RESTful APIs. 
  • Soft Skills: Ownership: Ability to take a project from concept to delivery independently. 
  • Collaboration: Strong communication skills to align with remote and local cross-functional teams. 
  • Agility: A proactive mindset that thrives in fast-paced, continuous-improvement environments. 
  • Nice to Have Cloud & DevOps: Experience with cloud platforms (AWS, Azure, or GCP) and CI/CD pipelines. 
  • Containerization: Familiarity with Docker and Kubernetes orchestration. 
  • Tooling: Experience with Git version control and logging, monitoring, and observability tools. 
  • Methodology: Familiarity working within Agile/Scrum frameworks using JIRA 
Additional Information:

Our Benefits

  • Flexible working environment
  • Volunteer time off
  • LinkedIn Learning
  • Employee-Assistance-Program (EAP)

NIQ may utilize artificial intelligence (AI) tools at various stages of the recruitment process, including résumé screening, candidate assessments, interview scheduling, job matching, communication support, and certain administrative tasks that help streamline workflows. These tools are intended to improve efficiency and support fair and consistent evaluation based on job-related criteria. All use of AI is governed by NIQ’s principles of fairness, transparency, human oversight, and inclusion. Final hiring decisions are made exclusively by humans. NIQ regularly reviews its AI tools to help mitigate bias and ensure compliance with applicable laws and regulations. If you have questions, require accommodations, or wish to request human review were permitted by law, please contact your local HR representative. For more information, please visit NIQ’s AI Safety Policies and Guiding Principles: https://nielseniq.com/global/en/info/niqs-ai-safety-policies/

About NIQ

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

For more information, visit NIQ.com

Want to keep up with our latest updates?

Follow us on: LinkedIn | Instagram | Twitter | Facebook

Our commitment to Diversity, Equity, and Inclusion

At NIQ, we are steadfast in our commitment to fostering an inclusive workplace that mirrors the rich diversity of the communities and markets we serve. We believe that embracing a wide range of perspectives drives innovation and excellence.  All employment decisions at NIQ are made without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, marital status, veteran status, or any other characteristic protected by applicable laws. We invite individuals who share our dedication to inclusivity and equity to join us in making a meaningful impact. To learn more about our ongoing efforts in diversity and inclusion, please visit the https://nielseniq.com/global/en/news-center/diversity-inclusion

About NielsenIQ

Provides consumer intelligence and retail measurement data services.

Similar jobs

Backend Engineer roles near Chennai, Tamil Nadu
6d
Save
Mark Applied
Hide
Java Backend Engineer
Bengaluru or Chennai or Gurugram or Mumbai
HybridFull Time
Ascendion
Ascendion: AI-native digital engineering and software development services provider.
7+ YOE7+ years of backend development experience with Java, Spring Boot, REST APIs, microservices, Docker, CI/CD, cloud platforms, Git, testing, and Agile methodologies.
Java, Spring Boot, REST APIs, Microservices Architecture, Docker, CI/CD, Azure, AWS, Git
6d
Save
Mark Applied
Hide
Java Backend Developer
Chennai or Pune
HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
5+ YOE5–8 years in financial services and Java application development; extensive Java, Spring, Spring Boot, microservices, Kafka, ECS, PL/SQL, and Agile experience; bachelor's degree or equivalent.
Java, Spring Framework, Spring Boot, Kafka, ECS, PL/SQL
1w
Save
Mark Applied
Hide
Lead Backend Developer
Chennai, Tamil Nadu, India
HybridFull Time
TEGNA
TEGNANYSE: TGNA: Broadcast and digital media operating local television stations.
8+ YOERequires a bachelor's degree, 8–12+ years of Java development experience, and expertise in Spring Boot, microservices, AWS, distributed systems, REST APIs, SQL, Git, and CI/CD.
Java, Spring Boot, Microservices, AWS, REST APIs, CI/CD, SQL, Git, Amazon EC2, Amazon S3, Amazon RDS, AWS Lambda
1w
Save
Mark Applied
Hide
Technical Lead (132073)
Chennai or Nagpur
HybridFull Time
HCLTech
HCLTechNational Stock Exchange of India: HCLTECH: Global provider of information technology services and software consulting.
5+ YOERequires 5+ years developing scalable Go backend applications, microservices, APIs, distributed systems, cloud platforms, databases, containers, CI/CD, and Linux; strong problem-solving and communication skills.
Go, REST, gRPC, AWS, Microsoft Azure, Google Cloud Platform, Docker, Kubernetes, Linux, SQL, NoSQL, CI/CD
1w
Save
Mark Applied
Hide
Java Backend
Chennai, Tamil Nadu, India
HybridFull Time
Citi
CitiNYSE: C: A global financial services providing banking and credit services.
Requires strong cryptography and information security expertise, PKI experience, database and PowerShell skills, Windows and Unix knowledge, and a bachelor's degree or equivalent experience.
PKI, Microsoft SQL Server (MSSQL), PowerShell, Microsoft Windows, Unix, HSM, Certificate Authority (CA)
1w
Save
Mark Applied
Hide
Back End Developer-II
Chennai, Tamil Nadu, India
OnsiteFull Time
Fuller Technologies
Fuller Technologies: Global provider of cement production equipment and services.
4+ YOEBachelor's degree in a technical field and 4+ years of backend development experience. Requires backend programming, APIs, databases, Azure, cloud-native solutions, DevOps, Agile, cybersecurity, and fluent English.
Java, Python, C#, Node.js, Microsoft Azure, RESTful APIs, CI/CD, SDLC, Agile, IEC 62443, NoSQL
2w
Save
Mark Applied
Hide
Python Backend Developer
Chennai, Tamil Nadu, India
OnsiteFull Time
Kavi Global
Kavi Global: Provides data analytics and AI-driven business intelligence solutions.
5+ YOERequires 5–7 years of Python development experience, backend and REST API expertise, Python frameworks, ORM, authentication, API documentation, testing, and strong analytical and teamwork skills.
Python, FastAPI, Django, Flask, SQL, HTML, CSS, JavaScript, Git, REST APIs, Software Development Life Cycle (SDLC), SQLAlchemy, Django ORM, OAuth2, JWT, LDAP, SSO, Swagger, OpenAPI, PyTest, UnitTest
2w
Save
Mark Applied
Hide
Backend Developer
Chennai, Tamil Nadu, India
OnsiteFull Time
Consolidated Analytics
Consolidated Analytics: Provides mortgage technology and operational intelligence platforms.
5+ YOEBachelor's degree,5+ years database development experience,extensive MS SQL Server expertise,complex SQL and schema design,performance tuning,problem-solving and collaboration skills.
MS SQL Server, Azure SQL, AWS RDS, MySQL, PostgreSQL, Oracle