NielsenIQ logo
fulltime·NielsenIQ

Software Engineer - Big Data Engineer (Spark, Databricks, PySpark , Snowflake)

Pune, IndiaSalary not disclosed7 skills

Skills & Stack

Spark/PySparkDatabricksSnowflakeAirflowSQLAzureCI/CD

About the Role

Big Data Software Engineer at NielsenIQ in Pune, building ingestion services on a unified global data ecosystem powered by Microsoft Azure, using Spark, Databricks, PySpark and Snowflake.

About NielsenIQ

Global consumer intelligence company formed by the 2023 combination of NielsenIQ and GfK.

What You'll Do

5 items
  • 1Develop, test, troubleshoot, debug and enhance data engineering applications using Spark, PySpark, Pandas, Databricks, Snowflake, Airflow and SQL
  • 2Design, build and optimize scalable data pipelines and ETL/ELT workflows for large-scale data processing
  • 3Deploy and maintain application components through CI/CD pipelines for reliable, efficient releases
  • 4Build utilities, frameworks and monitoring solutions to automate repetitive tasks and improve operational efficiency
  • 5Investigate production issues, perform root cause analysis and implement bug fixes and performance improvements

What We're Looking For

  • 2-5 years of experience as a Big Data engineer on enterprise frameworks like Spark, Databricks, PySpark and Snowflake
  • Strong fundamentals in Spark, PySpark, Pandas, Databricks, Snowflake, Airflow and SQL
  • Experience with cloud technologies, preferably Microsoft Azure
  • Good understanding of CI/CD pipelines (GitHub Actions) and version control with GitHub; basic Linux/Unix and shell scripting
  • Nice to have: Kubernetes, Jenkins, Docker, PostgreSQL, and Databricks/Snowflake/cloud certifications

Check your fit before you apply

We check the resume on your profile against this role at NielsenIQ: a match score, what is missing, and what to fix before you apply.

Ready to apply for this role?

Software Engineer - Big Data Engineer (Spark, Databricks, PySpark , Snowflake) at NielsenIQ — click below to submit your application.

Apply Now

Get new Data Engineer Jobs in Pune by email

Only new listings. No spam. Or get them on Telegram

Prepare for this interview

Free practice for the problem-solving rounds data roles screen on.

blur