Sr. Big Data Engineer
The NPD Group

Port Washington, New York

This job has expired.


Become a part of our diverse team

NPD is an inclusive and innovative work environment where you can learn and work on meaningful initiatives with some of the best and brightest in the market research industry. The NPD Group provides the world's most successful brands with leading market research, combining consumer and retail point-of-sale data with analytic solutions to interpret today's market trends while anticipating tomorrow's.

Position Overview

Gather complex requirement specifications, analyze the specifications, and determine approach to convert requirements into applications using UNIX, Linux, Sun Solaris, HP-UX, AIX operating system, Python, BIG Data Hadoop, Spark, Scala, Microsoft Azure, DataBricks, SnowFlake, and Oracle Database Tool. Design, develop, test and support computer software programs using UNIX Shell Scripting, Python, Oracle PL/SQL following SDLC life cycle, Waterfall, Agile software architecture methodologies. Design and develop UNIX Shell scripts using Putty and Oracle SQLs and stored procedures using Toad, MYSQL DB to automate the developed software programs on Production environment. Perform data analysis on input and output data using the tools available and solve any data related queries or issues. Develop, test, and automate metadata upload/download, data quality control applications, release procedures using Oracle SQL and PL/SQL, Unix Shell Scripts, Python, Hadoop, HIVE, Hbase, Scala, Spark, Trifacta, REST API, Microsoft Azure, Data Bricks, SnowFlake. Ensure the deliverables are completed and released to Production environment as per the company quality standards and goals. Debug the delivered code and fine tune them following development standards and best practices. Collect feedback from end-users to develop and implement add-ons and additional features. Train end-users on the new features and enhancements. Track and manage user reported errors and production issues and resolve them within the SLA using BMC Remedy ITSM Incident and Problem Management tool, Azure DevOps. Document software errors and release fixes. Document best practices and standards for developing software programs using SharePoint. Assist in drafting documentation and software manuals for end-users using SharePoint. Provide knowledge transfer and training to the new team members. Migrate data from old system to new system.

Requirements: Master's degree in Computer Science or Engineering (Computer or Electronics and Telecommunications), plus three years of experience in position offered or as Programmer/Analyst or Abinitio or Project Lead or Bachelor's degree in Computer Science or Engineering (Computer or Electronics and Telecommunications), plus five years of post-Bachelor's progressive experience in position offered or as Programmer/Analyst or Abinitio or Project Lead. Three years of required experience must have included designing and implementing BIG Data Hadoop platform using HIVE, Hbase, Spark, Scala, Trifacta, REST API; designing, architecting, and unit testing software-based applications and Microsoft Azure, SnowFlake, Data Bricks following Software Architecture models including SDLC Life Cycle, Waterfall, Agile; working with operating systems including UNIX, Linux, Sun Solaris, HP-UX, AIX; developing modular systems applications which map requirements for ETL workflows and systems data configurations; writing packages of Oracle, MYSQL databases for ETL processing using tools including Toad, Putty, MySQL DB; incident management using BMC Remedy ITSM, Azure DevOps tools; configuration management using SharePoint tool; and creating release procedure scripts for repository-based objects.

E-mail résumé to Janice.Ippolito@npd.com.

The NPD Group, L.P. is an Affirmative Action/Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status or any other characteristic protected by law.


This job has expired.

Diversity Inclusion Jobs

Gain Access


Add Your Resume

Add your resume to our resume database that can be searched by employers looking to hire!

Job Alerts

Stay up to date with job alerts! Customize your alerts based on a specific area, category and receive weekly updates!


Sign up now to gain access!

More Science and Research jobs


Southwest Research Institute
Atlanta, Georgia
Posted about 15 hours ago
Southwest Research Institute
Columbus, Ohio
Posted about 15 hours ago
Southwest Research Institute
Atlanta, Georgia
Posted about 15 hours ago
View Science and Research jobs »