Description
To illustrate: • Played a critical role in Installing and configuring Cloudera CDH5 on 20 node clusters for development and stage environments. Maintained the Apache Hadoop ecosystem and the major components in Hadoop Ecosystem including HDFS, Yarn, Hive, Flume, Zookeeper, Oozie, Pig, Sqoop and other ecosystem tools and products. for application development and stage environments. • As a Hadoop Cluster Administration responsibilities include software installation, configuration, software upgrades, backup and recovery, commissioning and decommissioning data nodes, cluster setup, cluster performance and monitoring on daily basis, maintaining cluster on healthy on different Hadoop distributions (Hortonworks & Cloudera) • Involved in design and development of the BigData Hadoop plugins to an agent application to submit hadoop jobs and workflows from scheduling manager to the Hadoop Infrastructure in a tiered distributed environment • Wrote custom mapreduce, oozie, sqoop, pig and spark applications and scripts for unit, system and end-to-end testing • Worked on Providing User support and application support on Hadoop Infrastructure and Advanced Hadoop integration product to the job scheduler teams • Provided analysis,design,coding,unit testing, integration test support user support to enhance the system and for service requests for software maintenance • Maintained customer satisfaction and improved speed and efficiency of sustain engineering By handling incoming calls for diagnosis of system failure, analyzing errors, and recommended solutions. • Played a critical role in managing all the issues related to the products and provided efficient fixes to customers to be safely implemented in the vast production environment. Developed and managed high performance teams in US and India. • Collaborated with cross-functional teams with a primary focus to provide a quality product with zero defects.
