Familiarity with HDFS, MapR filesystem, M3 & M5 clusters, Oozie, scooping, Hive, Spark frame works. * Easy of operability with the Unix file system through command line interface. * Good expertise knowledge with the Unix commands like changing the permissions of the file to file and group permissions. * Handling Server to Server Key encryptions and accessibility to various owners and groups in Unix environments. * Implementing various MapReduce jobs through Hive and MapReduce in MapR file systems * Great knowledge on Spark framework with Scala and Java APIs. * Handling the Data level issues while writing UDFs. * Understanding the complexity of a given module and decomposing it into several simple achievable goals. * Addressing complex POCs according to business requirements from the technical end. * Writing test cases for achieving the Unit test accomplishment. * Handling workflow scheduling using Oozie. * Handling the Null values and entitlement tagging protocols according to the business requirement. * Creating the schema file for the wrapper scripts for passing the parameters for the staging environment for Data Integrity. * Key analysis of issues raised and estimating RCA on criticality of the issues raised and handling them. * Organizing business meetings and standup calls for status updates and maintain the integrity of the Software Development Life cycle & maintaining a schedule on par with the other teams and make sure that all of us on the same page by checking with the Delivery Management. * Ability to address issues in accordance with the on-shore and off-shore teams working off the business hours. * Performed shell scripting by a learn and go approach and wrote wrapper scripts for task automation. * Ability to work as a Team Player and shoulder individual responsibility of a task whenever required. * Effectively communicate with business units and stake holders and provide strategic solutions according to the client's requirements. * Ability to work on deadlines, sprint to sprint and handle escalations if any or escalate to appropriate resource whenever necessary. * Passionate approach to handle complexity at design levels and gradually work towards achieving them. * Consistently learning the new technologies and IT Trends and enhancing interpersonal skills for contributing my best foot forward in any given situation promising a great extent of flexibility.

Highlights:

• Spark
• Hadoop
• Hive
• Scala
• Structured Query Language
• Team Player
• Lamba Architecture
• Test Cases
• Unit Testing
• Version Control
• Pig
• Map Reduce
• Shell Scripting
• Python
• Data engineering