Description
Professional Summary: * Over all 7+ years of experience in IT and 4+ years hands on experience in Hadoop ecosystem's implementation, maintenance, ETL and Big Data analysis operations. * Excellent knowledge/understanding of Hadoop architecture and its components. * Hands-on experience in installing, configuration and using Hadoop ecosystem components such as HDFS, MapReduce, PIG, Hive, Sqoop, Spark, Kafka, and Flume. * Full-scale knowledge of Hadoop components such as HDFS, Job Tracker, Name Node, Data Node. * Good experience in Map Reduce Programming, Pig Scripting and analyzing data using HiveQL, Pig Latin, and HBase. * Experience in designing and developing POCs in Spark using Scala to compare the performance of Spark with Hive and SQL/Oracle. Experience in managing and monitoring Hadoop cluster using Cloudera Manager. * Experience in writing custom UDF's which extends Hive and Pig core functionalities. * Configured Zookeeper, Cassandra & Fume to the existing Hadoop Cluster. * Experience in working with different NOSQL databases like HBase. * Handled different file formats like Parquet, Avro files, RC files using different SerDes in Hive. * Experience in importing and exporting data using Sqoop from HDFS/Hive/HBase to Relational Database Systems. * Converted Map Reduce Applications to Spark. * Transformed big data requirements into Hadoop-driven technologies working along with BI team. * In-depth knowledge on Tableau Desktop, Tableau Reader and Tableau Server. * Experience in job workflow schedulers and monitoring applications such as Oozie and Zookeeper. * Experience in dumping shared data into Hdfs from MySQL by writing shell scripts. * Good knowledge in the collection of log files from different sources using Flume and Kafka. * Experience in Core Java, Java Virtual Machines and multi-thread processing. * Proficiency in working with databases like Oracle, MySQL. * Extensive experience in writing stored procedures and functions using SQL and PL/SQL. * Experience in using UNIX shell Scripts for automating batch programs. * Good Knowledge on developing Java Applications using IDEs like Eclipse, NetBeans.