Hadoop Developer - HADOOP BIG DATA MANAGEMENT
• 1.9 year of professional
experience in Izon Technosoft working as a Hadoop Developer.
• Having Experience in writing queries in Pig and Hive.
• Executed jobs in Hadoop local mode, Pseudo Distributed mode, Hadoop Cluster mode for production.
• Having exposure in writing SQL quires
• Having Experience in developing Map reduce applications for Hadoop.
• Optimized several MapReduce algorithms in Java according to the client requirement for big data analytics.
• Followed the given standard approaches while debugging and error handling.
• Exposure on Query Programming Model of Hadoop such as Hive, Pig, SQL.
• Written Unit Test cases in JUnit and submitted Unit test results as per the quality process.
• Knowledge on Hadoop architecture and Hadoop Distributed File System, Hadoop ecosystem.
• Good understanding of Hbase, Zookeeper, Oozie.
The project is meant to provide one spot solution to all the major actions required while working
with big data and hadoop ecosystem.
➢ Development of enterprise level data lakes and making data available.
• Creation of various data zones to make data available for different phases like landing, staging, processing and raw data zones.
• Data Ingestion from landing zone to staging.
• Making data available to raw data zone and integrating the data to the Hive tables to make them available for further analysis.
➢ Did POC's in Sandbox
• Required a dedicated environment for data analysis.
• Creation of definite hdfs folder.
• Creation of hive database over it.
• Creation of tables/views over it.
• Maintenance of permissions and ownership.
Roles and Responsibilities:
Worked as Hadoop developer using Hadoop framework, Map Reduce, Pig, Hive, HBase, and Core java.
• Handled bad records while processing big datasets.
• Installed Hadoop and Hive.
• Exposure on Query Programming Model of Hadoop such as Hive.
• Exposure on Query Programming Model of Hadoop such as Pig.
• Exposure on Query Programming Model of SQL
• Having Experience in writing queries in Pig and Hive.
• Executed jobs in Hadoop local mode, Pseudo Distributed mode, Hadoop Cluster mode for production.
• Having exposure in writing SQL quires
• Having Experience in developing Map reduce applications for Hadoop.
• Optimized several MapReduce algorithms in Java according to the client requirement for big data analytics.
• Followed the given standard approaches while debugging and error handling.
• Exposure on Query Programming Model of Hadoop such as Hive, Pig, SQL.
• Written Unit Test cases in JUnit and submitted Unit test results as per the quality process.
• Knowledge on Hadoop architecture and Hadoop Distributed File System, Hadoop ecosystem.
• Good understanding of Hbase, Zookeeper, Oozie.
The project is meant to provide one spot solution to all the major actions required while working
with big data and hadoop ecosystem.
➢ Development of enterprise level data lakes and making data available.
• Creation of various data zones to make data available for different phases like landing, staging, processing and raw data zones.
• Data Ingestion from landing zone to staging.
• Making data available to raw data zone and integrating the data to the Hive tables to make them available for further analysis.
➢ Did POC's in Sandbox
• Required a dedicated environment for data analysis.
• Creation of definite hdfs folder.
• Creation of hive database over it.
• Creation of tables/views over it.
• Maintenance of permissions and ownership.
Roles and Responsibilities:
Worked as Hadoop developer using Hadoop framework, Map Reduce, Pig, Hive, HBase, and Core java.
• Handled bad records while processing big datasets.
• Installed Hadoop and Hive.
• Exposure on Query Programming Model of Hadoop such as Hive.
• Exposure on Query Programming Model of Hadoop such as Pig.
• Exposure on Query Programming Model of SQL
Work
Experience
Hadoop Developer
HADOOP BIG DATA MANAGEMENT
January 2014 to Present
Platform: Hadoop.
Technology: Hadoop ecosystem including HDFS, Hive, Pig.
Technology: Hadoop ecosystem including HDFS, Hive, Pig.
Hadoop Developer
Izon Technosoft
Education
B-Tech in Electrical and
Electronics
Vidya College Of Engineering -
Meerut,
Uttar Pradesh
CBSE
Translam Academy International -
Meerut,
Uttar Pradesh
CBSE
Rainbow Public School -
Saharanpur,
Uttar Pradesh
Additional
Information
TECHNICAL SKILLS
Platform: Hadoop
Operating System: Windows, Linux.
Languages: Java 1.7
Course: CCNA (Routing and Switches)
Platform: Hadoop
Operating System: Windows, Linux.
Languages: Java 1.7
Course: CCNA (Routing and Switches)
0 comments:
Post a Comment