Main Duties & Responsibilities -
1. Hadoop development and implementation.
2. Loading from disparate data sets.
3. Pre-processing using Hive and Pig.
4. Designing, building, installing, configuring and supporting Hadoop. 5. Translate complex functional and technical requirements into detailed design.
6. Perform analysis of vast data stores and uncover insights.
7. Maintain security and data privacy.
8. Create scalable and high-performance web services for data tracking.
9. High-speed querying.
10. Managing and deploying HBase.
11. Being a part of a POC effort to help build new Hadoop clusters.
12. Test prototypes and oversee handover to operational teams.
13. Propose best practices/standards.