Hadoop Administration - Cloudera Hadoop on AWS

Hadoop Administration - Cloudera Hadoop on AWS

itversity via YouTube Direct link

Big Data Introduction

10 of 64

10 of 64

Big Data Introduction

Class Central Classrooms beta

YouTube playlists curated by Class Central.

Classroom Contents

Hadoop Administration - Cloudera Hadoop on AWS

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Amazon Web Services - Sign up and Regions
  2. 2 Amazon Web Services - Networking
  3. 3 Amazon Web Services - Key Pair (authentication) and Security Groups (firewalls)
  4. 4 Amazon Web Services - Storage
  5. 5 Amazon Web Services - EC2 Pricing (Very Important)
  6. 6 Amazon Web Services - Provision EC2 Instance Demo
  7. 7 Amazon Web Services - Setup SSH forwarding (Bastion)
  8. 8 Amazon Web Services - Mac - Setup SSH Forwarding (Bastion)
  9. 9 Amazon Web Services - Setup SSH Tunneling and Foxyproxy
  10. 10 Big Data Introduction
  11. 11 Hadoop Introduction and brief comparison with Oracle
  12. 12 Hadoop Administration - CDH5 on AWS - Introduction
  13. 13 Setup CDH on AWS - Provision EC2 Instances
  14. 14 Setup CDH on AWS - Setup parallel ssh
  15. 15 Setup CDH on AWS - Setup http server on master01 or gateway node
  16. 16 Setup CDH on AWS - Setup local yum repository server for Cloudera Manager and Hadoop
  17. 17 Setup CDH5 on AWS - Setup pre-requisites using parallel-ssh
  18. 18 Setup CDH5 on AWS - Install Cloudera Manager
  19. 19 Setup CDH on AWS - Review Cloudera Management Service Components
  20. 20 Setup CDH on AWS - Setup HDFS
  21. 21 HDFS - Files and blocks - dfs.blocksize (Block Size)
  22. 22 HDFS - Replication Factor - Fault Tolerance
  23. 23 HDFS - Metadata, Datanode, Namenode and Secondary Namenode
  24. 24 HDFS - Heartbeat, Block report and Checksum
  25. 25 HDFS - Namenode Recovery (role of editlogs, fsimage and secondary namenode)
  26. 26 Setup CDH on AWS - Setup HDFS High Availability Introduction
  27. 27 Setup CDH on AWS - Setup HDFS High Availability using Cloudera Manager
  28. 28 HDFS - High Availability - Setup using Cloudera Manager
  29. 29 HDFS - High Availability - Review components and parameter files
  30. 30 HDFS Commands - hadoop fs command overview, help and appendToFile
  31. 31 HDFS Commands - cat, checksum, chgrp, chmod, chown
  32. 32 HDFS Commands - copyFromLocal or put, copyToLocal or get and cp
  33. 33 HDFS Commands - count, df, du and expunge
  34. 34 HDFS Commands - find, getmerge and ls
  35. 35 Hadoop Certification - HDPCA - Recover a snapshot
  36. 36 Hadoop Certification - HDPCA - Create a snapshot of an HDFS directory
  37. 37 Hadoop Certification - HDPCA - Configure ACLs
  38. 38 HDFS Commands - mkdir, moveFromLocal, moveToLocal, mv
  39. 39 HDFS Commands - stat, tail, test, text, touchz and usage
  40. 40 Setup Map Reduce v1 (MRv1) or Classic using Cloudera Distribution
  41. 41 Setup Map Reduce v1 (MRv1) or Classic using Cloudera Distribution - Review
  42. 42 Setup Map Reduce v1 (MRv1) or Classic using Cloudera Distribution - JobLifeCycle
  43. 43 Setup Map Reduce v1 (MRv1) - Heartbeat, Fault Tolerance and Speculative Execution
  44. 44 Setup Map Reduce v1 (MRv1) - Challenges
  45. 45 Setup CDH on AWS - Configure MRv2 + YARN
  46. 46 Setup CDH on AWS - Configure MRv2 + YARN - Review
  47. 47 Setup CDH on AWS - Configure MRv2 + YARN - Validate
  48. 48 Setup CDH on AWS - Configure MRv2 + YARN - Map Reduce Job Life Cycle
  49. 49 Setup CDH on AWS - Configure MRv2 + YARN - Fault Tolerance
  50. 50 Hadoop Certification - CCAH - Principal points to consider hardware and OS for Hadoop cluster
  51. 51 Hadoop Certification - CCAH - Cluster planning
  52. 52 Hadoop Certification - CCAH - Logging Configuration (log4j.properties)
  53. 53 Hadoop Certification - CCAH - Setup Hadoop eco system tools - Introduction
  54. 54 Hadoop Certification - CCAH - Hadoop metrics and cluster health monitoring
  55. 55 Setup CDH on AWS - Setup mysql for hive, oozie, sqoop etc.
  56. 56 Setup CDH - Setup Pig using Cloudera Manager
  57. 57 Setup CDH on AWS - Setup Hive using Cloudera Manager
  58. 58 Setup CDH on AWS - Setup Hive using Cloudera Manager - Review
  59. 59 Setup CDH on AWS - Setup Hive using Cloudera Manager - Validate
  60. 60 Setup CDH on AWS - Setup Sqoop using Cloudera Manager
  61. 61 Setup CDH - Schedulers Overview
  62. 62 Setup CDH - FIFO Scheduler
  63. 63 Setup CDH - Fair Scheduler
  64. 64 Setup CDH - Capacity Scheduler

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.