Bash Magic: List Hive Table Sizes in GB
Posted by Jakub Holý on January 8, 2013
To list the sizes of Hive tables in Hadoop in GBs:
sudo -u hdfs hadoop fs -du /user/hive/warehouse/ | awk '/^[0-9]+/ { print int($1/(1024**3)) " [GB]\t" $2 }'
Result:
448 [GB] hdfs://aewb-analytics-staging-name.example.com:8020/user/hive/warehouse/mybigtable 8 [GB] hdfs://aewb-analytics-staging-name.example.com:8020/user/hive/warehouse/anotherone 0 [GB] hdfs://aewb-analytics-staging-name.example.com:8020/user/hive/warehouse/tinyone
