HDFS Issues

HDFS Issues Steve Loughran Julio Guijarro Paolo Castagna

HDFS: Hadoop Distributed Filesystem ,[object Object],[object Object],[object Object],[object Object],[object Object]

Locality is key for Hadoop performance ,[object Object],[object Object],[object Object],[object Object]

Append ,[object Object],[object Object],[object Object],[object Object]

Data Loss ,[object Object],[object Object],[object Object],[object Object]

Handling of full disks ,[object Object],[object Object],[object Object],[object Object],[object Object]

Underreplication/ bad handling of corrupt data ,[object Object],[object Object],[object Object],[object Object]

Limits to scale of Namenode ,[object Object],[object Object],[object Object],[object Object]

Failover handling ,[object Object],[object Object],[object Object],[object Object]

Rate of change of filesystem/APIs ,[object Object],[object Object],[object Object],[object Object]

Security: none ,[object Object],[object Object],[object Object],[object Object]

Is HDFS ready for production? Maybe, but with care

Recommandé