Garments industry is considered the life line of the economy and an important area in the development policy of Bangladesh. Bangladesh has set its vision in 2014 to achieve 50 billion US dollar exports earnings from garments sector by 2021.In recent years; global clothing export market has become very competitive. On the other hand, the growth of Bangladesh’s garments sector has been surrounded by a number of difficulties. This study has identified several issues linked to weak infrastructures, low labour productivity, poorly performed compliance, instability in politics as the key challenges to achieve the goal .After analyzing the rapidly growing garments industry of Vietnam, the findings have suggested that only based on low wage rate, cheaper price and better market access facilities, garments sector could not gain expected growth rate. Like Vietnam, Bangladesh’s garments exporters and Governments policy makers should take necessary steps in order to reduce lead time and power crisis, increase labour productivity, and improve compliance standards and political situation.