lower garment?

[*charisma*]

hi i read that it is haraam for the lower garment of a man can't go lower then his ankles is this true? or does it only apply to when one is about to pray?