Modified the LFN crawler to iterate per indextable entry
Changed the iterations order so that for every indextable entry there is performed a directory and a file iteration. Added also a sleep period between indextable entries iterations so that other operations can be performed in the meantime. This changes aim to reduce the execution time of the crawler.