[SEARCH-95] crawl jacow
Closes SEARCH-77
Changes:
- Support for files
- Support for iframes
- New flags:
-
WCRAWLER_FORCE
: Resend files, default: False -
WCRAWLER_CRAWEL_WEB
: Crawl web pages, default: True
-
Edited by Carina Antunes
Closes SEARCH-77
Changes:
WCRAWLER_FORCE
: Resend files, default: FalseWCRAWLER_CRAWEL_WEB
: Crawl web pages, default: True