RecrawlPolicy
When crawling an Amazon S3 data source after the first crawl is complete, specifies whether to crawl the entire dataset again or to crawl only folders that were added since the last crawler run. For more information, see Incremental Crawls in AWS Glue in the developer guide.
Contents
- RecrawlBehavior
-
Specifies whether to crawl the entire dataset again or to crawl only folders that were added since the last crawler run.
A value of
CRAWL_EVERYTHINGspecifies crawling the entire dataset again.A value of
CRAWL_NEW_FOLDERS_ONLYspecifies crawling only folders that were added since the last crawler run.A value of
CRAWL_EVENT_MODEspecifies crawling only the changes identified by Amazon S3 events.Type: String
Valid Values:
CRAWL_EVERYTHING | CRAWL_NEW_FOLDERS_ONLY | CRAWL_EVENT_MODERequired: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following:
