antibot_extractor_enricher.dropins.default

antibot_extractor_enricher.dropins.default#

Module Contents#

class antibot_extractor_enricher.dropins.default.DefaultDropin(sb: seleniumbase.SB, extractor: auto_archiver.core.Extractor)#

Bases: auto_archiver.modules.antibot_extractor_enricher.dropin.Dropin

A default fallback drop-in class for handling generic cases in the antibot extractor enricher module.

static suitable(url: str) bool#

Check if the URL is suitable for processing with this dropin. :param url: The URL to check. :return: True if the URL is suitable for processing, False otherwise.

open_page(url) bool#

Make sure the page is opened, even if it requires authentication, captcha solving, etc. :param url: The URL to open. :return: True if success, False otherwise.