MCPcopy
hub / github.com/scrapy/scrapy / _crawl_and_track

Method _crawl_and_track

scrapy/crawler.py:572–579  ·  view source on GitHub ↗
(
        self, crawler: Crawler, *args: Any, **kwargs: Any
    )

Source from the content-addressed store, hash-verified

570 return self._crawl(crawler, *args, **kwargs)
571
572 async def _crawl_and_track(
573 self, crawler: Crawler, *args: Any, **kwargs: Any
574 ) -> None:
575 try:
576 await crawler.crawl_async(*args, **kwargs)
577 except Exception:
578 self.bootstrap_failed = True
579 raise # re-raise so asyncio still logs it to stderr naturally
580
581 def _done(self, task: asyncio.Task[None], crawler: Crawler) -> None:
582 self._active.discard(task)

Callers 1

_crawlMethod · 0.95

Calls 1

crawl_asyncMethod · 0.80

Tested by

no test coverage detected