MCPcopy
hub / github.com/scrapy/scrapy / _wait_for_processing

Method _wait_for_processing

scrapy/core/scraper.py:285–293  ·  view source on GitHub ↗
(
        self, result: Response | Failure, request: Request, queue_dfd: Deferred[None]
    )

Source from the content-addressed store, hash-verified

283 await self.handle_spider_output_async(output, request, result)
284
285 async def _wait_for_processing(
286 self, result: Response | Failure, request: Request, queue_dfd: Deferred[None]
287 ) -> None:
288 try:
289 await self._scrape(result, request)
290 except Exception:
291 queue_dfd.errback(Failure())
292 else:
293 queue_dfd.callback(None) # awaited in enqueue_scrape()
294
295 def call_spider(
296 self, result: Response | Failure, request: Request, spider: Spider | None = None

Callers 1

_scrape_nextMethod · 0.95

Calls 3

_scrapeMethod · 0.95
callbackMethod · 0.80
errbackMethod · 0.45

Tested by

no test coverage detected