MCPcopy
hub / github.com/scrapy/scrapy / _scrape_next

Method _scrape_next

scrapy/core/scraper.py:238–242  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

236 self._scrape_next()
237
238 def _scrape_next(self) -> None:
239 assert self.slot is not None # typing
240 while self.slot.queue:
241 result, request, queue_dfd = self.slot.next_response_request_deferred()
242 _schedule_coro(self._wait_for_processing(result, request, queue_dfd))
243
244 async def _scrape(self, result: Response | Failure, request: Request) -> None:
245 """Handle the downloaded response or failure through the spider callback/errback."""

Callers 1

enqueue_scrapeMethod · 0.95

Calls 3

_wait_for_processingMethod · 0.95
_schedule_coroFunction · 0.90

Tested by

no test coverage detected