MCPcopy
hub / github.com/scrapy/scrapy / join

Method join

scrapy/crawler.py:483–491  ·  view source on GitHub ↗

join() Returns a deferred that is fired when all managed :attr:`crawlers` have completed their executions.

(self)

Source from the content-addressed store, hash-verified

481
482 @inlineCallbacks
483 def join(self) -> Generator[Deferred[Any], Any, None]:
484 """
485 join()
486
487 Returns a deferred that is fired when all managed :attr:`crawlers` have
488 completed their executions.
489 """
490 while self._active:
491 yield DeferredList(self._active)
492
493
494class AsyncCrawlerRunner(CrawlerRunnerBase):

Callers 15

mainFunction · 0.95
_configureMethod · 0.45
_join_if_neededMethod · 0.45
startMethod · 0.45
_start_asyncioMethod · 0.45
_start_twistedMethod · 0.45
_path_safeFunction · 0.45
_print_commandsFunction · 0.45
get_helpMethod · 0.45

Calls

no outgoing calls

Tested by 15

random_stringMethod · 0.36
test_log_scrapy_infoFunction · 0.36
test_string_seqMethod · 0.36
test_stringset_seqMethod · 0.36
_random_temp_filenameMethod · 0.36
random_stringMethod · 0.36
test_process_requestMethod · 0.36
generate_random_stringFunction · 0.36
test_csviter_headersMethod · 0.36