MCPcopy
hub / github.com/scrapy/scrapy / spider_closed

Method spider_closed

scrapy/extensions/logstats.py:75–81  ·  view source on GitHub ↗
(self, spider: Spider, reason: str)

Source from the content-addressed store, hash-verified

73 self.pagesprev, self.itemsprev = self.pages, self.items
74
75 def spider_closed(self, spider: Spider, reason: str) -> None:
76 if self.task and self.task.running:
77 self.task.stop()
78
79 rpm_final, ipm_final = self.calculate_final_stats(spider)
80 self.stats.set_value("responses_per_minute", rpm_final)
81 self.stats.set_value("items_per_minute", ipm_final)
82
83 def calculate_final_stats(
84 self, spider: Spider

Calls 3

calculate_final_statsMethod · 0.95
stopMethod · 0.45
set_valueMethod · 0.45