MCPcopy
hub / github.com/scrapy/scrapy / _build_request

Method _build_request

scrapy/spiders/crawl.py:131–137  ·  view source on GitHub ↗
(self, rule_index: int, link: Link)

Source from the content-addressed store, hash-verified

129 return results
130
131 def _build_request(self, rule_index: int, link: Link) -> Request:
132 return Request(
133 url=link.url,
134 callback=self._callback,
135 errback=self._errback,
136 meta={"rule": rule_index, "link_text": link.text},
137 )
138
139 def _requests_to_follow(self, response: Response) -> Iterable[Request | None]:
140 if not isinstance(response, HtmlResponse):

Callers 1

_requests_to_followMethod · 0.95

Calls 1

RequestClass · 0.90

Tested by

no test coverage detected