MCPcopy
hub / github.com/scrapy/scrapy / push

Method push

scrapy/pqueues.py:169–182  ·  view source on GitHub ↗
(self, request: Request)

Source from the content-addressed store, hash-verified

167 return -request.priority
168
169 def push(self, request: Request) -> None:
170 priority = self.priority(request)
171 is_start_request = request.meta.get("is_start_request", False)
172 if is_start_request and self._start_queue_cls:
173 if priority not in self._start_queues:
174 self._start_queues[priority] = self._sqfactory(priority)
175 q = self._start_queues[priority]
176 else:
177 if priority not in self.queues:
178 self.queues[priority] = self.qfactory(priority)
179 q = self.queues[priority]
180 q.push(request) # this may fail (eg. serialization error)
181 if self.curprio is None or priority < self.curprio:
182 self.curprio = priority
183
184 def pop(self) -> Request | None:
185 while self.curprio is not None:

Callers

nothing calls this directly

Calls 5

priorityMethod · 0.95
_sqfactoryMethod · 0.95
qfactoryMethod · 0.95
getMethod · 0.45
pushMethod · 0.45

Tested by

no test coverage detected