Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/psf/requests-html
/ functions
Functions
84 in github.com/psf/requests-html
⨍
Functions
84
◇
Types & classes
9
↓ 15 callers
Method
find
Given a CSS Selector, returns a list of :class:`Element <Element>` objects or a single one. :param selector: CSS Selector to use.
requests_html.py:180
↓ 11 callers
Function
get
()
tests/test_requests_html.py:15
↓ 8 callers
Method
close
If a browser was created close it first.
requests_html.py:733
↓ 5 callers
Method
__init__
(self, *, session: Union['HTMLSession', 'AsyncHTMLSession'] = None, url: str = DEFAULT_URL, html: _HTML, defau
requests_html.py:413
↓ 4 callers
Method
render
Reloads the response in Chromium, and replaces HTML content with an updated version, with JavaScript executed. :param retries: The nu
requests_html.py:541
↓ 4 callers
Method
status
Prints things in bold.
setup.py:46
↓ 3 callers
Method
arender
Async version of render. Takes same parameters.
requests_html.py:612
↓ 3 callers
Function
async_get
AsyncSession cannot be created global since it will create a different loop from pytest-asyncio.
tests/test_requests_html.py:23
↓ 3 callers
Method
next
Attempts to find the next page, if there is one. If ``fetch`` is ``True`` (default), returns :class:`HTML <HTML>` object of next page.
requests_html.py:433
↓ 2 callers
Method
_async_render
Handle page creation and js rendering. Internal use for render/arender methods.
requests_html.py:502
↓ 2 callers
Function
_get_first_or_list
(l, first=False)
requests_html.py:676
↓ 2 callers
Method
_make_absolute
Makes a given link absolute.
requests_html.py:306
↓ 2 callers
Method
xpath
Given an XPath selector, returns a list of :class:`Element <Element>` objects or a single one. :param selector: XPath Selector to use
requests_html.py:236
↓ 1 callers
Method
__anext__
(self)
requests_html.py:491
↓ 1 callers
Method
_from_response
(cls, response, session: Union['HTMLSession', 'AsyncHTMLSession'])
requests_html.py:659
↓ 1 callers
Method
close
If a browser was created close it first.
requests_html.py:761
↓ 1 callers
Method
pq
`PyQuery <https://pythonhosted.org/pyquery/>`_ representation of the :class:`Element <Element>` or :class:`HTML <HTML>`.
requests_html.py:144
↓ 1 callers
Method
run
Pass in all the coroutines you want to run, it will wrap each one in a task, run it and wait for the result. Return a list with all
requests_html.py:767
↓ 1 callers
Method
search
Search the :class:`Element <Element>` for the given Parse template. :param template: The Parse template to use.
requests_html.py:274
↓ 1 callers
Function
test_containing
()
tests/test_requests_html.py:78
↓ 1 callers
Function
user_agent
Returns an apparently legit user-agent, if not requested one of a specific style. Defaults to a Chrome-style User-Agent.
requests_html.py:665
Method
__aiter__
(self)
requests_html.py:488
Method
__init__
(self, message)
requests_html.py:65
Method
__init__
(self, *, element, default_encoding: _DefaultEncoding = None, html: _HTML = None, url: _URL)
requests_html.py:79
Method
__init__
(self, *, element, url: _URL, default_encoding: _DefaultEncoding = None)
requests_html.py:378
Method
__init__
(self, session: Union['HTMLSession', 'AsyncHTMLSession'])
requests_html.py:646
Method
__init__
(self, mock_browser : bool = True, verify : bool = True, browser_args : list = ['--no-sandbox
requests_html.py:691
Method
__init__
(self, **kwargs)
requests_html.py:721
Method
__init__
Set or create an event loop and a thread pool. :param loop: Asyncio loop to use. :param workers: Amount of threads to use fo
requests_html.py:743
Method
__iter__
(self)
requests_html.py:474
Method
__next__
(self)
requests_html.py:485
Method
__repr__
(self)
requests_html.py:385
Method
__repr__
(self)
requests_html.py:430
Method
absolute_links
All found links on page, in absolute form (`learn more <https://www.navegabem.com/absolute-or-relative-links.html>`_).
requests_html.py:329
Method
add_next_symbol
(self, next_symbol)
requests_html.py:499
Method
attrs
Returns a dictionary of the attributes of the :class:`Element <Element>` (`learn more <https://www.w3schools.com/tags/ref_attributes.asp>`_).
requests_html.py:390
Method
base_url
The base URL for the page. Supports the ``<base>`` tag (`learn more <https://www.w3schools.com/tags/tag_base.asp>`_).
requests_html.py:341
Method
browser
(self)
requests_html.py:712
Method
browser
(self)
requests_html.py:725
Function
count_chromium_process
()
tests/test_requests_html.py:34
Method
encoding
The encoding string to be used, extracted from the HTML and :class:`HTMLResponse <HTMLResponse>` headers.
requests_html.py:119
Method
finalize_options
(self)
setup.py:53
Method
full_text
The full text content (including links) of the :class:`Element <Element>` or :class:`HTML <HTML>`.
requests_html.py:174
Method
gen
()
requests_html.py:294
Method
get_next
()
requests_html.py:440
Method
html
Unicode representation of the HTML content (`learn more <http://www.diveintopython3.net/strings.html>`_).
requests_html.py:100
Method
html
(self)
requests_html.py:652
Method
initialize_options
(self)
setup.py:50
Method
links
All found links on page, in as–is form.
requests_html.py:291
Method
lxml
`lxml <http://lxml.de>`_ representation of the :class:`Element <Element>` or :class:`HTML <HTML>`.
requests_html.py:154
Method
raw_html
Bytes representation of the HTML content. (`learn more <http://www.diveintopython3.net/strings.html>`_).
requests_html.py:90
Method
request
Partial original request func and run it in a thread.
requests_html.py:756
Method
response_hook
Change response enconding and replace it by a HTMLResponse.
requests_html.py:705
Method
run
(self)
setup.py:56
Method
search_all
Search the :class:`Element <Element>` (multiple times) for the given parse template. :param template: The Parse template to use.
requests_html.py:282
Function
test1
()
tests/test_internet.py:36
Function
test2
()
tests/test_internet.py:39
Function
test3
()
tests/test_internet.py:42
Function
test_absolute_links
(url, link, expected)
tests/test_requests_html.py:161
Function
test_anchor_links
()
tests/test_requests_html.py:144
Function
test_async_browser_session
()
tests/test_requests_html.py:338
Function
test_async_file_get
(async_get)
tests/test_requests_html.py:50
Function
test_async_links
(async_get)
tests/test_requests_html.py:108
Function
test_async_pagination
(event_loop)
tests/test_internet.py:20
Function
test_async_render
(async_get)
tests/test_requests_html.py:198
Function
test_async_run
()
tests/test_internet.py:33
Function
test_attrs
()
tests/test_requests_html.py:89
Function
test_bare_arender
()
tests/test_requests_html.py:241
Function
test_bare_js_async_eval
()
tests/test_requests_html.py:285
Function
test_bare_js_eval
()
tests/test_requests_html.py:263
Function
test_bare_render
()
tests/test_requests_html.py:219
Function
test_browser_process
()
tests/test_requests_html.py:328
Function
test_browser_session
Test browser instaces is created and properly close when session is closed. Note: session.close method need to be tested together with browse
tests/test_requests_html.py:307
Function
test_browser_session_fail
HTMLSession.browser should not be call within an existing event loop>
tests/test_requests_html.py:320
Function
test_class_seperation
()
tests/test_requests_html.py:56
Function
test_css_selector
()
tests/test_requests_html.py:64
Function
test_file_get
()
tests/test_requests_html.py:43
Function
test_html_loading
()
tests/test_requests_html.py:134
Function
test_links
()
tests/test_requests_html.py:98
Function
test_pagination
()
tests/test_internet.py:7
Function
test_render
()
tests/test_requests_html.py:177
Function
test_search
()
tests/test_requests_html.py:117
Function
test_xpath
()
tests/test_requests_html.py:124
Method
text
The text content of the :class:`Element <Element>` or :class:`HTML <HTML>`.
requests_html.py:167