Loads the content of a file based on its input type. Parameters: state (dict): The current state of the graph. input

Yield Documents one at a time, fetching each URL synchronously.

Load a test fixture file. Args: fixture_name: Name of the fixture file fixture_dir: Directory containing fixtures (defaults to te

Fixture returning a ChromiumLoader instance with dummy scraping methods patched.

Suppress default logging.

Mock embedder model for unit testing.

Mock LLM model for unit testing.

Start a mock HTTP server for testing.

Get the base URL for the mock server.

URL for the mock test website.

Import models_tokens directly to avoid triggering the full package init.

Parametrized fixture that tests against multiple LLM providers.

Estimate the number of tokens in a given text using Mistral's tokenization method, adjusted for different Mistral models. Args:

Estimate the number of tokens in a given text using Ollama's tokenization method, adjusted for different Ollama models. Args: te

Estimate the number of tokens in a given text using OpenAI's tokenization method, adjusted for different OpenAI models. Args: te

Ollama configuration for testing.

Collect token usage.

Print out the token.

Print out the prompts.

OpenAI configuration for testing.

OpenAI GPT-4 configuration for testing.

Track performance metrics across tests.

Processes a list of links recursively up to a given depth. Args: base_url (str): The base URL for resolving relative lin

Add custom command line options.

Compare current benchmark results against a baseline. Args: baseline_file: Path to baseline results JSON current_file: Path to cu

Modify test collection based on markers and CLI options.

Register custom markers.

Decorator to limit the rate of function calls. Args: calls (int): Maximum number of calls allowed in the period. period (int

Record a new request.

Retry a function with exponential backoff. Args: func: Function to retry max_retries: Maximum number of retry attempts in

Executes the full batch scraping pipeline. This will: 1. Fetch and parse all URLs concurrently 2. Submit all LLM prompts as a

Executes the web scraping and searching process. Returns: str: The answer to the prompt.

Executes the web scraping and searching process. Returns: str: The answer to the prompt.

Abstract method to execute the graph and return the result.

Executes the scraping process and returns the scraping content. Returns: str: The scraping content.

Executes the web scraping and searching process. Returns: str: The answer to the prompt.

Executes the scraping process and returns the answer to the prompt. Returns: str: The answer to the prompt.

Executes the web scraping and searching process. Returns: str: The answer to the prompt.

Runs the image-to-text conversion using the provided image URL. Args: image_url (str): The URL of the image to convert.

Converts the provided text to speech and returns the bytes of the generated speech. Args: text (str): The text to conver

Sample CSV content for testing.

Sample HTML content for testing.

Sample JSON data for testing.

Example of text fixture.

Sample XML content for testing.

Example of text

Save test output to a file for debugging. Args: content: Content to save filename: Output filename output_dir: Output dir

Call the scrapegraph-py scrape endpoint across SDK versions.

Call the scrapegraph-py search endpoint across SDK versions.

Allows you to manually select an image area using ipywidgets. It is recommended to use this function if your project is in Google Colab,

Add the default handler to the root logger for the library.

Set up test fixtures.

Set formatting for all handlers bound to the root logger for the library. The formatting is set to: "[levelname|filename:lineno] time >> mes

Enable propagation of the root logger for the library.

Set the verbosity level of the root logger for the library to DEBUG.

Set the verbosity level of the root logger for the library to ERROR.

Set the verbosity level of the root logger for the library to FATAL.

Setup the SearchLinkNode and initial state for testing.

Clean up after tests.

Create a temporary CSV file for testing.

Create a temporary HTML file for testing.

Create a temporary JSON file for testing.

Create a temporary XML file for testing.

Test that alazy_load asynchronously yields Document objects with dummy content and proper metadata.

Test that alazy_load runs tasks concurrently by measuring elapsed time. Each dummy task sleeps for 0.5 seconds. If run sequentially the total time

Test that alazy_load yields no documents when the urls list is empty.

Test that alazy_load yields Document objects in order when one scraper returns None and the other valid HTML.

Test that alazy_load raises TypeError when urls is not an iterable (e.g., integer).

Test that alazy_load yields Document objects with a non‐string page_content when the JS scraping function returns a non‐string value.

Test that alazy_load returns documents in the same order as the input URLs even if scraping tasks complete out of order.

Test that alazy_load propagates an exception if one of the scraping tasks fails.

Test that alazy_load correctly yields Document objects when using selenium backend.

Test that alazy_load yields Document objects when urls is a string (iterating over characters).

Test that append_node correctly delegates to the graph's append_node method.

Test that ascrape_playwright passes extra browser_config kwargs to the browser launch.

Test that ascrape_playwright calls Malenia.apply_stealth on the browser context.

Test that ascrape_playwright recovers on failure and that error messages are logged. This test simulates one failed attempt (via a Timeout) a

Test that ascrape_playwright returns None when retry_limit is negative (loop not executed).

Test that ascrape_playwright retries scraping and raises RuntimeError after all attempts fail.

Test the ascrape_playwright_scroll method with various configurations.