MCPcopy Create free account

hub / github.com/ScrapeGraphAI/Scrapegraph-ai / functions

Functions904 in github.com/ScrapeGraphAI/Scrapegraph-ai

⨍ Functions 904◇ Types & classes 195↳ Endpoints 27
Method__init__
Initializes the FetchNodeLevelK instance. Args: input (str): Boolean expression defining the input keys needed from the
scrapegraphai/nodes/fetch_node_level_k.py:40
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/batch_generate_answer_node.py:58
Method__init__
Initializes an empty ConditionalNode.
scrapegraphai/nodes/conditional_node.py:36
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/merge_answers_node.py:36
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/reasoning_node.py:33
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/graph_iterator_node.py:31
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/search_link_node.py:35
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/parse_node.py:40
Method__init__
( self, input: str, output: List[str], node_config: dict, node_name: s
scrapegraphai/nodes/get_probable_tags_node.py:31
Method__init__
Initializes the GenerateAnswerNodeCsv with a language model client and a node name. Args: llm_model: An instance of the O
scrapegraphai/nodes/generate_answer_csv_node.py:47
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/description_node.py:33
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/generate_answer_omni_node.py:45
Method__init__
( self, node_name: str, node_type: str, input: str, output: List[str],
scrapegraphai/nodes/base_node.py:48
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/fetch_node.py:39
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/rag_node.py:28
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/merge_generated_scripts_node.py:27
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/text_to_speech_node.py:25
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/html_analyzer_node.py:31
Method__init__
( self, input: str, output: List[str], library: str, website: str,
scrapegraphai/nodes/generate_scraper_node.py:34
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/fetch_screen_node.py:17
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/generate_answer_from_image_node.py:20
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/markdownify_node.py:28
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/generate_answer_node.py:52
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/integrations/indexify_node.py:24
Method__init__
Instantiates a BurrNodeBridge object.
scrapegraphai/integrations/burr_bridge.py:51
Method__init__
(self, **llm_config)
scrapegraphai/models/xai.py:18
Method__init__
(self, **llm_config)
scrapegraphai/models/minimax.py:18
Method__init__
(self, llm_config: dict)
scrapegraphai/models/openai_itt.py:20
Method__init__
(self, **llm_config)
scrapegraphai/models/oneapi.py:17
Method__init__
(self, **llm_config)
scrapegraphai/models/clod.py:18
Method__init__
(self, tts_config: dict)
scrapegraphai/models/openai_tts.py:21
Method__init__
(self, **llm_config)
scrapegraphai/models/deepseek.py:18
Method__init__
(self)
tests/test_chromium.py:14
Method__init__
(self)
tests/test_chromium.py:20
Method__init__
(self)
tests/test_chromium.py:25
Method__init__
(self)
tests/test_chromium.py:30
Method__init__
(self, options)
tests/test_chromium.py:301
Method__init__
(self)
tests/test_chromium.py:744
Method__init__
(self)
tests/test_chromium.py:2039
Method__init__
(self, page_content, metadata=None)
tests/test_fetch_node_timeout.py:36
Method__init__
(self, source)
tests/test_fetch_node_timeout.py:44
Method__init__
(self, source)
tests/test_fetch_node_timeout.py:167
Method__init__
(self, answer)
tests/test_csv_scraper_multi_graph.py:15
Method__init__
(self, nodes, edges, entry_point, graph_name)
tests/test_csv_scraper_multi_graph.py:34
Method__init__
(self)
tests/test_csv_scraper_multi_graph.py:124
Method__init__
(self, final_state)
tests/test_omni_search_graph.py:9
Method__init__
(self, final_state, execution_info)
tests/test_script_creator_multi_graph.py:18
Method__init__
(self, value)
tests/utils/copy_utils_test.py:13
Method__init__
(self, value)
tests/utils/copy_utils_test.py:19
Method__init__
(self, value)
tests/utils/copy_utils_test.py:29
Method__init__
(self, value)
tests/utils/copy_utils_test.py:42
Method__init__
(self, prompt: str, config: dict)
tests/graphs/abstract_graph_test.py:79
Method__init__
Initialize rate limit helper. Args: max_requests: Maximum number of requests allowed time_window: Time window in seco
tests/fixtures/helpers.py:348
Method__init__
Initialize the benchmark tracker. Args: output_dir: Directory to save benchmark results
tests/fixtures/benchmarking.py:55
Method__init__
(self, host: str = "localhost", port: int = 8888)
tests/fixtures/mock_server/server.py:314
Method__new__
(cls, **llm_config)
scrapegraphai/models/nvidia.py:20
Method__or__
(self, other)
tests/test_generate_answer_node.py:64
Method__repr__
(self)
scrapegraphai/utils/custom_callback.py:57
Method_async_run
(graph)
scrapegraphai/nodes/graph_iterator_node.py:129
Function_base_model_v1_output_parser
Parse the output of an LLM when the schema is BaseModelv1. Args: x (BaseModelV1): The output from the LLM model. Returns:
scrapegraphai/utils/output_parser.py:54
Function_base_model_v2_output_parser
Parse the output of an LLM when the schema is BaseModelv2. Args: x (BaseModelV2): The output from the LLM model. Returns:
scrapegraphai/utils/output_parser.py:77
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping with images. Returns: BaseGraph: A graph instance
scrapegraphai/graphs/screenshot_scraper_graph.py:44
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/search_link_graph.py:46
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping and searching. Returns: BaseGraph: A graph instanc
scrapegraphai/graphs/smart_scraper_multi_graph.py:64
Method_create_graph
(self)
scrapegraphai/graphs/smart_scraper_multi_batch_graph.py:40
Method_create_graph
Creates the graph of nodes for the batch scraping pipeline. The graph has two phases: 1. GraphIteratorNode runs _FetchParseOnlyGraph
scrapegraphai/graphs/smart_scraper_multi_batch_graph.py:145
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping and searching. Returns: BaseGraph: A graph instanc
scrapegraphai/graphs/json_scraper_multi_graph.py:57
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/xml_scraper_graph.py:57
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping and searching, including a ConditionalNode to decide between me
scrapegraphai/graphs/smart_scraper_multi_concat_graph.py:61
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/depth_search_graph.py:67
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/omni_scraper_graph.py:62
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/code_generator_graph.py:69
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/smart_scraper_graph.py:72
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping.
scrapegraphai/graphs/csv_scraper_graph.py:65
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping and audio generation. Returns: BaseGraph: A graph
scrapegraphai/graphs/speech_graph.py:60
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/smart_scraper_lite_graph.py:53
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping and searching. Returns: BaseGraph: A graph instanc
scrapegraphai/graphs/document_scraper_multi_graph.py:57
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/script_creator_graph.py:59
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/json_scraper_graph.py:55
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping. Returns: BaseGraph: A graph instance representing
scrapegraphai/graphs/document_scraper_graph.py:57
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping and searching. Returns: BaseGraph: A graph instanc
scrapegraphai/graphs/xml_scraper_multi_graph.py:56
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping and parsing and then merge the content and generates answers to
scrapegraphai/graphs/smart_scraper_multi_lite_graph.py:62
Method_create_graph
Creates the graph of nodes representing the workflow for web scraping and searching. Returns: BaseGraph: A graph instanc
scrapegraphai/graphs/search_graph.py:56
Method_create_graph
(self)
tests/graphs/abstract_graph_test.py:82
Function_dict_output_parser
Parse the output of an LLM when the schema is TypedDict or JsonSchema. Args: x (dict): The output from the LLM model. Returns:
scrapegraphai/utils/output_parser.py:90
Function_send_telemetry
Send telemetry payload to the tracing endpoint.
scrapegraphai/telemetry/telemetry.py:125
Methodalazy_load
Asynchronously yield Documents, fetching all URLs concurrently.
scrapegraphai/docloaders/plasmate.py:183
Methodaload
Load all documents asynchronously.
scrapegraphai/docloaders/chromium.py:442
Functionalways_value_error
(url, browser_name="chromium")
tests/test_chromium.py:1908
Methodalways_verbose
Whether to call verbose callbacks even if verbose is False.
scrapegraphai/utils/custom_callback.py:67
Functionanthropic_config
Anthropic Claude configuration for testing.
tests/conftest.py:93
Methodappend_node
Add a node to the graph. Args: node (BaseNode): The node to add to the graph.
scrapegraphai/graphs/abstract_graph.py:296
Functionassert_no_errors_in_result
Assert that the result doesn't contain common error indicators. Args: result: The result to check
tests/fixtures/helpers.py:59
Functionassert_response_time_acceptable
Assert that response time is within acceptable limits. Args: execution_time: Actual execution time in seconds max_time: Maximum a
tests/fixtures/helpers.py:47
Functionazure_config
Azure OpenAI configuration for testing.
tests/conftest.py:123
Functionbenchmark
Benchmark a function with multiple runs. Args: func: Function to benchmark name: Name for the benchmark (defaults to function nam
tests/fixtures/benchmarking.py:163
Functionbenchmark_config
Configuration for performance benchmarking.
tests/conftest.py:312
Functionbenchmark_tracker
Pytest fixture for benchmark tracking.
tests/fixtures/benchmarking.py:226
Methodbuild_graph
Executes the graph creation process based on the user prompt and returns the graph configuration. Returns: dict
scrapegraphai/builders/graph_builder.py:126
Methodcan_make_request
Check if a new request can be made. Returns: True if request is allowed
tests/fixtures/helpers.py:359
← previousnext →301–400 of 904, ranked by callers