MCPcopy Create free account

hub / github.com/ScrapeGraphAI/Scrapegraph-ai / functions

Functions904 in github.com/ScrapeGraphAI/Scrapegraph-ai

↓ 1 callersMethodhandle_local_source
Handles the local source by fetching HTML content, optionally converting it to Markdown, and updating the state. Parameters:
scrapegraphai/nodes/fetch_node.py:223
↓ 1 callersMethodhandle_web_source
Handles the web source by fetching HTML content from a URL, optionally converting it to Markdown, and updating the state. Pa
scrapegraphai/nodes/fetch_node.py:266
↓ 1 callersFunctionis_boto3_client
Function for understanding if the script is using boto3 or not
scrapegraphai/utils/copy.py:17
↓ 1 callersMethodload_file_content
Loads the content of a file based on its input type. Parameters: source (str): The path to the source file. input_ty
scrapegraphai/nodes/fetch_node.py:171
↓ 1 callersFunctionlog_event
(event: str, properties: Dict[str, any])
scrapegraphai/telemetry/telemetry.py:155
↓ 1 callersFunctionmain
()
examples/extras/authenticated_playwright.py:48
↓ 1 callersFunctionmain
()
examples/extras/chromium_selenium.py:88
↓ 1 callersFunctionnormalize_list
Recursively normalizes the values in a list. Args: lst (List[Any]): The list to normalize. Returns: List[Any]: A normal
scrapegraphai/utils/dict_content_compare.py:39
↓ 1 callersMethodobtain_content
Iterates through documents, fetching and updating content recursively. Args: documents (List): A list of documents conta
scrapegraphai/nodes/fetch_node_level_k.py:234
↓ 1 callersMethodoverall_reasoning_loop
Executes the overall reasoning loop to generate and validate the code. Args: state (dict): The current state of the reas
scrapegraphai/nodes/generate_code_node.py:145
↓ 1 callersFunctionparse_boolean_expression
Parse a boolean expression to extract the keys used in the expression, without boolean operators. Args: expression (str): The bo
scrapegraphai/integrations/burr_bridge.py:76
↓ 1 callersFunctionparse_expression
Parses a complex boolean expression involving state keys. Args: expression (str): The boolean expression to parse. state (di
scrapegraphai/utils/parse_state_keys.py:8
↓ 1 callersFunctionpoll_batch_until_complete
Poll a batch job until it completes, fails, or times out. Args: client: An initialized OpenAI client. batch_id: The batch ID to p
scrapegraphai/utils/batch_api.py:190
↓ 1 callersMethodprocess_image
async process image
scrapegraphai/nodes/generate_answer_from_image_node.py:29
↓ 1 callersFunctionprocess_properties
(properties)
scrapegraphai/utils/schema_trasform.py:17
↓ 1 callersMethodquit
(self)
tests/test_chromium.py:305
↓ 1 callersFunctionrecursive_dict_parser
(work_dict: dict)
scrapegraphai/utils/output_parser.py:66
↓ 1 callersMethodrun
Executes the scraping process and returns the answer to the prompt. Returns: str: The answer to the prompt.
scrapegraphai/graphs/screenshot_scraper_graph.py:71
↓ 1 callersMethodrun
Executes the scraping process and returns the answer to the prompt. Returns: str: The answer to the prompt.
scrapegraphai/graphs/search_link_graph.py:92
↓ 1 callersMethodrun
Executes the scraping process and returns the answer to the prompt. Returns: str: The answer to the prompt.
scrapegraphai/graphs/omni_scraper_graph.py:124
↓ 1 callersMethodrun
Executes the web scraping process and returns the answer to the prompt. Returns: str: The answer to the prompt.
scrapegraphai/graphs/script_creator_graph.py:114
↓ 1 callersMethodrun
(self, state: State, **run_kwargs)
scrapegraphai/integrations/burr_bridge.py:60
↓ 1 callersMethodrun_safe_async
Executes the run process asynchronously safety. Returns: str: The answer to the prompt.
scrapegraphai/graphs/abstract_graph.py:332
↓ 1 callersFunctionsanitize_search_query
Sanitizes search query to prevent injection attacks. Args: query (str): The search query. Returns: str: Sanitized query
scrapegraphai/utils/research_web.py:122
↓ 1 callersFunctionsave_audio_from_bytes
Saves the byte response as an audio file to the specified path. Args: byte_response (bytes): The byte array containing audio data.
scrapegraphai/utils/save_audio_from_bytes.py:9
↓ 1 callersFunctionsave_code_to_file
Saves the generated code to a Python file. Args: code (str): The generated code to be saved. filename (str): name of the out
scrapegraphai/utils/save_code_to_file.py:6
↓ 1 callersMethodsave_results
Save all benchmark results to a JSON file. Args: filename: Name of the output file
tests/fixtures/benchmarking.py:100
↓ 1 callersFunctionsearch_all
(proxybroker: FreeProxy, k: int, search_outside: bool)
scrapegraphai/utils/proxy_rotation.py:89
↓ 1 callersFunctionselect_area_with_opencv
Allows you to manually select an image area using OpenCV. It is recommended to use this function if your project is on your computer, oth
scrapegraphai/utils/screenshot_scraping/screenshot_preparation.py:44
↓ 1 callersMethodsemantic_comparison
Performs a semantic comparison between the generated result and the reference result. Args: generated_result (Any): The
scrapegraphai/nodes/generate_code_node.py:362
↓ 1 callersMethodsemantic_comparison_loop
Executes the semantic comparison loop to ensure the generated code's output is semantically equivalent to the reference answer.
scrapegraphai/nodes/generate_code_node.py:298
↓ 1 callersFunctionsemantic_focused_analysis
Analyzes the semantic differences in the generated code based on a comparison result. Args: state (dict): Contains the 'generated_co
scrapegraphai/utils/code_error_analysis.py:275
↓ 1 callersFunctionsemantic_focused_code_generation
Generates corrected code based on semantic error analysis. Args: state (dict): Contains the 'generated_code', 'execution_result', an
scrapegraphai/utils/code_error_correction.py:251
↓ 1 callersFunctionset_handler
Add a handler to the root logger for the library. Args: handler (logging.Handler): The handler to add.
scrapegraphai/utils/logging.py:136
↓ 1 callersFunctionset_verbosity_warning
Set the verbosity level of the root logger for the library to WARNING.
scrapegraphai/utils/logging.py:115
↓ 1 callersMethodsyntax_check
Checks the syntax of the provided code. Args: code (str): The code to be checked for syntax errors. Returns:
scrapegraphai/nodes/generate_code_node.py:419
↓ 1 callersFunctionsyntax_focused_analysis
Analyzes the syntax errors in the generated code. Args: state (dict): Contains the 'generated_code' and 'errors' related to syntax.
scrapegraphai/utils/code_error_analysis.py:106
↓ 1 callersFunctionsyntax_focused_code_generation
Generates corrected code based on syntax error analysis. Args: state (dict): Contains the 'generated_code'. analysis (str):
scrapegraphai/utils/code_error_correction.py:86
↓ 1 callersMethodsyntax_reasoning_loop
Executes the syntax reasoning loop to ensure the generated code has correct syntax. Args: state (dict): The current stat
scrapegraphai/nodes/generate_code_node.py:206
↓ 1 callersFunctiontake_screenshot
Takes a screenshot of a webpage at the specified URL and saves it if the save_path is specified. Parameters: url (str): The URL of th
scrapegraphai/utils/screenshot_scraping/screenshot_preparation.py:15
↓ 1 callersFunctionunset_handler
Remove a handler from the root logger for the library. Args: handler (logging.Handler): The handler to remove.
scrapegraphai/utils/logging.py:157
↓ 1 callersMethodupdate_config
Updates the node_config dictionary as well as attributes with same key. Args: param (dict): The dictionary to update nod
scrapegraphai/nodes/base_node.py:84
↓ 1 callersMethodvalidate_dict
Validates the provided data against the given schema. Args: data (dict): The data to be validated. schema (d
scrapegraphai/nodes/generate_code_node.py:472
↓ 1 callersFunctionvalidation_focused_analysis
Analyzes the validation errors in the generated code based on a JSON schema. Args: state (dict): Contains the 'generated_code', 'err
scrapegraphai/utils/code_error_analysis.py:214
↓ 1 callersFunctionvalidation_focused_code_generation
Generates corrected code based on validation error analysis. Args: state (dict): Contains the 'generated_code' and 'json_schema'.
scrapegraphai/utils/code_error_correction.py:192
↓ 1 callersMethodvalidation_reasoning_loop
Executes the validation reasoning loop to ensure the generated code's output matches the desired schema. Args: s
scrapegraphai/nodes/generate_code_node.py:264
Method__aenter__
(self)
tests/test_chromium.py:269
Method__aexit__
(self, exc_type, exc, tb)
tests/test_chromium.py:272
Method__call__
(self, *args, **kwargs)
tests/test_generate_answer_node.py:20
Method__call__
(self, *args, **kwargs)
tests/test_generate_answer_node.py:67
Method__copy__
Return a copy of the callback handler.
scrapegraphai/utils/custom_callback.py:134
Method__copy__
(self)
tests/utils/copy_utils_test.py:35
Method__copy__
(self)
tests/utils/copy_utils_test.py:48
Method__deepcopy__
Return a deep copy of the callback handler.
scrapegraphai/utils/custom_callback.py:138
Method__deepcopy__
(self, memo)
tests/utils/copy_utils_test.py:22
Method__deepcopy__
(self, memo)
tests/utils/copy_utils_test.py:32
Method__deepcopy__
(self, memo)
tests/utils/copy_utils_test.py:45
Method__enter__
Context manager entry.
tests/fixtures/mock_server/server.py:339
Method__exit__
Context manager exit.
tests/fixtures/mock_server/server.py:344
Function__getattr__
(name)
scrapegraphai/docloaders/__init__.py:17
Method__init__
Initialize the loader with a list of URL paths. Args: backend: The web driver backend library; defaults to 'playwright'.
scrapegraphai/docloaders/chromium.py:26
Method__init__
( self, urls: List[str], *, output_format: str = "text", timeout: int
scrapegraphai/docloaders/plasmate.py:84
Method__init__
(self, llm_model_name: str)
scrapegraphai/utils/custom_callback.py:52
Method__init__
Initializes the GraphBuilder with a user prompt and language model configuration.
scrapegraphai/builders/graph_builder.py:44
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/screenshot_scraper_graph.py:35
Method__init__
( self, source: str, config: dict, schema: Optional[Type[BaseModel]] = None )
scrapegraphai/graphs/search_link_graph.py:39
Method__init__
( self, prompt: str, source: List[str], config: dict, schema: Optional
scrapegraphai/graphs/smart_scraper_multi_graph.py:51
Method__init__
( self, prompt: str, source: List[str], config: dict, schema: Optional
scrapegraphai/graphs/smart_scraper_multi_batch_graph.py:119
Method__init__
( self, prompt: str, source: List[str], config: dict, schema: Optional
scrapegraphai/graphs/json_scraper_multi_graph.py:45
Method__init__
( self, prompt: str, config: dict, schema: Optional[Type[BaseModel]] = None )
scrapegraphai/graphs/omni_search_graph.py:44
Method__init__
( self, llm_model, embedder_model=None, node_config: Optional[Dict] = None,
scrapegraphai/graphs/markdownify_graph.py:37
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/xml_scraper_graph.py:46
Method__init__
( self, prompt: str, source: List[str], config: dict, schema: Optional
scrapegraphai/graphs/smart_scraper_multi_concat_graph.py:49
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/depth_search_graph.py:56
Method__init__
( self, nodes: list, edges: list, entry_point: str, use_burr: bool = F
scrapegraphai/graphs/base_graph.py:56
Method__init__
( self, prompt: str, config: dict, source: Optional[str] = None, schem
scrapegraphai/graphs/abstract_graph.py:56
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/omni_scraper_graph.py:49
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/code_generator_graph.py:58
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/smart_scraper_graph.py:58
Method__init__
Initializes the CSVScraperGraph with a prompt, source, and configuration.
scrapegraphai/graphs/csv_scraper_graph.py:51
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/speech_graph.py:49
Method__init__
( self, source: str, config: dict, prompt: str = "", schema: Optional[
scrapegraphai/graphs/smart_scraper_lite_graph.py:42
Method__init__
( self, prompt: str, source: List[str], config: dict, schema: Optional
scrapegraphai/graphs/document_scraper_multi_graph.py:45
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/script_creator_graph.py:46
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/json_scraper_graph.py:44
Method__init__
( self, prompt: str, source: str, config: dict, schema: Optional[Type[
scrapegraphai/graphs/document_scraper_graph.py:46
Method__init__
( self, prompt: str, source: List[str], config: dict, schema: Optional
scrapegraphai/graphs/xml_scraper_multi_graph.py:45
Method__init__
( self, prompt: str, source: List[str], config: dict, schema: Optional
scrapegraphai/graphs/script_creator_multi_graph.py:44
Method__init__
( self, prompt: str, source: List[str], config: dict, schema: Optional
scrapegraphai/graphs/smart_scraper_multi_lite_graph.py:51
Method__init__
( self, prompt: str, source: List[str], config: dict, schema: Optional
scrapegraphai/graphs/csv_scraper_multi_graph.py:45
Method__init__
( self, prompt: str, config: dict, schema: Optional[Type[BaseModel]] = None )
scrapegraphai/graphs/search_graph.py:45
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/image_to_text_node.py:28
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/concat_answers_node.py:25
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/search_node_with_context.py:37
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/search_internet_node.py:34
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/generate_answer_node_k_level.py:49
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/generate_code_node.py:53
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/prompt_refiner_node.py:33
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/robots_node.py:39
Method__init__
( self, input: str, output: List[str], node_config: Optional[dict] = None,
scrapegraphai/nodes/parse_node_depth_k_node.py:29
← previousnext →201–300 of 904, ranked by callers