Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/omkarcloud/botasaurus
/ functions
Functions
1,906 in github.com/omkarcloud/botasaurus
⨍
Functions
1,906
◇
Types & classes
224
↳
Endpoints
23
↓ 1 callers
Function
perform_is_task_updated
(task_id)
botasaurus_server/botasaurus_server/routes_db_logic.py:184
↓ 1 callers
Function
play_beep
()
botasaurus/beep_utils.py:3
↓ 1 callers
Method
pollForTasks
* Poll master for tasks. Checks capacity and makes appropriate API call. * Uses mutex to ensure only one concurrent request to master at a time.
js/botasaurus-server-js/src/worker-executor.ts:217
↓ 1 callers
Method
preEnd
()
js/botasaurus-server-js/src/ndjson-http.ts:30
↓ 1 callers
Method
preEnd
()
js/botasaurus-server-js/src/ndjson.ts:57
↓ 1 callers
Method
preStart
(headers: string[])
js/botasaurus-server-js/src/ndjson-http.ts:64
↓ 1 callers
Function
printFilenames
(writtenFilenames: string[])
js/botasaurus-js/src/decorators-common.ts:22
↓ 1 callers
Function
print_filenames
(written_filenames)
botasaurus/decorators_common.py:174
↓ 1 callers
Method
processScraperBasedTasks
()
js/botasaurus-server-js/src/task-executor.ts:252
↓ 1 callers
Method
processScraperTypeBasedTasks
()
js/botasaurus-server-js/src/task-executor.ts:234
↓ 1 callers
Method
processTasksByScraper
(scraperName: string)
js/botasaurus-server-js/src/task-executor.ts:289
↓ 1 callers
Function
project_exists
(project_id)
bota/src/bota/__main__.py:268
↓ 1 callers
Method
push
(data: any)
js/botasaurus-server-js/src/ndjson-http.ts:49
↓ 1 callers
Method
push
(data: string[])
js/botasaurus-server-js/src/ndjson-http.ts:69
↓ 1 callers
Method
push
(data: any)
js/botasaurus-server-js/src/ndjson.ts:77
↓ 1 callers
Method
put
(key: string, item: any)
js/botasaurus-server-js/src/task-results.ts:83
↓ 1 callers
Function
queryPendingTasks
(maxTasks: number | null, query: any)
js/botasaurus-server-js/src/task-executor.ts:31
↓ 1 callers
Function
queryTasks
( ets: string[], withResults: boolean, page?: any, per_page?: any, serializer: (task: any, withResul
js/botasaurus-server-js/src/routes-db-logic.ts:96
↓ 1 callers
Method
raiseTypeValidationErrorMessage
(type: string, value: any, control: any)
botasaurus-controls/src/index.ts:1210
↓ 1 callers
Function
readExcelFile
(filePath:string)
js/botasaurus-js/src/output.ts:462
↓ 1 callers
Function
readIdFromFile
()
js/botasaurus-server-js/src/models.ts:36
↓ 1 callers
Function
readNdJson
(taskPath: string, limit: number | null | undefined=null)
js/botasaurus-server-js/src/ndjson.ts:106
↓ 1 callers
Method
read_clean_save_task
(parent_id, remove_duplicates_by, status)
botasaurus_server/botasaurus_server/task_helper.py:187
↓ 1 callers
Function
read_csv
Reads a CSV file and returns a list of dictionaries. :param filepath: str, the path to the CSV file :return: list of dictionaries
botasaurus/output.py:142
↓ 1 callers
Function
read_excel
(filename)
botasaurus/output.py:420
↓ 1 callers
Function
read_file
(path)
bota/src/bota/apache_utils.py:4
↓ 1 callers
Function
read_file
(filename)
botasaurus/output.py:322
↓ 1 callers
Function
read_html
(filename)
botasaurus/output.py:297
↓ 1 callers
Method
refresh
(self)
bota/src/bota/package_storage.py:30
↓ 1 callers
Method
refresh
()
js/botasaurus-js/src/botasaurus-storage.ts:32
↓ 1 callers
Method
refresh
()
js/botasaurus-js/src/botasaurus-storage.ts:93
↓ 1 callers
Method
refresh
(self)
botasaurus/botasaurus_storage.py:36
↓ 1 callers
Method
refresh
(self)
botasaurus/local_storage.py:29
↓ 1 callers
Function
registerHealthEndpoint
* Register health endpoint
js/botasaurus-server-js/src/api-config.ts:452
↓ 1 callers
Function
registerMasterRoutes
* Register Kubernetes master routes
js/botasaurus-server-js/src/api-config.ts:372
↓ 1 callers
Function
relativePath
(targetPath: string, goback: number = 0)
js/botasaurus-desktop-api/src/utils.ts:36
↓ 1 callers
Function
relative_path
(path, goback=0)
bota/src/bota/__main__.py:16
↓ 1 callers
Function
relative_path
(target_path, goback=0)
botasaurus_api/botasaurus_api/utils.py:21
↓ 1 callers
Function
relative_path
(path, goback=0)
botasaurus/decorators_utils.py:3
↓ 1 callers
Function
relative_path
(path, goback=0)
botasaurus_server/botasaurus_server/server.py:10
↓ 1 callers
Function
relative_path_backend
Determines the relative path to the database file, prioritizing 'backend/db.sqlite3'.
botasaurus_server/botasaurus_server/db_setup.py:21
↓ 1 callers
Function
removeAfterFirstSlash
* Removes everything after (and including) the first single slash (/) in a string, * but skips over '//' (double slashes), which are used in protocol
js/botasaurus-server-js/src/api-config.ts:725
↓ 1 callers
Function
removeAfterFirstSlash
* Removes everything after (and including) the first single slash (/) in a string, * but skips over '//' (double slashes), which are used in protocol
js/botasaurus-desktop-api/src/utils.ts:15
↓ 1 callers
Method
removeFromAbortCheck
* Removes a task from the abortion check set and cleans up if no more tasks.
js/botasaurus-server-js/src/task-executor.ts:372
↓ 1 callers
Function
removeSingleSync
(folderPath:string)
js/botasaurus-js/src/utils.ts:79
↓ 1 callers
Function
removeSync
(folderPaths: string | string[])
js/botasaurus-js/src/utils.ts:94
↓ 1 callers
Function
remove_after_first_slash
(input_string)
botasaurus_api/botasaurus_api/utils.py:4
↓ 1 callers
Function
remove_apache_proxy_config
Removes proxy configuration for a specific root path from Apache config. Args: root_path (str): The root path to remove from Apa
bota/src/bota/apache_utils.py:51
↓ 1 callers
Method
remove_item
(self, item: str)
bota/src/bota/package_storage.py:82
↓ 1 callers
Function
remove_service
removes a systemd service. Args: service_name (str): Name of the service (with .service extension)
bota/src/bota/vm.py:603
↓ 1 callers
Function
reorganize_dict_by_importance
(input_dict)
botasaurus/ip_utils.py:49
↓ 1 callers
Function
replaceFileTypesInCode
* Replaces FileTypes constants (e.g., FileTypes.IMAGE) in a string of code * with their corresponding JSON array values. * * @param {string} code -
js/botasaurus-server-js/src/server.ts:58
↓ 1 callers
Function
replace_require_with_json
Replaces require statements with a specified JSON object in the given JavaScript code. Args: code (str): The JavaScript code
botasaurus_server/botasaurus_server/server.py:26
↓ 1 callers
Method
reportCountUpdate
()
js/botasaurus-server-js/src/task-helper.ts:305
↓ 1 callers
Method
reportTaskSuccess
* Report task success to master and fetch next tasks. * Uses mutex to ensure only one concurrent request to master at a time.
js/botasaurus-server-js/src/worker-executor.ts:247
↓ 1 callers
Function
restoreCapacity
()
js/botasaurus-server-js/src/api-config.ts:164
↓ 1 callers
Method
retryFailedChildTasks
(parentId: number)
js/botasaurus-server-js/src/task-helper.ts:667
↓ 1 callers
Function
retryTask
( taskId: number, is_all_task: boolean, parent_task_id: number | null, )
js/botasaurus-server-js/src/routes-db-logic.ts:1151
↓ 1 callers
Method
retryTask
(taskId: number)
js/botasaurus-server-js/src/task-helper.ts:659
↓ 1 callers
Function
run
()
botasaurus_server/botasaurus_server/run.py:114
↓ 1 callers
Function
runValidation
(id:any, validate: (value: any, otherData: any) => string | string[] | undefined, value: any, data: any)
botasaurus-controls/src/index.ts:1244
↓ 1 callers
Function
run_bot_tests
Main function to run all bot detection tests. Executes various tests to check bypass capabilities against different security systems.
bot_detection_tests.py:60
↓ 1 callers
Function
run_create_cluster_commands
(cluster_name, max_nodes, machine_type)
bota/src/bota/__main__.py:612
↓ 1 callers
Function
run_delete_cluster_commands
(cluster_name)
bota/src/bota/__main__.py:1052
↓ 1 callers
Method
run_task_and_update_state
(self, scraper_type, task_json)
botasaurus_server/botasaurus_server/task_executor.py:127
↓ 1 callers
Method
run_task_on_node
(self, task, node_name)
botasaurus_server/botasaurus_server/k8s.py:75
↓ 1 callers
Method
run_worker_task
(self, task, node_name)
botasaurus_server/botasaurus_server/worker_executor.py:38
↓ 1 callers
Function
safeWrite
(data: string, filePath: string, tempPath: string,)
js/botasaurus-js/src/botasaurus-storage.ts:7
↓ 1 callers
Method
saveCachedTask
(scraperName: string, data: any, result: any,isLarge:boolean)
js/botasaurus-server-js/src/task-results.ts:95
↓ 1 callers
Method
save_cached_task
(scraper_name, data, result)
botasaurus_server/botasaurus_server/task_results.py:61
↓ 1 callers
Method
scroll_into_view_of_element
Scrolls the element into viewport, if not already in it
botasaurus_humancursor/src/botasaurus_humancursor/web_cursor.py:245
↓ 1 callers
Method
section
(label: string, defineControls: (section: SectionControls) => void)
botasaurus-controls/src/index.ts:564
↓ 1 callers
Function
sentenceCase
(string: string)
botasaurus-controls/src/index.ts:56
↓ 1 callers
Function
serializeTaskForRunTask
(obj: Task)
js/botasaurus-server-js/src/models.ts:166
↓ 1 callers
Function
serializeUiDisplayTask
(obj: Task)
js/botasaurus-server-js/src/models.ts:156
↓ 1 callers
Function
serialize_task
(obj, with_result)
botasaurus_server/botasaurus_server/models.py:85
↓ 1 callers
Function
serialize_ui_display_task
(obj)
botasaurus_server/botasaurus_server/models.py:77
↓ 1 callers
Method
setStorage
(storage: Record<string, any>)
js/botasaurus-js/src/botasaurus-storage.ts:104
↓ 1 callers
Method
set_item
(self, item: str, value: any)
botasaurus/local_storage.py:90
↓ 1 callers
Method
setupGracefulShutdown
* Set up graceful shutdown handler on global. * Call global.cleanupWorker() from main.ts exit handlers.
js/botasaurus-server-js/src/worker-executor.ts:508
↓ 1 callers
Function
setup_apache_load_balancer
()
bota/src/bota/vm.py:335
↓ 1 callers
Function
setup_apache_load_balancer_desktop_app
(port, api_base_path)
bota/src/bota/vm.py:780
↓ 1 callers
Function
setup_systemctl
(folder_name, uname)
bota/src/bota/vm.py:350
↓ 1 callers
Function
setup_systemctl_for_data_scraper
(launch_file_path, service_name)
bota/src/bota/vm.py:454
↓ 1 callers
Method
shouldFilter
(filterValue: any)
js/botasaurus-server-js/src/filters.ts:406
↓ 1 callers
Method
should_filter
(self, filter_value)
botasaurus_server/botasaurus_server/filters.py:76
↓ 1 callers
Function
show_help
()
botasaurus_server/botasaurus_server/run.py:15
↓ 1 callers
Function
sitemap
(req, _)
botasaurus/links.py:347
↓ 1 callers
Method
sitemaps
(self)
botasaurus/sitemap.py:207
↓ 1 callers
Function
sleep
* Sleep helper
js/botasaurus-server-js/src/worker-executor.ts:81
↓ 1 callers
Function
sortDictByKeys
(dictionary: Record<string, any>, keys: string[])
js/botasaurus-server-js/src/models.ts:185
↓ 1 callers
Function
split_into_links_and_sitemaps
(content)
botasaurus/sitemap_parser_utils.py:115
↓ 1 callers
Method
start
()
js/botasaurus-server-js/src/task-executor.ts:118
↓ 1 callers
Method
start
(self)
botasaurus_server/botasaurus_server/worker_executor.py:35
↓ 1 callers
Method
startScraperNameBasedWorker
* Worker loop for scraper-name-based rate limiting. * Polls master for tasks by scraper name.
js/botasaurus-server-js/src/worker-executor.ts:155
↓ 1 callers
Method
startScraperTypeBasedWorker
* Worker loop for scraper-type-based rate limiting. * Polls master for tasks by scraper type.
js/botasaurus-server-js/src/worker-executor.ts:135
↓ 1 callers
Method
startStaleTaskRecoveryLoop
()
js/botasaurus-server-js/src/master-executor.ts:99
↓ 1 callers
Method
startTaskWorker
()
js/botasaurus-server-js/src/task-executor.ts:124
↓ 1 callers
Function
stopServer
()
js/botasaurus-server-js/src/api-config.ts:699
↓ 1 callers
Function
stop_desktop_app_services
Removes systemd services associated with a desktop app. Args: package_name (str): Name of the package
bota/src/bota/vm.py:647
← previous
next →
1,101–1,200 of 1,906, ranked by callers