MCPcopy Create free account

hub / github.com/IPADS-SAI/MobiAgent / functions

Functions923 in github.com/IPADS-SAI/MobiAgent

⨍ Functions 923◇ Types & classes 124↳ Endpoints 16
↓ 1 callersMethodanalyzeScreenForSearchBox
(AccessibilityNodeInfo rootNode)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:2323
↓ 1 callersFunctionanalyze_task
分析任务是单阶段还是多阶段 Args: task_description: 任务描述 planner_client: Planner客户端 planner_model: Planner模型名称 experie
runner/mobiagent/multi_task/planner.py:215
↓ 1 callersMethodannotate
Draws bounding boxes on the frame using the detections provided. Args: scene (np.ndarray): The image on which the boundi
utils/box_annotator.py:45
↓ 1 callersMethodannotate
Draws bounding boxes on the frame using the detections provided. Args: scene (np.ndarray): The image on which the boundi
agent_rr/omniparser/box_annotator.py:45
↓ 1 callersMethodappStart
启动指定包名的应用（增强版 - 处理特殊应用） @param context 上下文对象 @param packageName 应用包名 @throws Exception 启动失败时抛出异常，成功时返回成功信息
app/app/src/main/java/com/mobi/agent/monitoru2.java:133
↓ 1 callersMethodapp_stop
Stop an application by package name
collect/manual/device.py:25
↓ 1 callersFunctionassign_bounds_to_layers
使用贪心算法将bounds分配到不同的图层，避免文本重叠
collect/auto/draw_bounds.py:23
↓ 1 callersFunctionauto_annotate
(root, chain, task_description, actions)
collect/annotate.py:318
↓ 1 callersFunctionbalance_embedding
(entries)
agent_rr/train/prepare_data.py:112
↓ 1 callersMethodbindScreenCaptureService
绑定截图服务
app/app/src/main/java/com/mobi/agent/monitoru2.java:76
↓ 1 callersMethodbindToScreenCaptureService
绑定到屏幕截图服务
app/app/src/main/java/com/mobi/agent/ScreenshotManager.java:133
↓ 1 callersMethodcaptureScreenshot
直接截图（复用现有的VirtualDisplay）
app/app/src/main/java/com/mobi/agent/ScreenCaptureService.java:420
↓ 1 callersFunctionchange_auto_data
(data_log_path, index)
collect/auto/server.py:415
↓ 1 callersFunctionchange_task_description
(app_name, original_task)
collect/annotate.py:86
↓ 1 callersMethodcheck
(self, action, step)
agent_rr/action_cache/tree.py:123
↓ 1 callersMethodcheckForScreenshotIndicator
(AccessibilityNodeInfo node)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:3558
↓ 1 callersMethodcheckForSystemUIInterference
()
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:1111
↓ 1 callersFunctioncheckMousePositionAfterRefresh
()
collect/manual/static/js/script.js:1558
↓ 1 callersMethodcheckNodeForScreenshotText
(AccessibilityNodeInfo node, String[] indicators, int depth)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:3571
↓ 1 callersMethodcheck_done
(self)
agent_rr/run_experiment.py:113
↓ 1 callersFunctioncheck_ocr_box
(image_source: Union[str, Image.Image], display_img = True, output_bb_format='xywh', goal_filtering=None, easy
utils/omni_utils.py:488
↓ 1 callersFunctioncheck_ocr_box
(image_source: Union[str, Image.Image], display_img = True, output_bb_format='xywh', easyocr_args=None, use_pa
agent_rr/omniparser/utils.py:467
↓ 1 callersMethodcleanup
清理资源
app/app/src/main/java/com/mobi/agent/ScreenshotManager.java:254
↓ 1 callersMethodclearChat
清空聊天记录
app/app/src/main/java/com/mobi/agent/MainActivity.java:1730
↓ 1 callersMethodclear_all_memories
尝试清空当前 user 的所有记忆。返回成功删除的条数（尽力而为）。 若底层不支持删除，将记录日志并返回0。
runner/mobiagent/user_preference_extractor.py:240
↓ 1 callersFunctioncloseHistoryModal
()
collect/manual/static/js/script.js:934
↓ 1 callersFunctioncombine_context
结合experience和用户偏好 Args: experience_content: 经验内容 user_preferences: 用户偏好 Returns: 增强的上下文
runner/mobiagent/user_preference_extractor.py:360
↓ 1 callersFunctioncompare_actions
(actions, reacts)
collect/annotate.py:40
↓ 1 callersMethodcompute_logits
(self, inputs)
agent_rr/action_cache/reranker.py:44
↓ 1 callersMethodconfigure
配置日志系统 Args: level: 日志级别 use_colors: 是否使用颜色输出 show_time: 是否显示时间 show_module: 是否显示模块名
MobiFlow/avdag/logger.py:210
↓ 1 callersFunctionconstruct_ds
(data_path, single_step_data_path, unexpected_img_path, out_path, factor=0.5, train_ratio=0.9, e2e=False, do_c
collect/construct_sft.py:494
↓ 1 callersFunctionconstruct_ss_data
(single_step_data_path, out_path, factor=0.5, train_ratio=0.9, do_copy=True, use_qwen3=False)
collect/construct_sft.py:199
↓ 1 callersFunctioncontinueWithNextDataCollection
()
collect/manual/static/js/script.js:1167
↓ 1 callersFunctioncreateElementOverlay
()
collect/manual/static/js/script.js:1395
↓ 1 callersMethodcreateHttpClient
()
app/app/src/main/java/com/mobi/agent/MainActivity.java:169
↓ 1 callersMethodcreateNotificationChannel
()
app/app/src/main/java/com/mobi/agent/ScreenCaptureService.java:106
↓ 1 callersFunctioncreate_device
Factory function to create device instance Args: device_type: "Android" or "Harmony" adb_endpoint: ADB endpoint for Android d
collect/manual/device.py:413
↓ 1 callersFunctioncreate_frame_ocr_function
创建适用于Frame的OCR函数，用于集成到VerifierOptions中 Args: processor: 高级OCR处理器实例 Returns: callable: 接受Frame参数的OCR函数
utils/advanced_ocr.py:541
↓ 1 callersFunctioncreate_frame_texts_function
创建适用于Frame的文本列表提取函数 Args: processor: 高级OCR处理器实例 Returns: callable: 接受Frame参数，返回文本列表的函数
utils/advanced_ocr.py:608
↓ 1 callersFunctioncreate_grounder_entries_for_one_trace
(react_data, actions, root, data_path, out_path, factor, rules, is_train, do_copy=False, use_qwen3=False)
collect/construct_sft.py:317
↓ 1 callersFunctioncreate_standard_ocr_functions
()
MobiFlow/avdag/ocr_processor.py:80
↓ 1 callersFunctioncreate_swipe_visualization
为滑动动作创建可视化图像
runner/mobiagent/multi_task/executor.py:105
↓ 1 callersMethodcreate_task_directory
创建任务目录 Args: app_name: 应用名称 task_type: 任务类型 task_index: 任务索引 Returns:
runner/UI-TARS-agent/batch_task_executor.py:281
↓ 1 callersFunctiondeleteCurrentData
()
collect/manual/static/js/script.js:963
↓ 1 callersFunctiondetect_icons_simple
简化的图标检测接口 Args: image: 目标图像 icon_names: 图标名称列表 app_id: 应用ID threshold: 相似度阈值 match_mode: 匹配模式 ('
utils/icon_detection.py:567
↓ 1 callersFunctiondisplayElementInfo
(elements)
collect/manual/static/js/script.js:1323
↓ 1 callersFunctiondisplayHistoryModal
(actions, totalCount)
collect/manual/static/js/script.js:826
↓ 1 callersFunctiondo_task
(task_description, data_dir)
collect/auto/server.py:186
↓ 1 callersFunctiondraw_bounds_on_screenshot
在截图上绘制所有bounds并保存
collect/auto/draw_bounds.py:74
↓ 1 callersMethodexecute
(self, task_description)
agent_rr/action_cache/tree.py:392
↓ 1 callersMethodexecuteAppStartCommand
执行应用启动命令 @param currentItem 当前指令项 @param currentAction 当前动作信息 @param responseBuilder 响应构建器 @return 是否执行成功
app/app/src/main/java/com/mobi/agent/MainActivity.java:2252
↓ 1 callersMethodexecuteClickCommand
执行点击命令
app/app/src/main/java/com/mobi/agent/MainActivity.java:1312
↓ 1 callersMethodexecuteInputCommand
执行输入命令
app/app/src/main/java/com/mobi/agent/MainActivity.java:1372
↓ 1 callersMethodexecuteSwipeCommand
执行滑动命令
app/app/src/main/java/com/mobi/agent/MainActivity.java:1433
↓ 1 callersMethodexecute_all_tasks
执行所有任务 Args: task_file: 任务文件路径
runner/UI-TARS-agent/batch_task_executor.py:672
↓ 1 callersFunctionexecute_multi_stage_task_internal
内部函数：执行多阶段任务（不创建新的任务目录） Args: task_description: 任务描述 device: 设备对象 task_dir: 任务目录（已创建） extract_config: Ar
runner/mobiagent/multi_task/mobiagent_refactored.py:364
↓ 1 callersMethodexecute_single_task
执行单个任务 Args: app_name: 应用名称 task_type: 任务类型 (type1, type2, ...) task_index: 任务索引 (1, 2, 3, ...)
runner/UI-TARS-agent/batch_task_executor.py:506
↓ 1 callersFunctionexecute_task
统一的任务执行入口 自动分析任务类型并选择合适的执行策略 Args: task_description: 用户的原始任务描述 device: 设备对象 base_data_dir: 数据存储基础目录
runner/mobiagent/multi_task/mobiagent_refactored.py:208
↓ 1 callersFunctionextract_all_bounds
从hierarchy.xml中提取所有bounds
utils/parse_xml.py:24
↓ 1 callersFunctionextract_artifact
从子任务输出中提取artifact Args: subtask_id: 子任务ID subtask_description: 子任务描述 artifact_schema: 需要提取的字段定义 subtask_
runner/mobiagent/multi_task/planner.py:327
↓ 1 callersMethodextract_async
异步提取用户偏好 Args: task_data: 任务数据，包含task_description, actions, reacts等
runner/mobiagent/user_preference_extractor.py:108
↓ 1 callersFunctionextract_json_from_response
(response_content: str)
collect/annotate.py:270
↓ 1 callersFunctionextract_json_from_text
从文本中提取JSON内容，处理包含```json标记的情况
MobiFlow/avdag/verifier.py:740
↓ 1 callersMethodextract_target_elem
(self, screen, parser)
agent_rr/action_cache/action.py:37
↓ 1 callersFunctionextract_text_from_xml_simple
从XML内容中使用正则表达式简单提取文字（备用方案） Args: xml_content: XML文件内容字符串 Returns: ProcessedText: 处理后的文本结果
utils/advanced_ocr.py:496
↓ 1 callersMethodfindAllEditableElements
(AccessibilityNodeInfo node, List<AccessibilityNodeInfo> editableNodes)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:1912
↓ 1 callersMethodfindAllInputElementsDeep
(AccessibilityNodeInfo node, List<AccessibilityNodeInfo> inputs, int depth)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:1062
↓ 1 callersMethodfindAndActivateEditableElement
(AccessibilityNodeInfo node, String text)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:1931
↓ 1 callersMethodfindAndCloseApp
在最近任务中查找并关闭应用
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:431
↓ 1 callersMethodfindClickableNodesInQuickSettings
(AccessibilityNodeInfo node, List<AccessibilityNodeInfo> clickableNodes)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:3308
↓ 1 callersMethodfindEditableElementRecursively
(AccessibilityNodeInfo node, String text, int depth)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:1944
↓ 1 callersMethodfindFocusedEditTextRecursive
(AccessibilityNodeInfo node, int depth)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:996
↓ 1 callersMethodfindLikelyFocusedInput
(AccessibilityNodeInfo node)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:941
↓ 1 callersMethodfindSearchBoxRecursively
(AccessibilityNodeInfo node, int depth)
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:2329
↓ 1 callersFunctionfind_clicked_element
(hierarchy_xml, click_x, click_y)
utils/parse_xml.py:53
↓ 1 callersFunctionfind_clicked_element
找到包含点击位置的最合适边界框，增加容错和扩展机制 Args: bounds_list: 边界框列表 click_x, click_y: 点击坐标 expand_ratio: 边界框扩展比例（默认5%） ne
utils/parse_omni.py:99
↓ 1 callersMethodforceCloseCurrentApp
强制关闭当前应用进程 @return 是否成功执行
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:376
↓ 1 callersMethodforceReauthorization
强制重新授权（清理当前权限状态）
app/app/src/main/java/com/mobi/agent/ScreenshotManager.java:224
↓ 1 callersFunctionformat_yaml_with_brackets
格式化YAML输出，确保特定数组字段使用方括号格式 Args: config: 配置字典 Returns: 格式化后的YAML字符串
MobiFlow/auto_rules/main.py:33
↓ 1 callersMethodgenerate_config_from_prompt
根据完整的提示词生成配置 Args: prompt: 完整的LLM提示词 Returns: 生成的配置字典或原始文本
MobiFlow/auto_rules/llm_generator.py:39
↓ 1 callersFunctiongenerate_llm_prompt
生成发送给 LLM 的提示词（使用共享的提示词模块）
MobiFlow/auto_rules/main.py:117
↓ 1 callersFunctiongenerate_plan
生成多阶段任务计划 Args: task_description: 任务描述 planner_client: Planner客户端 planner_model: Planner模型名称 experience_
runner/mobiagent/multi_task/planner.py:267
↓ 1 callersMethodgenerate_shortcuts
(self)
agent_rr/action_cache/tree.py:375
↓ 1 callersFunctiongenerate_user_prompt
生成用户提示词 Args: task_descriptions: 任务描述列表 template_yaml: 参考模版YAML内容 app_name: 应用名称 Returns: 完
MobiFlow/auto_rules/prompts.py:95
↓ 1 callersMethodgetEventTypeName
获取事件类型的可读名称
app/app/src/main/java/com/mobi/agent/MyAccessibilityService.java:76
↓ 1 callersMethodgetMainActivityName
获取应用的主Activity名称 @param packageName 包名 @return Activity名称，失败返回null
app/app/src/main/java/com/mobi/agent/monitoru2.java:178
↓ 1 callersMethodgetReasoning
()
app/app/src/main/java/com/mobi/agent/Message.java:31
↓ 1 callersMethodgetScreenInfo
()
app/app/src/main/java/com/mobi/agent/ScreenCaptureService.java:188
↓ 1 callersMethodget_agent_input
(self, history, task_description)
agent_rr/agent/env.py:13
↓ 1 callersMethodget_all_paths_to_targets
获取从根节点到目标节点的所有可能路径
MobiFlow/avdag/dag.py:122
↓ 1 callersFunctionget_app_package_name
单阶段：本地检索经验，调用模型完成应用选择和任务描述生成。
runner/mobiagent/mobiagent.py:889
↓ 1 callersFunctionget_app_package_name
单阶段任务：本地检索经验，调用模型完成应用选择和任务描述生成 Args: task_description: 原始任务描述 planner_client: Planner客户端 planner_model: Planner模
runner/mobiagent/multi_task/planner.py:130
↓ 1 callersFunctionget_app_package_name
结合经验检索和任务描述改写，获取应用包名和最终任务描述
collect/auto/server.py:142
↓ 1 callersMethodget_app_package_name_by_ai
使用AI结合经验检索和任务描述改写，获取应用包名和最终任务描述（参考mobiagent） Args: task_description: 任务描述 Returns: (pack
runner/UI-TARS-agent/batch_task_executor.py:161
↓ 1 callersFunctionget_app_packages
Get app packages for specific device type
collect/manual/server.py:510
↓ 1 callersFunctionget_caption_model_processor
(model_name, model_name_or_path="Salesforce/blip2-opt-2.7b", device=None)
agent_rr/omniparser/utils.py:32
↓ 1 callersFunctionget_current_hierarchy_and_screenshot
(action_dir, sleep_time = 0)
collect/auto/server.py:34
↓ 1 callersFunctionget_frame_logger
获取帧处理日志器
MobiFlow/avdag/logger.py:396
↓ 1 callersMethodget_icon_detection_config
获取图标检测配置
utils/config.py:197
↓ 1 callersFunctionget_llm_logger
获取LLM调用日志器
MobiFlow/avdag/logger.py:392
← previousnext →301–400 of 923, ranked by callers