MCPcopy Create free account

hub / github.com/mwmbl/mwmbl / functions

Functions929 in github.com/mwmbl/mwmbl

⨍ Functions 929◇ Types & classes 208↳ Endpoints 48
↓ 1 callersFunctionget_query_rankings
(queries)
mwmbl/rankeval/dataset/get_gold_rankings.py:22
↓ 1 callersMethodget_raw_results
(self, query: str)
mwmbl/tinysearchengine/mmr_rank.py:98
↓ 1 callersMethodget_raw_results
(self, query: str)
mwmbl/tinysearchengine/rank.py:325
↓ 1 callersFunctionget_redirect_no_cookies
(url, max_redirects=5)
mwmbl/indexer/domains/domain_titles.py:17
↓ 1 callersMethodget_stats
(self)
mwmbl/crawler/stats.py:144
↓ 1 callersMethodget_stats_for_domain
(self, host: str)
mwmbl/crawler/stats.py:239
↓ 1 callersFunctionget_stoplist
Returns an built-in stop-list for the language as a set of words.
mwmbl/justext/utils.py:51
↓ 1 callersFunctionget_subfolders
(prefix)
mwmbl/crawler/app.py:408
↓ 1 callersMethodget_terms
(self)
mwmbl/tinysearchengine/completer.py:21
↓ 1 callersFunctionget_test_batches
()
mwmbl/crawler/stats.py:294
↓ 1 callersFunctionget_url_batches
()
analyse/export_urls.py:17
↓ 1 callersFunctionget_url_error_status
(item: Item)
mwmbl/indexer/index_batches.py:225
↓ 1 callersFunctionget_url_score
(url)
mwmbl/indexer/index_batches.py:58
↓ 1 callersFunctionget_urls
()
analyse/analyse_crawled_links.py:20
↓ 1 callersFunctionget_urls
()
analyse/analyse_crawled_domains.py:14
↓ 1 callersFunctionget_urls
()
mwmbl/indexer/links.py:13
↓ 1 callersFunctionget_user_id_hash_from_url
(url)
mwmbl/indexer/historical.py:23
↓ 1 callersFunctionget_wiki_score
(url)
mwmbl/tinysearchengine/rank.py:204
↓ 1 callersFunctionget_wiki_stats_urls
(n: int = 10)
analyse/wiki_stats.py:25
↓ 1 callersFunctiongrouper
(n: int, iterator: Iterator)
mwmbl/indexer/dedupe.py:46
↓ 1 callersFunctionhn_prior_map
Map domain -> 'high' | 'medium' hint from HN top-domain scores, else absent.
scripts/build_super_search_candidates.py:82
↓ 1 callersFunctionignored
(*exceptions)
mwmbl/justext/core.py:49
↓ 1 callersFunctionindex_reading_writing_multithreading
()
analyse/index_concurrency.py:48
↓ 1 callersFunctioninvalidate_api_key_cache
(key_hash: str)
mwmbl/search_auth.py:20
↓ 1 callersFunctionis_blank
Returns `True` if string contains only white-space characters or is empty. Otherwise `False` is returned.
mwmbl/justext/utils.py:30
↓ 1 callersMethoditer_content
(self, n)
test/test_ssrf.py:94
↓ 1 callersFunctionjustext_with_dom
Converts an HTML page into a list of classified paragraphs. Each paragraph is represented as instance of class ˙˙justext.paragraph.Paragraph˙
mwmbl/views.py:42
↓ 1 callersMethodlinks_density
(self)
mwmbl/justext/paragraph.py:62
↓ 1 callersFunctionload_recipe
(path: Path | str)
mwmbl/tinysearchengine/super_search_sources/recipe.py:54
↓ 1 callersFunctionmain
Run administrative tasks.
manage.py:7
↓ 1 callersFunctionmain
()
scripts/build_super_search_candidates.py:231
↓ 1 callersFunctionmain
()
scripts/check_search_api_key.py:118
↓ 1 callersFunctionmain
()
scripts/verify_user_ids_beta.py:50
↓ 1 callersFunctionmake_recipe_source
Wrap a recipe as a ``search(client, query, limit)`` adapter for ``SOURCES``.
mwmbl/tinysearchengine/super_search_sources/recipe.py:89
↓ 1 callersMethodorder_results
(self, terms: list[str], results: list[Document], is_complete: bool)
mwmbl/tinysearchengine/rank.py:336
↓ 1 callersMethodpredict
(self, X)
mwmbl/rankeval/ltr/baseline.py:12
↓ 1 callersMethodpredict
Generate a list of URLs as search results for the given query.
mwmbl/rankeval/evaluation/evaluate.py:25
↓ 1 callersMethodprepare_rankings
(self, gold_standard: DataFrame, url_database_path: str)
mwmbl/rankeval/evaluation/evaluate_oracle.py:22
↓ 1 callersFunctionpreprocess_documents
(documents, index_path)
mwmbl/indexer/index_batches.py:204
↓ 1 callersFunctionprint_feature_importances
Print top feature importances for XGBoost models.
mwmbl/rankeval/ltr/evaluate.py:35
↓ 1 callersFunctionprocess
(batches: Collection[HashedBatch])
mwmbl/indexer/index_batches.py:51
↓ 1 callersFunctionproducer
()
mwmbl/tinysearchengine/super_search.py:558
↓ 1 callersFunctionqueue_deduped_items
(deduped_pages)
mwmbl/indexer/dedupe.py:29
↓ 1 callersFunctionqueue_domains
()
mwmbl/indexer/domains/queue_domains.py:20
↓ 1 callersFunctionrandom_string
()
analyse/index_concurrency.py:13
↓ 1 callersMethodrecord_dataset
Record dataset statistics from a dataset submission.
mwmbl/crawler/stats.py:266
↓ 1 callersMethodrecord_results
(self, results: Results, username: str)
mwmbl/crawler/stats.py:256
↓ 1 callersFunctionredirectToSuggestions
()
front-end/src/utils/suggestions.js:8
↓ 1 callersFunctionregister_routers
Initialise and register all sub-routers on the v1 and v2 APIs. This is called from urls.py after Django app setup is complete, so that d
mwmbl/api.py:133
↓ 1 callersFunctionremove_curate_state
(state: DocumentState)
mwmbl/tinysearchengine/rank.py:228
↓ 1 callersMethodretrieve_batches
(self, num_batches)
mwmbl/indexer/batch_cache.py:49
↓ 1 callersFunctionretrieve_rankings
(query)
mwmbl/rankeval/dataset/search_api.py:41
↓ 1 callersFunctionretrieve_suggestions
(query)
mwmbl/rankeval/dataset/search_api.py:32
↓ 1 callersFunctionretrieve_title
(domain)
mwmbl/indexer/domains/domain_titles.py:61
↓ 1 callersFunctionretrieve_titles
(items)
mwmbl/indexer/domains/domain_titles.py:50
↓ 1 callersFunctionrobots_allowed
(url: str, redis: Redis)
mwmbl/crawler/retrieve.py:97
↓ 1 callersFunctionroot_domain
(d)
scripts/build_super_search_candidates.py:77
↓ 1 callersFunctionrun
()
analyse/wiki_stats.py:70
↓ 1 callersFunctionrun
()
analyse/stress_test_request.py:20
↓ 1 callersFunctionrun
()
analyse/add_term_info.py:24
↓ 1 callersFunctionrun
()
analyse/export_urls.py:28
↓ 1 callersFunctionrun
()
analyse/send_batch.py:12
↓ 1 callersFunctionrun
()
analyse/record_historical_batches.py:40
↓ 1 callersFunctionrun
()
analyse/analyse_crawled_links.py:31
↓ 1 callersFunctionrun
()
analyse/analyse_crawled_domains.py:50
↓ 1 callersFunctionrun
()
analyse/load_test.py:18
↓ 1 callersFunctionrun
()
analyse/index_url_count.py:7
↓ 1 callersFunctionrun
Main entry point (backward compatibility).
mwmbl/crawl.py:352
↓ 1 callersFunctionrun
()
mwmbl/main.py:10
↓ 1 callersFunctionrun
()
mwmbl/indexer/links.py:30
↓ 1 callersFunctionrun
()
mwmbl/indexer/dedupe.py:37
↓ 1 callersFunctionrun
()
mwmbl/indexer/historical.py:10
↓ 1 callersFunctionrun
()
mwmbl/indexer/domains/domain_titles.py:83
↓ 1 callersFunctionrun
()
mwmbl/rankeval/ltr/dataset.py:16
↓ 1 callersFunctionrun
()
mwmbl/rankeval/ltr/evaluate.py:71
↓ 1 callersFunctionrun
()
mwmbl/rankeval/dataset/queries.py:58
↓ 1 callersFunctionrun
()
mwmbl/rankeval/dataset/get_gold_rankings.py:39
↓ 1 callersFunctionrun
()
mwmbl/rankeval/evaluation/evaluate_remote.py:31
↓ 1 callersFunctionrun
()
mwmbl/rankeval/evaluation/evaluate_wiki.py:31
↓ 1 callersFunctionrun
()
mwmbl/rankeval/evaluation/evaluate_combined.py:24
↓ 1 callersFunctionrun
()
mwmbl/rankeval/evaluation/evaluate_ranker.py:23
↓ 1 callersFunctionrun
()
mwmbl/rankeval/evaluation/evaluate_oracle.py:35
↓ 1 callersFunctionrun_update_urls_on_fixed_batches
()
analyse/update_urls.py:10
↓ 1 callersFunctionsave_dataset
(dataset: list[dict[str, str]])
mwmbl/rankeval/dataset/queries.py:54
↓ 1 callersFunctionsave_dataset
(dataset: pd.DataFrame)
mwmbl/rankeval/dataset/extension_dataset.py:47
↓ 1 callersFunctionscore_match
(last_match_char, match_length, total_possible_match_length)
mwmbl/tinysearchengine/rank.py:76
↓ 1 callersFunctionscore_result_whole
Score a document using the combined whole-field match for promotion decisions. Uses match_score_whole from get_features() without the majority-te
mwmbl/tinysearchengine/rank.py:56
↓ 1 callersMethodsearch
(self, s: str, additional_results: list[Document])
mwmbl/tinysearchengine/mmr_rank.py:92
↓ 1 callersMethodsearch
(self, s: str, additional_results: list[Document])
mwmbl/tinysearchengine/rank.py:407
↓ 1 callersMethodserialize
(self, item)
mwmbl/indexer/fsqueue.py:32
↓ 1 callersFunctionsetupResultsLoadedListener
()
front-end/src/utils/events.js:29
↓ 1 callersMethodstopwords_count
(self, stopwords)
mwmbl/justext/paragraph.py:53
↓ 1 callersMethodstopwords_density
(self, stopwords)
mwmbl/justext/paragraph.py:56
↓ 1 callersFunctionstrip_query_string
(event)
mwmbl/settings_common.py:222
↓ 1 callersFunctionswitch_state
(state: Optional[DocumentState])
mwmbl/views.py:227
↓ 1 callersFunctionsync_search_counts
Bidirectional sync between Redis and UsageBucket, run once per hour. Step 1 (Postgres → Redis): seed any missing Redis keys from UsageBucket
mwmbl/background.py:92
↓ 1 callersMethodto_bytes
(self)
mwmbl/tinysearchengine/indexer.py:112
↓ 1 callersFunctiontotal_num_batches
()
analyse/record_historical_batches.py:16
↓ 1 callersMethodtransform
(self, X: DataFrame, y=None)
mwmbl/tinysearchengine/ltr.py:49
↓ 1 callersMethodupdate_domain_links
(self, source: str, target: set[str])
mwmbl/crawler/domains.py:51
← previousnext →301–400 of 929, ranked by callers