Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Index your code
hub
/
github.com/jaeles-project/gospider
/ functions
Functions
61 in github.com/jaeles-project/gospider
⨍
Functions
61
◇
Types & classes
8
↓ 18 callers
Method
String
Set implements the flag.Value interface.
stringset/set.go:120
↓ 17 callers
Method
WriteToFile
(msg string)
core/output.go:26
↓ 8 callers
Method
Duplicate
Duplicate checks if the name provided has been seen before by this filter.
stringset/filter.go:23
↓ 6 callers
Function
FixUrl
func FixUrl(site *url.URL, nextLoc string) string { var newUrl string if strings.HasPrefix(nextLoc, "//") { google.com/example.php newUrl = site.Schem
core/utils.go:72
↓ 6 callers
Method
Insert
Insert adds the element string argument to the receiver Set.
stringset/set.go:41
↓ 6 callers
Function
NewStringFilter
NewStringFilter returns an initialized StringFilter.
stringset/filter.go:16
↓ 5 callers
Method
Close
()
core/output.go:32
↓ 4 callers
Function
DecodeChars
(s string)
core/utils.go:146
↓ 4 callers
Function
GetExtType
(rawUrl string)
core/utils.go:107
↓ 4 callers
Method
Has
Has returns true if the receiver Set already contains the element string argument.
stringset/set.go:35
↓ 4 callers
Method
Set
Set implements the flag.Value interface.
stringset/set.go:125
↓ 3 callers
Function
New
New returns a Set containing the values provided in the arguments.
stringset/set.go:24
↓ 3 callers
Method
feedLinkfinder
(jsFileUrl string, OutputType string, source string, )
core/crawler.go:310
↓ 2 callers
Function
InScope
(u *url.URL, regexps []*regexp.Regexp)
core/utils.go:161
↓ 2 callers
Function
LinkFinder
(source string)
core/linkfinder.go:10
↓ 2 callers
Function
OtherSources
(domain string, includeSubs bool)
core/othersource.go:13
↓ 2 callers
Method
Remove
Remove will delete the element string from the receiver Set.
stringset/set.go:53
↓ 2 callers
Method
Slice
Slice returns a string slice that contains all the elements in the Set.
stringset/set.go:62
↓ 2 callers
Function
Unique
(intSlice []string)
core/utils.go:80
↓ 2 callers
Function
contains
(i []int,j int)
core/utils.go:205
↓ 2 callers
Method
findAWSS3
Find AWS S3 from response
core/crawler.go:577
↓ 2 callers
Method
findSubdomains
Find subdomains from response
core/crawler.go:546
↓ 1 callers
Function
CleanSubdomain
(s string)
core/utils.go:115
↓ 1 callers
Function
Examples
()
main.go:237
↓ 1 callers
Function
FilterNewLines
(s string)
core/utils.go:142
↓ 1 callers
Function
GetAWSS3
(source string)
core/grep.go:29
↓ 1 callers
Function
GetDomain
(site *url.URL)
core/utils.go:28
↓ 1 callers
Function
GetRawCookie
(cookies []*http.Cookie)
core/utils.go:19
↓ 1 callers
Function
GetSubdomains
(source, domain string)
core/grep.go:20
↓ 1 callers
Function
NewCrawler
(site *url.URL, cmd *cobra.Command)
core/crawler.go:76
↓ 1 callers
Function
NewOutput
(folder, filename string)
core/output.go:14
↓ 1 callers
Function
ParseRobots
(site *url.URL, crawler *Crawler, c *colly.Collector, wg *sync.WaitGroup)
core/robots.go:17
↓ 1 callers
Function
ParseSiteMap
(site *url.URL, crawler *Crawler, c *colly.Collector, wg *sync.WaitGroup)
core/sitemap.go:14
↓ 1 callers
Function
ReadingLines
ReadingLines Reading file and return content as []string
core/utils.go:179
↓ 1 callers
Method
Start
(linkfinder bool)
core/crawler.go:347
↓ 1 callers
Function
cleanName
Clean up the names scraped from the web. Get from Amass
core/utils.go:125
↓ 1 callers
Function
getCommonCrawlURLs
(domain string, noSubs bool)
core/othersource.go:102
↓ 1 callers
Function
getOtxUrls
(domain string, noSubs bool)
core/othersource.go:175
↓ 1 callers
Function
getVirusTotalURLs
(domain string, noSubs bool)
core/othersource.go:137
↓ 1 callers
Function
getWaybackURLs
(domain string, noSubs bool)
core/othersource.go:63
↓ 1 callers
Method
setupLinkFinder
Setup link finder
core/crawler.go:602
↓ 1 callers
Function
subdomainRegex
SubdomainRegex returns a Regexp object initialized to match subdomain names that end with the domain provided by the parameter.
core/grep.go:14
Function
Deduplicate
Deduplicate utilizes the Set type to generate a unique list of strings from the input slice.
stringset/set.go:19
Method
InsertMany
InsertMany adds all the elements strings into the receiver Set.
stringset/set.go:46
Method
Intersect
Intersect causes the receiver Set to only contain elements also found in the other Set argument.
stringset/set.go:98
Method
Len
Len returns the number of elements in the receiver Set.
stringset/set.go:83
Function
LoadCookies
(rawCookie string)
core/utils.go:92
Function
NormalizePath
NormalizePath the path
core/utils.go:171
Method
Subtract
Subtract removes all elements in the other Set argument from the receiver Set.
stringset/set.go:88
Function
TestFixUrl
(t *testing.T)
core/utils_test.go:12
Function
TestGetCommonCrawlURLs
(t *testing.T)
core/othersource_test.go:13
Function
TestGetExtType
(t *testing.T)
core/utils_test.go:7
Function
TestGetOtxUrls
(t *testing.T)
core/othersource_test.go:40
Function
TestGetVirusTotalURLs
(t *testing.T)
core/othersource_test.go:22
Function
TestGetWaybackURLs
(t *testing.T)
core/othersource_test.go:31
Function
TestOtherSources
(t *testing.T)
core/othersource_test.go:7
Function
Test_ParseJSSource
(t *testing.T)
core/linkfinder_test.go:5
Method
Union
Union adds all the elements from the other Set argument into the receiver Set.
stringset/set.go:76
Function
init
()
core/logger.go:12
Function
main
()
main.go:25
Function
run
(cmd *cobra.Command, _ []string)
main.go:72