metasploit-framework

https://github.com/rapid7/metasploit-framework

Ruby

Metasploit Framework

MetasploitModule#crawler_process_page

The main callback from the crawler, redefines crawler_process_page() as
defined by Msf::Auxiliary::HttpCrawler

Data we will report:
- The path of any URL found by the crawler (web.uri, :path => page.path)
- The occurence of any form (web.form :path, :type (get|post|path_info), :params)

Source | Google | Stack overflow

Edit

git clone [email protected]:rapid7/metasploit-framework.git

cd metasploit-framework

open modules/auxiliary/scanner/http/crawler.rb

Contribute

# Make a new branch

git checkout -b -your-name--update-docs-MetasploitModule-crawler_process_page-for-pr

# Commit to git

git add modules/auxiliary/scanner/http/crawler.rbgit commit -m "better docs for MetasploitModule#crawler_process_page"

# Open pull request

gem install hub # on a mac you can `brew install hub`

hub fork

git push <your name> -your-name--update-docs-MetasploitModule-crawler_process_page-for-pr

hub pull-request

# Celebrate!