All functions

as_absolute()

transform url to absolute

as_url2file()

transfrom a url to link to a file

base_name()

get base directory name of url

belong_to()

whether the url belong to a domain

dir_create()

recursive create directory it not exist

dir_name()

get directory name of url or path

download_dependencies()

download dependencies for a website

download_file()

using wget to download file

.queue()

wanted HTML file (absolute url) queue

remove_protocol()

remove 'protocol://' in url

rget()

download a static website

rget_html()

process a html file a time

shorten_url()

remove '?...#...' from url

test_url()

test whether a url can be accessed

tidy_url()

remove . and .. in url