We're now ready to write our first fully-fledged Julia program—a simple web crawler. This first iteration will make a request for Julia's Wikipedia page, will parse it and extract all the internal URLs, storing them in an Array.
The first thing we need to do is to set up a dedicated project. This is done by using Pkg. It is a very important step as it allows us to efficiently manage and version the packages on which our program depends.
For starters, we need a folder for our software. Create one—let's call it WebCrawler. I'll use Julia to make it, but you do it however you like:
julia> mkdir("WebCrawler")
"WebCrawler"
julia> cd("WebCrawler/")Now we can use Pkg to add the dependencies. When we start a new project, we need to initialise it. This is achieved with the following:
pkg> activate .This tells Pkg that we want to manage dependencies in the current project as opposed to doing it globally. You will notice that the...