Go to https://jsoup.org/download, and download the jsoup-1.9.2.jar file. Add the JAR file to your Eclipse project an external library.

If you are a Maven fan, please follow the instructions on the download page to include the JAR file into your Eclipse project.

Create a method named extractDataWithJsoup(String url). The parameter is the URL of any webpage that you need to call the method. We will be extracting web data from this URL:

        public void extractDataWithJsoup(String href){  

Use the connect() method by sending the URL where we want to connect (and extract data). Then, we will be chaining a few more methods with it. First, we will chain the timeout() method that takes milliseconds as parameters. The methods after that define the user-agent name during this connection and whether attempts will be made to ignore connection errors. The next method to chain with the previous two is the get() method that eventually returns a Document object. Therefore, we will be holding this returned object in doc of the Document class:

        doc = 
          Jsoup.connect(href).timeout(10*1000).userAgent
            ("Mozilla").ignoreHttpErrors(true).get();

As this code throws IOException, we will be using a try...catch block as follows:

        Document doc = null; 
        try { 
         doc = Jsoup.connect(href).timeout(10*1000).userAgent
           ("Mozilla").ignoreHttpErrors(true).get(); 
           } catch (IOException e) { 
              //Your exception handling here 
        } 

A large number of methods can be found for a Document object. If you want to extract the title of the URL, you can use title method as follows:

         if(doc != null){ 
          String title = doc.title(); 

To only extract the textual part of the web page, we can chain the body() method with the text() method of a Document object, as follows:

        String text = doc.body().text();

If you want to extract all the hyperlinks in a URL, you can use the select() method of a Document object with the a[href]parameter. This gives you all the links at once:

        Elements links = doc.select("a[href]"); 

Perhaps you wanted to process the links in a web page individually? That is easy, too--you need to iterate over all the links to get the individual links:

        for (Element link : links) { 
            String linkHref = link.attr("href"); 
            String linkText = link.text(); 
            String linkOuterHtml = link.outerHtml(); 
            String linkInnerHtml = link.html();  
        System.out.println(linkHref + "t" + linkText + "t"  +  
          linkOuterHtml + "t" + linkInnterHtml);       
        }  

Finally, close the if-condition with a brace. Close the method with a brace: