The top part of the Utility panel is context-sensitive, depending on what kind of file is clicked on in the Navigation panel. The bottom part of the Utility panel has four tabs for the different library types used to drag-and-drop certain library-specific objects onto the Editor panel. Sometimes, the top part gets hidden under the bottom part of the panel, but you can drag the bottom part of the utility to reveal the content hidden under it.
The Utility panel is better understood once we jump through the project and look at each file individually.