Once the logs are collected by Datadog, they will be available on Log Explorer to view and search. The logs in the structured JSON format are processed by Datadog automatically. The unstructured logs can be processed further and analytical insights extracted. Datadog uses Pipelines and Processors to process the incoming logs.
To view the pipelines available, open the Logs | Configuration menu option from the main menu. The pipelines are listed under the Pipelines tab, as shown in the following sample screenshot:
A pipeline can be fed with a subset of logs and it uses a set of processors that are executed sequentially for processing the logs. There are predefined pipelines available based on the Datadog integrations currently in use, and they are enabled if related logs are collected by Datadog. It is also possible to set up custom pipelines to meet specific indexing requirements.