Summary
In this chapter, we learned what data governance is and why is it needed. Then, we briefly discussed the data governance framework. After that, we discussed how to develop a practical data governance solution using DataHub. Next, we learned what data security is and why it is needed. Finally, we briefly discussed the various solutions and tools that are available for ensuring data security.
With that, we have learned how to ingest data using real-time and batch-based pipelines, popular architectural patterns for data ingestion, and data governance and data security. In the next chapter, we will discuss how to publish the data as a service for downstream systems.