Index

A

• access, Data Lake
  • direct data access / Access, analyze, and report
  • via BI tools / Access, analyze, and report
• Ad hoc analysis
  • about / User access
• ad hoc analysis, with Hive
  • about / Ad hoc analysis using Hive
• alternatives, for analysis
  • about / Other alternatives for analysis
  • RHadoop / RHadoop
  • Apache Giraph / Apache Giraph
  • Apache Mahout / Apache Mahout
  • Azure Machine Learning (ML) / Azure Machine Learning
• Amazon Elastic MapReduce
  • URL / Hadoop distributions
• Ambari
  • about / HDInsight and Hadoop relationship
• analytics
  • about / User access
• Apache Giraph
  • about / Apache Giraph
  • URL, for example / Apache Giraph
• Apache Hadoop
  • about / HDInsight and Hadoop relationship
• Apache Hive
  • about / Apache Hive
  • architecture / Hive architecture
  • starting, in HDInsight / Starting Hive in HDInsight
  • commands / Basic Hive commands
  • selecting / Pig or Hive
  • used, for registering refined data / Registering a refined and aggregate table using Hive
  • used, for registering aggregate table / Registering a refined and aggregate table using Hive
  • script, executing / Executing Hive script
• Apache Mahout
  • about / Apache Mahout
  • reference links / Apache Mahout
• Apache Pig
  • about / Apache Pig
  • features / Apache Pig
  • architecture / Pig architecture
  • starting, in HDInsight node / Starting Pig in HDInsight node
  • commands / Basic Pig commands
  • selecting / Pig or Hive
  • used, for cleaning data / Cleaning data using Pig
  • script, executing / Executing Pig script
• Apache Software Foundation (ASF) / HDInsight and Hadoop relationship
• Apache Tez
  • about / Apache Tez
• Application Containers / YARN overview
• application life cycle, YARN / YARN application life cycle
• Application Master / YARN overview
• Azure account
  • registering for / Registering for an Azure account
• Azure Blob Storage
  • accessing, Azure Powershell used / Access Azure Blob storage using Azure PowerShell
• Azure Blob storage
  • data loading, Azure PowerShell used / Loading data to Azure Blob storage using Azure PowerShell
• Azure Blob Storage data
  • importing, into Excel / Step 2 – importing Azure Blob storage data into Excel, Step 1 – importing Azure Blob storage data into Excel
• Azure HDInsight
  • about / HDInsight and Hadoop relationship
• Azure Machine Learning (ML)
  • about / Azure Machine Learning
  • URL / Azure Machine Learning
• Azure Management Studio
  • URL / Storage tools
• Azure Powershell
  • used, for provisioning HDInsight cluster / Provisioning using Azure PowerShell
  • URL / Provisioning using Azure PowerShell, Azure PowerShell
  • used, for accessing Azure Blob Storage / Access Azure Blob storage using Azure PowerShell
• Azure PowerShell
  • used, for loading data to Azure Blob storage / Loading data to Azure Blob storage using Azure PowerShell
• Azure storage
  • about / Azure storage
  • characteristics / Azure storage management
• Azure Storage Explorer
  • URL / Managing access keys, Storage tools
• Azure Storage Management
  • about / Azure storage management
  • storage account, configuring / Configuring your storage account
  • storage account, monitoring / Monitoring your storage account
  • access keys, managing / Managing access keys
  • storage account, deleting / Deleting your storage account

B

• basic commands, HDFS / HDFS basic commands
• BI dashboard
  • about / User access
• BI features, Excel
  • about / Other BI features in Excel
  • PowerPivot / PowerPivot
  • Power View / Power View and Power Map
  • Power Map / Power View and Power Map
  • map view, launching / Step 2 – launch map view
  • map, configuring / Step 3 – configure the map
  • Power BI Catalog / Power BI Catalog
• Big Data
  • about / Data is everywhere
  • business value / Business value of big data
  • use cases / Business value of big data
  • use cases, references / Business value of big data
• Blob storage
  • files, uploading to / Uploading files to your Blob storage
• Business Intelligence (BI) / Analysis using Excel Power Query

C

• Center of Excellence (COE), Data Lake
  • forming / Form a Data Lake Center of Excellence
• client, directories
  • staging / Organizing your Data Lake in HDFS
  • cleansed / Organizing your Data Lake in HDFS
  • summarized / Organizing your Data Lake in HDFS
• CloudBerry Explorer
  • URL / Storage tools
• Cloudera
  • URL / Hadoop distributions
• CloudFlow
  • about / User access
• CloudXplorer
  • URL / Storage tools
  • about / CloudXplorer
  • benefits / Key benefits
  • storage account, registering / Registering your storage account
  • files, uploading to Blob storage / Uploading files to your Blob storage
• cluster
  • exploring, Remote Desktop used / Exploring clusters using the remote desktop
  • deleting / Deleting the cluster
• cluster health
  • monitoring / Monitoring cluster health
• command-line interface (CLI) / Hive architecture
• components, ResourceManager
  • Scheduler / YARN overview
  • Applications Manager / YARN overview
• CONFIGURATION tab, HDInsight Management dashboard / Configuration
• containers, NodeManager
  • Application Master / YARN overview
  • Application Containers / YARN overview
• core components, Hadoop
  • Hadoop Common / Core components
  • Hadoop Distributed File System (HDFS) / Core components
  • YARN / Core components
  • MapReduce / Core components
• customer relationship management (CRM) / Source systems

D

• DASHBOARD page, HDInsight Management dashboard / Dashboard
• data
  • about / Data is everywhere
  • loading into Data Lake, HDFS command used / Ingesting to Data Lake using HDFS command
  • loading to Azure Blob storage, Azure PowerShell used / Loading data to Azure Blob storage using Azure PowerShell
  • importing, Sqoop used / Using Sqoop to import data (SQL to Hadoop)
  • importing, to Excel / Step 3 – importing data to Excel
  • analyzing, Excel used / Step 3 – analyzing data using Excel
• Data access
  • overview / Data access overview
• data analysis, with Excel and Microsoft Hive ODBC driver
  • about / Analysis using Excel and Microsoft Hive ODBC driver
  • prerequisites / Prerequisites
  • Microsoft Hive ODBC driver, installing / Step 1 – installing the Microsoft Hive ODBC driver
  • Hive ODBC Data Source, creating / Step 2 – creating Hive ODBC Data Source
  • data, importing to Excel / Step 3 – importing data to Excel
• data analysis, with Excel Power Query
  • about / Analysis using Excel Power Query
  • prerequisites / Prerequisites
  • Microsoft Power Query, installing for Excel / Step 1 – installing the Microsoft Power Query for Excel
  • Azure Blob Storage data, importing into Excel / Step 2 – importing Azure Blob storage data into Excel
  • data, analyzing with Excel / Step 3 – analyzing data using Excel
• Data Lake
  • about / Data Lake
  • data stores / Storage
  • processing mechanisms / Processing
  • enabling / Journey to your Data Lake dream
  • components / Journey to your Data Lake dream
  • ingestion and organization / Ingestion and organization
  • metadata / Ingestion and organization
  • transformation / Transformation (rules driven)
  • access / Access, analyze, and report
  • key projects / Tools and technology for Hadoop ecosystem
  • organizing, in HDFS / Organizing your Data Lake in HDFS
  • attributes / Managing file metadata using HCatalog
  • data transformation, tools / Tools for transforming data in Data Lake
  • HBase, positioning / HBase positioning in Data Lake and use cases
  • Storm, positioning / Storm positioning in Data Lake
  • challenges / Challenges on building a production Data Lake
  • production / The success path for a production Data Lake
  • big data problem, identifying / Identifying the big data problem
  • Hadoop-based, use cases / Identifying the big data problem
  • proof of technology (POT) / Proof of technology for Data Lake
  • Center of Excellence (COE), forming / Form a Data Lake Center of Excellence
  • executive sponsors / Executive sponsors
  • consumers / Data Lake consumers
  • development / Development
  • roles and responsibilities / Operations and infrastructure
  • Operations manager / Operations and infrastructure
  • Information security (Infosec) manager / Operations and infrastructure
  • Infrastructure architect / Operations and infrastructure
  • architecture / Architectural considerations
  • online resources / Online resources
• Data Lake, architecture
  • about / Architectural considerations
  • extensible and modular / Extensible and modular
  • considerations / Extensible and modular
  • metadata-driven solution / Metadata-driven solution
  • integration strategy / Integration strategy
  • security / Security
• Data Lake, using HDFS command
  • Hadoop client, connecting to / Connecting to a Hadoop client
  • files, obtaining on local storage / Getting your files on the local storage
  • HDFS, transferring to / Transferring to HDFS
• data sources, next generation architecture
  • OLTP / Source systems
  • XML and text files / Source systems
  • unstructured / Source systems
  • machine-generated data / Source systems
  • audio / Source systems
  • video / Source systems
  • images / Source systems
  • web clicks and logs / Source systems
  • social media / Source systems
• data stores, Data Lake
  • Hadoop HDFS / Storage
  • Hadoop HBase / Storage
  • Hadoop MPP databases / Storage
  • Legacy EDW and DM / Storage
• data stores, EDW
  • EDW / Storage
  • data mart / Storage
  • Master data management (MDM) / Storage
• data transformation
  • overview / Transformation overview
  • tools / Tools for transforming data in Data Lake, Other tools used for transformation
• data transformation tools, Data Lake
  • about / Tools for transforming data in Data Lake
  • HCatalog / HCatalog
  • HCatalog metastore / Persisting HCatalog metastore in a SQL database
  • Apache Hive / Apache Hive, Pig or Hive
  • Apache Pig / Apache Pig, Pig or Hive
  • MapReduce / MapReduce
  • Azure PowerShell / Azure PowerShell for execution of Hadoop jobs
  • Oozie / Oozie
  • Spark / Spark
• data warehouse, EDW architecture
  • about / Data warehouse
  • data stores / Storage
  • processing mechanisms / Processing
• directed acyclic graph (DAG) execution engine / Tools and technology for Hadoop ecosystem
• driver code, MapReduce / The driver code

E

• EDW architecture
  • about / Enterprise Data Warehouse architecture
  • diagrammatic representation / Enterprise Data Warehouse architecture
  • source systems / Source systems
  • data warehouse / Data warehouse
  • user access / User access
  • provisioning and monitoring / Provisioning and monitoring
  • data governance and security / Data governance and security
  • pain points / Pain points of EDW
• end-to-end Data Lake solution
  • about / End-to-end Data Lake solution
• Enterprise resource planning (ERP) / Source systems
• Excel
  • about / Analysis using Excel and Microsoft Hive ODBC driver
  • data, importing to / Step 3 – importing data to Excel
  • Microsoft Power Query, installing for / Step 1 – installing the Microsoft Power Query for Excel
  • Azure Blob Storage data, importing into / Step 2 – importing Azure Blob storage data into Excel, Step 1 – importing Azure Blob storage data into Excel
  • used, for analyzing data / Step 3 – analyzing data using Excel
  • BI features / Other BI features in Excel

F

• Falcon
  • about / HDInsight and Hadoop relationship
• file
  • writing, to HDFS / Writing a file to HDFS
  • reading, from HDFS / Reading a file from HDFS
• file metadata
  • managing, HCatalog used / Managing file metadata using HCatalog
• files
  • obtaining, on local storage / Getting your files on the local storage
  • loading to Data Lake, GUI tools used / Loading files to Data Lake using GUI tools
  • uploading, to Blob storage / Uploading files to your Blob storage
• files, Data Lake using GUI tools
  • storage access keys / Storage access keys
  • storage tools / Storage tools
  • CloudXplorer / CloudXplorer

G

• Genome Analysis Toolkit (GATK)
  • about / Processing
• Geo-Redundant storage (GRS)
  • about / Azure storage
• GUI tools
  • used, for loading files to Data Lake / Loading files to Data Lake using GUI tools

H

• Hadoop
  • concepts / Hadoop concepts
  • history / Brief history of Hadoop
  • core components / Core components
  • URL, for commands list / HDFS basic commands
• Hadoop, on Windows deployment options
  • about / Hadoop on Windows deployment options
  • Microsoft Azure HDInsight Service / Microsoft Azure HDInsight Service
  • HDInsight Emulator / HDInsight Emulator
  • Hortonworks Data Platform (HDP), for Windows / Hortonworks Data Platform (HDP) for Windows
• Hadoop Batch (MapReduce)
  • about / Processing
• Hadoop client
  • connecting to / Connecting to a Hadoop client
• Hadoop cluster layout
  • master nodes / Hadoop cluster layout
  • worker nodes / Hadoop cluster layout
• Hadoop Command Line
  • about / Monitoring cluster health
• Hadoop Common
  • about / Core components
• Hadoop Distributed File System (HDFS)
  • about / Core components
• Hadoop distributions
  • about / Hadoop distributions
  • Amazon Elastic / Hadoop distributions
  • Cloudera / Hadoop distributions
  • EMC PivitolHD / Hadoop distributions
  • Hortonworks HDP / Hadoop distributions
  • IBM BigInsights / Hadoop distributions
  • Microsoft HDInsight / Hadoop distributions
  • MapR / Hadoop distributions
• Hadoop ecosystem
  • tools and technology / Tools and technology for Hadoop ecosystem
• Hadoop HBase
  • about / Storage
• Hadoop HDFS
  • about / Storage
• Hadoop jobs
  • executing, with Azure Powershell / Azure PowerShell for execution of Hadoop jobs
• Hadoop MPP databases
  • about / Storage
• Hadoop Name Node Status
  • about / Name Node status
  • Overview page / The Name Node Overview page
  • Data Node Status / Datanode Status
  • Utilities menu option / Utilities and logs
  • Logs submenu / Utilities and logs
• Hadoop NameNode Status
  • about / Monitoring cluster health
  • URL / Monitoring cluster health
• Hadoop Oozie workflows
  • about / Processing
• Hadoop Real time (Tez)
  • about / Processing
• Hadoop Service Availability
  • about / Hadoop Service Availability
• Hadoop Service Availability Status
  • URL / Monitoring cluster health
  • about / Monitoring cluster health
• Hadoop Streaming (Storm)
  • about / Processing
• Hadoop Yarn Status
  • about / Monitoring cluster health
  • URL / Monitoring cluster health
• HBase
  • about / HBase, HBase additional information
  • features / HBase
  • positioning, in Data Lake / HBase positioning in Data Lake and use cases
  • use cases / HBase positioning in Data Lake and use cases
  • projects / HBase positioning in Data Lake and use cases
  • URL / HBase positioning in Data Lake and use cases, HBase additional information
  • HDInsight HBase cluster, provisioning / Provisioning HDInsight HBase cluster
  • connecting, with HBase shell / Connecting to HBase using the HBase shell
• HBase shell
  • launching / Connecting to HBase using the HBase shell
• HBase table
  • creating / Creating an HBase table
  • data, loading / Loading data to the HBase table
  • data, querying / Querying data from the HBase table
• HCatalog
  • used, for managing file metadata / Managing file metadata using HCatalog
  • benefits / Key benefits
  • Command Line used, for creating tables / Using HCatalog Command Line to create tables
  • about / HCatalog
• HCatalog Command Line
  • used, for creating tables / Using HCatalog Command Line to create tables
• HCatalog metastore
  • persisting, in SQL database / Persisting HCatalog metastore in a SQL database
• HDFS
  • overview / HDFS overview
  • file, writing to / Writing a file to HDFS
  • file, reading from / Reading a file from HDFS
  • basic commands / HDFS basic commands
  • transferring to / Transferring to HDFS
  • Data Lake, organizing in / Organizing your Data Lake in HDFS
• HDFS command
  • used, for loading data into Data Lake / Ingesting to Data Lake using HDFS command
• HDInsight
  • overview / HDInsight overview
  • Apache Hive, starting / Starting Hive in HDInsight
  • Apache Pig, starting / Starting Pig in HDInsight node
  • MapReduce, executing / Executing MapReduce on HDInsight
  • URL / HBase additional information
• HDInsight cluster
  • monthly pricing, estimating for / Registering for an Azure account
  • provisioning / Provisioning an HDInsight cluster
  • topology / Cluster topology
  • provisioning, Azure Powershell used / Provisioning using Azure PowerShell
• HDInsight distribution
  • key differentiators / HDInsight overview
• HDInsight documentation
  • URL / Online resources
• HDInsight Emulator
  • about / HDInsight overview, HDInsight Emulator
  • for development / HDInsight Emulator for the development
  • installing / Installing HDInsight Emulator
  • URL, for installing / Installing HDInsight Emulator
  • installation verification / Installation verification
  • using / Using HDInsight Emulator
• HDInsight HBase cluster
  • provisioning / Provisioning HDInsight HBase cluster
• HDInsight Management dashboard
  • about / HDInsight management dashboard
  • DASHBOARD page / Dashboard
  • MONITOR tab / Monitor
  • CONFIGURATION tab / Configuration
• HDInsight Storm cluster
  • provisioning / Provisioning HDInsight Storm cluster
• high-level Hadoop 2.0
  • core components / Core components
• Hive ODBC Data Source
  • creating / Step 2 – creating Hive ODBC Data Source
• Hortonworks Data Platform (HDP)
  • about / HDInsight and Hadoop relationship
• Hortonworks Data Platform (HDP), for Windows / Hortonworks Data Platform (HDP) for Windows
• Hortonworks HD
  • URL / Hadoop distributions

I

• IBM BigInsights
  • URL / Hadoop distributions
• Ingest to Report
  • data flow / Data access overview
• installation, HDInsight Emulator
  • about / Installing HDInsight Emulator
  • verification / Installation verification
• installation, Microsoft Hive ODBC driver / Step 1 – installing the Microsoft Hive ODBC driver
• installation, Microsoft Power Query
  • for Excel / Step 1 – installing the Microsoft Power Query for Excel

J

• journal nodes / Writing a file to HDFS

K

• Kafka
  • URL / Additional information on Storm
• key metadata, Data Lake
  • file inventory / Ingestion and organization
  • structural metadata / Ingestion and organization
  • user-defined information / Ingestion and organization
• key performance indicators (KPI) / User access, PowerPivot
• Knox
  • about / HDInsight and Hadoop relationship

L

• legacy EDW and DM
  • about / Storage
• legacy ETL
  • about / Processing
• Locally Redundant storage (LRS)
  • about / Azure storage
• logging
  • about / Configuring your storage account

M

• mapper code, MapReduce / The mapper code
• MapR
  • URL / Hadoop distributions
• MapReduce
  • about / Core components, MapReduce
  • URL / MapReduce
  • mapper code / The mapper code
  • reducer code / The reducer code
  • driver code / The driver code
  • executing, on HDInsight / Executing MapReduce on HDInsight
• master nodes
  • about / Hadoop cluster layout
  • functions / Hadoop cluster layout
• Microsoft
  • URL, for downloading Excel add-in / Step 1 – installing the Microsoft Power Query for Excel
• Microsoft Azure HDInsight Service / Microsoft Azure HDInsight Service
• Microsoft HDInsight
  • URL / Hadoop distributions
• Microsoft Hive ODBC driver
  • installing / Step 1 – installing the Microsoft Hive ODBC driver
  • URL, for downloading / Step 1 – installing the Microsoft Hive ODBC driver
• Microsoft Power Query
  • installing, for Excel / Step 1 – installing the Microsoft Power Query for Excel
• monitoring
  • about / Configuring your storage account
• MONITOR tab, HDInsight Management dashboard / Monitor

N

• NameNode
  • about / Hadoop cluster layout
• NameNode HA (High Availability)
  • about / Hadoop cluster layout
• National Human Genome Research Institute (NHGRI) / Benefits
• new HDInsight cluster
  • provisioning / Provisioning a new HDInsight cluster
• next generation Hadoop-based Enterprise data architecture
  • about / The next generation Hadoop-based Enterprise data architecture
  • source systems / Source systems
  • Data Lake / Data Lake
  • user access / User access
• NodeManager
  • containers / YARN overview
• NodeManager 2 (NodeMgr2) / YARN application life cycle
• Nutch Distributed Filesystem (NDFS) / Brief history of Hadoop

O

• On-Time Performance data
  • URL / End-to-end Data Lake solution
• online transactional processing (OLTP) / HDInsight overview
• Oozie
  • about / Oozie
• operational reports
  • about / User access
• OTP project
  • transformations / Transformation for the OTP project
• OTP project transformations
  • about / Transformation for the OTP project
  • steps / Transformation for the OTP project
  • data cleaning, Apache Pig used / Cleaning data using Pig
  • Pig script, executing / Executing Pig script
  • Hive script, executing / Executing Hive script
  • results, reviewing / Reviewing results

P

• pain points, EDW
  • about / Pain points of EDW
  • scale / Pain points of EDW
  • cost / Pain points of EDW
  • unstructured data / Pain points of EDW
  • timeliness / Pain points of EDW
• personal identifiable information (PII) / Security
• Platform as a Service (PaaS) / HDInsight overview
• plyrmr package / RHadoop
• Power BI Catalog
  • about / Power BI Catalog
  • URL / Power BI Catalog
• Power Map / Power View and Power Map
• PowerPivot / PowerPivot
• Power View / Power View and Power Map
• processing layer / Extensible and modular
• processing mechanisms, Data Lake
  • Hadoop Batch (MapReduce) / Processing
  • Hadoop Streaming (Storm) / Processing
  • Hadoop Real time (Tez) / Processing
  • Hadoop Oozie workflows / Processing
  • legacy ETL / Processing
• processing mechanisms, EDW
  • ETL / Processing
  • SQL-based stored procedures / Processing
• proof of technology (POT), Data Lake
  • about / Challenges on building a production Data Lake
  • objectives / Proof of technology for Data Lake
  • infrastructure considerations / Proof of technology for Data Lake
  • timeline and resources / Proof of technology for Data Lake
  • readout / Proof of technology for Data Lake

R

• ravro package / RHadoop
• Read Access Geo-Redundant storage (RA-GRS)
  • about / Azure storage
• reducer code, MapReduce / The reducer code
• Remote Desktop
  • used, for exploring cluster / Exploring clusters using the remote desktop
• replication
  • about / Configuring your storage account
• ResourceManager
  • components / YARN overview
• RHadoop
  • about / RHadoop
  • reference links / RHadoop
• rhbase package / RHadoop
• rhdfs package / RHadoop
• rmr package / RHadoop

S

• sample HBase schema
  • airline on-time performance table, creating / Designing the airline on-time performance table
  • connecting, with HBase shell / Connecting to HBase using the HBase shell
  • HBase table, creating / Creating an HBase table
  • data, loading to HBase table / Loading data to the HBase table
  • data, querying from HBase table / Querying data from the HBase table
• sample MapReduce
  • running / Running a sample MapReduce
• sample Storm topology
  • running / Running a sample Storm topology
  • connecting, with Storm shell / Connecting to Storm using Storm shell
  • Wordcount topology, running / Running the Storm Wordcount topology
  • Wordcount topology status, monitoring / Monitoring status of the Wordcount topology
• Secondary NameNode
  • about / Hadoop cluster layout
• solution, based on HDInsight
  • benefits / Benefits
• solution, HDInsight based
  • about / Solution
  • source systems / Source systems
  • storage / Storage
  • processing / Processing
  • user access / User access
• source systems, EDW architecture
  • about / Source systems
  • OLTP databases / Source systems
  • XML and text files / Source systems
• Spark
  • about / Spark
• spout / Storm key concepts
• SQL database
  • HCatalog metastore, persisting / Persisting HCatalog metastore in a SQL database
• Sqoop
  • used, for transferring data / Using Sqoop to move data from RDBMS to Data Lake
  • benefits / Key benefits
  • modes / Two modes of using Sqoop
  • used, for importing data / Using Sqoop to import data (SQL to Hadoop)
• Sqoop export
  • about / Two modes of using Sqoop
• Sqoop import
  • about / Two modes of using Sqoop
• Sqoop User Guide
  • URL / Using Sqoop to import data (SQL to Hadoop)
• storage access keys / Storage access keys
• storage account
  • registering / Registering your storage account
• Storage Container
  • creating / Creating a storage container
• storage tools
  • about / Storage tools
• Storm
  • about / Storm
  • features / Storm
  • positioning, in Data Lake / Storm positioning in Data Lake
  • key concepts / Storm key concepts
  • HDInsight Storm cluster, provisioning / Provisioning HDInsight Storm cluster
  • references / Additional information on Storm
  • URL / Additional information on Storm
• Storm shell
  • launching / Connecting to Storm using Storm shell
• Storm Wordcount topology
  • running / Running the Storm Wordcount topology
  • status, monitoring / Monitoring status of the Wordcount topology
• Storm Wordcount topology status
  • monitoring / Monitoring status of the Wordcount topology

T

• tail command / Using Sqoop to import data (SQL to Hadoop)
• Tez
  • about / HDInsight and Hadoop relationship
• tools, Hadoop ecosystem
  • Flume / Tools and technology for Hadoop ecosystem
  • Sqoop / Tools and technology for Hadoop ecosystem
  • HCatalog / Tools and technology for Hadoop ecosystem
  • Oozie / Tools and technology for Hadoop ecosystem
  • YARN / Tools and technology for Hadoop ecosystem
  • Pig / Tools and technology for Hadoop ecosystem
  • Spark / Tools and technology for Hadoop ecosystem
  • Tez / Tools and technology for Hadoop ecosystem
  • Hive / Tools and technology for Hadoop ecosystem
  • Excel / Tools and technology for Hadoop ecosystem
  • Mahout / Tools and technology for Hadoop ecosystem
  • Ambari / Tools and technology for Hadoop ecosystem
• top social media sites
  • URL / Data is everywhere
• trend analysis, Microsoft Azure / Data is everywhere

U

• use case, by Microsoft HDInsight
  • about / Use case powered by Microsoft HDInsight
  • problem statement / Problem statement
  • solution / Solution
  • benefits, of HDInsight based solution / Benefits
• use cases, Apache Mahout
  • collaborative filtering / Apache Mahout
  • clustering / Apache Mahout
  • categorization / Apache Mahout
  • frequent itemset / Apache Mahout
• user access, next generation Hadoop-based Enterprise data architecture
  • about / User access
  • provisioning and monitoring / Provisioning and monitoring
  • data governance / Data governance, security, and metadata
  • security / Data governance, security, and metadata
  • metadata / Data governance, security, and metadata
• user access mechanisms, EDW
  • BI dashboard / User access
  • Ad hoc analysis / User access
  • operational reports / User access
  • analytics / User access

W

• worker nodes
  • about / Hadoop cluster layout
  • functions / Hadoop cluster layout
• workloads, YARN
  • batch / YARN workloads
  • script / YARN workloads
  • interactive SQL / YARN workloads
  • streaming / YARN workloads
  • NoSQL / YARN workloads
  • in-memory / YARN workloads
  • search / YARN workloads

Y

• YARN
  • about / Core components
  • overview / YARN overview
  • application life cycle / YARN application life cycle
  • workloads / YARN workloads
• YARN Application Status
  • about / YARN Application Status
• YARN ResourceManager
  • about / Hadoop cluster layout

Z

• Zone Redundant Storage (ZRS)
  • about / Azure storage