Index
A
- ActiveMQ
- about / Introduction
- starting / Getting ready
- append method
- used, for concatenating files / Concatenating files using the append method
- auto increment keys
- about / Auto increment keys
- auto increment procedure
- about / Auto increment procedure
B
- batches / Batches
- benefits, repository schemas / Repository schemas
- binary error codes
- creating, for multiple test results storage / Creating binary error codes to store multiple test results, How to do it…, How it works…, There's more…
- decrypting / Decrypting the error code
- built-in schema
- hand-cranking / Hand-cranking a built-in schema, How to do it…
- bulk loading facility / Bulk loading
C
- capabilities, tMap component / The tMap component
- child job
- sessions, passing to / Passing a session to a child job, How it works…
- child jobs
- parameters, passing to / Passing parameters to a child job, There's more
- child tables
- surrogate keys, managing for / Managing surrogate keys for parent and child tables, How it works…
- code
- documenting / Before you begin
- code routine
- finding / Finding the code routine, How to do it…
- code routines
- about / Creating custom functions using code routines
- used, for creating custom functions / How to do it…, How it works…
- codes
- returning, from child job without tDie / Returning codes from a child job without tDie, How to do it…, There's more…
- code utilities, XMLUtils
- createDomFromString / Code utilities
- addChildAtPath / Code utilities
- DOMToString / Code utilities
- column
- checking, against list of allowed values / Checking a column against a list of allowed values
- checking, against lookup / Checking a column against a lookup, How to do it…, How it works…
- command line context parameters
- command line parameters
- passing, to job / Passing command line parameters
- compilation errors
- location, searching with problems tab / Find the location of compilation errors using the Problems tab, How to do it..., How it works...
- compiled executables
- creating / How to do it..., How it works…
- complex date formats
- about / Some complex date formats
- ISO 8601 with offset standard / Some complex date formats
- Mtime pattern / Some complex date formats
- complex hierarchical XML
- reading / Getting ready, How to do it..., How it works...
- relationships, managing / Managing the relationships
- file information / File information
- XML, to database mapping / XML to database mapping
- XPATH / XPATH
- web service XML / Web service XML
- complex logic
- adding, into flow / Adding complex logic into a flow using tJavaRow, How to do it…, How it works…
- complex queries / Multiple tables and complex queries
- complex test data
- creating, tRowGenerator component used / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
- creating, tFlowToIterate component used / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
- creating, tMap component used / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
- creating, sequences used / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
- complex XML
- writing / Writing complex XML, Method, How to do it..., How it works...
- component globalMap variables
- dragging / Dragging component globalMap variables
- conditional logic
- ternary operator, using for / Using the ternary operator for conditional logic, How it works…, There's more…
- considerations, databases
- efficiency versus readability / Efficiency versus readability
- SQL string / SQL string
- SQL style / SQL style
- console output
- execution errors, locating from / How to do it...
- context
- using, in SQL queries / Using context and globalMap variables in SQL queries
- printing out / How to do it...
- context file location
- setting, in operating system / Setting the context file location in the operating system, How to do it..., There’s more…
- context group
- about / Creating a context group
- creating / How to do it..., How it works...
- variable values, updaing in / Prompt for variable values using the tree mode
- adding, to job / How to do it..., How it works…
- contexts, adding to / How to do it..., There’s more…
- contexts
- common values / Common values in contexts
- adding, to context group / How to do it..., There’s more…
- loading, tContextLoad used / How to do it..., There’s more…
- loading, implicit context load used / Using implicit context loading to load contexts, How to do it...
- context types / Context types
- context variable
- finding / Finding a new context variable
- context variables
- about / Before you begin, Introduction, Context variables, Context Variables
- setting, tJava component used / Setting the context and globalMap variables using tJava, How to do it…
- setting, in code / Setting context variables in the code
- manipulating / Manipulating contexts in Talend Open Studio
- manipulating, pros / Manipulating contexts in Talend Open Studio
- manipulating, cons / Manipulating contexts in Talend Open Studio
- checking / Manually checking and setting contexts
- setting / Manually checking and setting contexts
- setting, pros / Manually checking and setting contexts
- checking, cons / Manually checking and setting contexts
- setting, cons / Manually checking and setting contexts
- checking, pros / Manually checking and setting contexts
- control files
- processing / Processing control/validation files, How to do it..., How it works...
- custom functions
- creating, code routines used / How to do it…, How it works…
D
- data
- joining, tMap component used / Joining data using tMap, How to do it..., How it works…
- database connection
- setting up, Talend supplied wizard used / Setting up a database connection, How to do it..., How it works...
- using / Using the connection
- considerations / Always create database connections, Context
- database context variables / Database context variables
- database management
- executing / Database and table management, How it works…
- databases
- considerations / There's more…
- database sessions
- managing / Managing database sessions, How to do it…, How it works…
- database tables
- reading from / Reading from database tables, How to do it…
- writing to / Writing to a database table, How it works…
- data formats, Talend
- about / There’s more...
- date patterns / Date patterns
- nullable elements / Nullable elements
- field lengths / Nullable elements
- keys / Nullable elements
- data integration
- about / Introduction
- data tables
- selected rows, filtering / Selected rows and columns
- selected columns, filtering / Selected rows and columns
- debugging
- about / Debugging
- Die on error option / Die on error
E
- enterprise scheduling tool
- about / Executable code
- errors
- capturing, for individual rows / Capturing individual rejects and errors, How it works…
- Excel
- used, for creating test data / Creating test data using Excel, How it works...
- executable code
- about / Executable code
- execution errors
- locating, from console output / How to do it...
F
- features, job / How it works…
- features, tMap component / tMap
- fields
- file
- records, appending to / Appending records to a file, How it works...
- header, adding to / Adding a header and trailer to a file, How it works...
- trailer, adding to / Adding a header and trailer to a file, How it works...
- copying, to different directory / Copying a file to another directory
- copying, to different name / Copying file to a different name
- renaming / Renaming a file
- moving / Moving a file
- deleting / Deleting a file
- logging data, dumping to / Dumping the console output to a file from within a job, How it works...
- file information
- capturing / Capturing file information, How to do it..., How it works...
- file management components / Moving, copying, renaming, and deleting files and folders
- files
- concatenating, append method used / Concatenating files using the append method
- creating, depending on input data / How to do it..., How it works...
- writing, depending on input data / How to do it..., How it works...
- fixed schemas
- about / Fixed schemas and columns
- flow
- complex logic, adding into / Adding complex logic into a flow using tJavaRow, How to do it…, How it works…
G
- generic schemas
- about / Generic schemas
- shared schemas / Shared schemas
- generated data sources / Generated data sources
- creating, from existing metadata / Creating a generic schema from the existing metadata, How to do it…, How it works…
- globalMap
- about / Before you begin
- globalMap variables
- setting, tJava component used / Setting the context and globalMap variables using tJava, How to do it…
- using, in SQL queries / Using context and globalMap variables in SQL queries
- about / The globalMap variables
H
- hashMap key table
- used, for adding efficiency / Added efficiency using hashMap key table
- hashMaps / How it works…
- header
- information, using in / Using the information in the header and trailer
- adding, to file / Adding a header and trailer to a file, How it works...
- header information
- using, in detail / Using the header information in the detail
- header information subjob
- headers
- reading, tMap component used / Reading headers and trailers using tMap, How to do it..., There's more…
- reading, with no identifiers / Reading headers and trailers with no identifiers, How to do it...
I
- implicit context load
- used, for loading contexts / Using implicit context loading to load contexts, How to do it...
- about / Turning implicit context loading on and off in a job
- turning off, in job / How to do it...
- turning on, in job / How to do it...
- implicit context load method / Implicit context load
- in-process database
- using / Background, How to do it…
- information
- using, in header / Using the information in the header and trailer
- using, in trailer / Using the information in the header and trailer
- input query
- printing / Printing your input query, How it works…
- input row
- splitting, into multiple outputs / Splitting an input row into multiple outputs based on input conditions, How to do it..., How it works…, There's more…
- input rows
- filtering / Filtering input rows, How it works…
- installation, Talend Open Studio / Installing the software, How to do it…
- intermediate data
- storing, in memory / Storing intermediate data in the memory using tHashMap, How it works...
- intermediate variables
- using, in tMap component / Using intermediate variables in tMap, How to do it…, How it works…
J
- JAR files
- Java / Before you begin
- Java debugger
- used, for debugging Talend jobs / Using the Java debugger to debug Talend jobs, How to do it..., How it works...
- Java Document format / How to do it...
- Java Document object
- about / Document objects
- Java DOM / Java DOM
- JDBC
- about / Introduction
- job
- context group, adding to / How to do it..., How it works…
- features / How it works…
- killing, from within tJavaRow component / Killing a job from within tJavaRow, How it works...
- values, adding / Adding job name, project name, and other job specific information
- job dependencies
- managing, within Talend / Managing job dependencies within Talend
- managing / Managing job dependencies, How it works…
- Die on error option / Die on error
- error checks, adding to schedule / Adding error checks to the schedule
- restartability, adding to job / Restartability
K
- keys
- updating / Update and delete keys
- deleting / Update and delete keys
- selecting / Selecting different fields and keys for insert, update, and delete, How to do it…, There's more...
L
- LastInsertId component / The LastInsertId component
- lists
- schemas, creating from / Creating schemas from lists, How to do it..., How it works…
- logging
- about / Logging
- logging data
- dumping, to file / Dumping the console output to a file from within a job, How it works...
- logic
- lookup
- columns, checking against / Checking a column against a lookup, How to do it…, How it works…
- lookups
- used, for creating random test / Creating random test data using lookups, How it works...
- lossless queue
- ensuring, sessions used / Ensuring lossless queues using sessions, How it works...
M
- memory
- intermediate data, storing in / Storing intermediate data in the memory using tHashMap, How it works...
- memory errors, stopping in Talend
- memory allocated, increasing of job / Increasing the memory allocated to a job
- lookup data, reducing / Reducing lookup data
- hashMap, using / Using hashMap/in-memory tables
- in-memory tables, using / Using hashMap/in-memory tables
- job, splitting / Splitting the job
- data, dropping to disk / Dropping data to disk
- files, splitting / Split the files
- hardware solutions / Hardware solutions
- message
- writing, to queue / How to do it...
- message queues
- about / Introduction
- metadata
- generic schema, creating from / Creating a generic schema from the existing metadata, How to do it…, How it works…
- missing tab
- restoring / Show view:
- MSDelimited component / There's more…
- multiple contexts
- using / Using a different context
- multiple files
- processing, at once / Processing multiple files at once, How it works...
- multiple outputs
- input rows, splitting into / Splitting an input row into multiple outputs based on input conditions, How to do it..., How it works…, There's more…
- multiple tables / Multiple tables and complex queries
- MySQL
- about / Introduction
N
- node / Node
- non-Talend objects
O
- ODS (Operational Data Store) / Introduction
- one-off logic
- adding, to job / How to do it…
- operating system
- context file location, setting in / Setting the context file location in the operating system, How to do it..., There’s more…
- operating system commands
- output query
- printing / Printing your output query, How it works…
P
- parameters
- passing, to child jobs / Passing parameters to a child job, There's more
- parent tables
- surrogate keys, managing for / Managing surrogate keys for parent and child tables, How it works…
- problems tab
- used, for searching location of compilation errors / Find the location of compilation errors using the Problems tab, How to do it..., How it works...
- pseudo components
- creating, tJavaFlex component used / How to do it…, How it works…
Q
- Quartz
- about / Executable code
- query
- developing / Developing the query
- queue
- message, writing to / How to do it...
R
- random test data
- creating, lookups used / Creating random test data using lookups, How it works...
- ranges / Ranges
- records
- appending, to file / Appending records to a file, How it works...
- regular expression (regex)
- about / Reading rows using a regular expression
- used, for reading rows / Reading rows using a regular expression, How it works..., There's more…
- rejected data
- reject flows
- about / Enabling and disabling reject flows
- enabling / How to do it…, How it works…
- disbaling / How to do it…, How it works…
- gathering / Gathering all rejects prior to killing a job, How to do it…, There's more...
- reject row facility
- erros, capturing for individual rows / Capturing individual rejects and errors, How it works…
- reload
- used, at each row for processing real-time data / Using reload at each row to process real-time / near real-time data, How to do it..., The result
- missing, at each row global variable / Reloads going missing at each row global variable, How to do it...
- reload at each row option / Batch versus real time
- repository schemas
- benefits / Repository schemas
- RESTful web service
- about / Introduction
- calling / Calling a RESTful web service, How it works...
- return codes
- rewritable lookups
- in-process database, using / Background, How to do it…
- row information
- displaying, tJavaRow component used / Using tJavaRow to display row information, How it works...
- rows
- components, rejecting / How to do it…
- rejecting, tMap used / Rejecting rows using tMap, How to do it…
- reading, regular expression used / Reading rows using a regular expression, How it works..., There's more…
S
- schema changes
- propagating / Propagating schema changes, How to do it…, How it works…
- schema information
- cutting / Cutting and pasting schema information
- psting / Cutting and pasting schema information
- schema metadata
- about / Schema metadata
- schemas
- about / Schemas
- repository schemas / Repository schemas
- generic schemas / Generic schemas
- fixed schemas / Fixed schemas and columns
- dropping / Dropping schemas to empty components, How it works…
- creating, from lists / Creating schemas from lists, How to do it..., How it works…
- sequences
- about / Sequences
- used, for creating complex test data / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
- sessions
- commit strategy, confirming / There's more…, Committing but not closing
- passing, to child job / Passing a session to a child job, How it works…
- used, for ensuring lossless queue / Ensuring lossless queues using sessions, How it works...
- shared schemas
- about / Shared schemas
- show view method / Show view:
- simple mapping
- single ternary expression / Single ternary expression: if-then-else
- SOAP web service
- about / Introduction
- calling / Calling a SOAP web service, How to do it..., There’s more…
- response, decoding / Decoding the response
- SQL queries
- context variables, using / Using context and globalMap variables in SQL queries
- globalMap variables, using / Using context and globalMap variables in SQL queries
- SQL string / SQL string
- SQL style / SQL style
- status messages
- displaying, tJava component used / How to do it...
- subjob component tab / Job "shape"
- surrogate keys
- managing, for parent tables / Managing surrogate keys for parent and child tables, How it works…
- managing, for child tables / Managing surrogate keys for parent and child tables, How it works…
- System.exit command / How it works...
T
- table related commands
- executing / Database and table management, How it works…
- tables
- creating / Creating tables
- table schemas
- importing / Importing the table schemas, How it works...
- Talend
- job dependencies, managing within / Managing job dependencies within Talend
- Talend 5.2.3
- Talend debug mode
- about / Using the Talend debug mode – row-by-row execution
- using, steps / How to do it..., How it works...
- Talend jobs
- about / Introduction
- debugging, Java debugger used / Using the Java debugger to debug Talend jobs, How to do it..., How it works...
- Talend Open Studio
- key concepts / Before you begin
- installing / Installing the software, How to do it…
- URL, for downloading / How to do it…
- context variables, manipulating / Manipulating contexts in Talend Open Studio
- Talend supplied wizard
- used, for setting up database connection / Setting up a database connection, How to do it..., How it works...
- tContextDump component
- about / How to do it...
- tContextLoad
- used, for loading contexts / How to do it..., There’s more…
- print operations / Print operations
- variations, of warnings / Warnings
- context file location / Context file location
- tContextLoad method
- about / Understanding tContextLoad
- pros / Understanding tContextLoad
- cons / Understanding tContextLoad
- tCreateFileTemporary component / How to do it...
- tCreateTemporaryFile component / How it works...
- tDie component / How to do it…, Validation subjob, Killing a job from within tJavaRow
- temporary files
- using / Using temporary files, How it works...
- ternary in ternary expression / Ternary in ternary: if-then-elsif-then-else
- ternary operator
- using, for conditional logic / Using the ternary operator for conditional logic, How it works…, There's more…
- tESBConsumer component
- about / How to do it...
- test data
- creating, tRowGenerator component used / How to do it..., How it works...
- creating, Excel used / Creating test data using Excel, How it works...
- testing
- about / Testing
- tFileCopy component / There's more…
- tFileDelete component / There's more…
- tFileInputDelimited component / How to do it…, There's more..., How it works…
- about / How to do it...
- tFileInputFullRow / How it works...
- tFileInputRegex / How to do it...
- tFileInputXML component
- about / How to do it...
- tFileList component / Concatenating files using the append method
- tFileOutputDelimited / How to do it...
- tFileOutputDelimited component / tJavaRow code explained
- tFileOutputMSDelimited / There's more…
- tFileProperties component / How to do it..., How it works...
- tFileRowCount component / How it works..., How it works...
- tFixedFlowInputs / How it works...
- tFlowToIterate / So here we go…
- tFlowToIterate component / How it works...
- about / tFlowToIterate
- used, for creating complex test data / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
- tHash components / So here we go…
- about / tHash components
- tHashInput
- enabling / Enabling tHashInput and tHashOutput
- tHashMap component
- used, for storing intermediate data in memory / Storing intermediate data in the memory using tHashMap, How it works...
- tHashOutput
- enabling / Enabling tHashInput and tHashOutput
- three-tier XML structure
- building / Method
- time servers, tMap component / Simple mapping and tMap time savers, How to do it..., How it works...
- tJava component / There's more…
- about / Performing one-off pieces of logic using tJava, Using tJava to display status messages and variables
- one-off logic, adding to job / How to do it…
- used, for setting globalMap variables / Setting the context and globalMap variables using tJava, How to do it…
- used, for setting context variables / Setting the context and globalMap variables using tJava, How to do it…
- used, for displaying status messages / How to do it...
- used, for displaying variables / How to do it...
- tJavaFlex component
- about / Creating pseudo components using tJavaFlex
- used, for creating pseudo components / How to do it…, How it works…
- tJavaRow component
- about / Adding complex logic into a flow using tJavaRow
- used, for adding complex logic into flow / Adding complex logic into a flow using tJavaRow, How to do it…, How it works…
- used, for displaying row information / Using tJavaRow to display row information, How it works...
- job, killing from within / Killing a job from within tJavaRow, How it works...
- tLogRow component
- used, for displaying data in row / Using tLogRow to show data in a row, How it works...
- tMap
- used, for rejecting rows / Rejecting rows using tMap, How to do it…
- tMap component
- about / The tMap component, Introduction
- capabilities / The tMap component
- flexibility feature / The tMap component
- single line of code / Single line of code
- batch versus real time / Batch versus real time
- time servers / Simple mapping and tMap time savers, How to do it..., How it works...
- espression editors / Expression editor
- intermediate variables, using / Using intermediate variables in tMap, How to do it…, How it works…
- input rows, filtering / Filtering input rows, How it works…
- used, for joining data / Joining data using tMap, How to do it..., How it works…
- data, joining in hierarchical fashion / Hierarchical joins using tMap
- reload, used at each row for processing real-time data / Using reload at each row to process real-time / near real-time data, How to do it..., The result
- features / tMap
- used, for reading headers / Reading headers and trailers using tMap, How to do it..., There's more…
- used, for reading trailers / Reading headers and trailers using tMap, How to do it..., There's more…
- used, for creating complex test data / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
- rejects, capturing / Capturing tMap rejects
- variables, printing / Printing tMap variables
- tMap expressions
- creating / Creating tMap expressions, How to do it..., How it works...
- testing / Testing expressions
- tMomCommit component
- about / There's more…
- tMomInput component
- about / There's more…
- tMysqlCommit component / Committing but not closing
- tMysqlConnection component
- about / How it works…
- tMysqlOutput component
- about / How it works…
- tMysqlRow component / How it works…
- trailer
- information, using in / Using the information in the header and trailer
- adding, to file / Adding a header and trailer to a file, How it works...
- trailer information
- used, for validation / Validating using the trailer information
- trailers
- reading, tMap component used / Reading headers and trailers using tMap, How to do it..., There's more…
- reading, with no identifiers / Reading headers and trailers with no identifiers, How to do it..., How it works...
- tRestClient component / How it works...
- tRowGenerator component
- about / Creating simple test data using tRowGenerator
- test data, creating / How to do it..., How it works...
- used, for creating complex test data / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
- tRunjob component
- about / How it works…
- tSchemaComplianceCheck component / Validating against the schema, How it works…
- tSystem component
- about / How to do it…, How it works…
- tWriteXMLField / So here we go…, tWriteXMLField
- tWriteXMLField component
- about / Introduction
- tXMLMap component
- about / Introduction
- used, for reading XML / Using tXMLMap to read XML, How to do it..., How it works...
- used, for creating XML document / Using tXMLMap to create an XML document, There's more…
- tXMLOutput component
- about / Introduction
U
- UI
- resetting, to original format / Reset the perspective
V
- validateCustomerAge method / How it works…
- validation files
- processing / Processing control/validation files, How to do it..., How it works...
- validation rules
- validation subjob / Validation subjob
- variables
- displaying, tJava component used / How to do it...
- variable values
- updating, in context group / Prompt for variable values using the tree mode
W
- web service calls in-flow
- using / Using web service calls in-flow
- web services
- about / Introduction
- web service XML / Web service XML
X
- XML
- reading, tXMLMap component used / Using tXMLMap to read XML, How to do it..., How it works...
- XML document
- creating, tXMLMap component used / Using tXMLMap to create an XML document, There's more…
- XML Schema Definition (XSD) / XML Structure
- XML Structure
- about / XML Structure
- XML structure
- about / Understanding the XML structure
- XPATH
- about / Introduction, XPATH
- XPATH Condition / XPATH Condition