DataStage Parallel Processing

Following figure represents one of the simplest jobs you could have — a data source, a Transformer (conversion) stage, and the data target. The links between the stages represent the flow of data into or out of a stage. In a parallel job, each stage would normally (but not always) correspond to a process. You can have multiple instances of each process to run on the available processors in your system. A parallel DataStage job incorporates two...

DataStage Best Practices

This section provides an overview of recommendations for standard practices. The recommendations are categorized as follows: * Standards * Development guidelines * Component usage * DataStage Data Types * Partitioning data * Collecting data * Sorting * Stage specific guidelines StandardsIt is important to establish and follow consistent standards in: * Directory structures for installation and application support directories. * Naming conventions, especially for DataStage Project categories, stage names, and links. All DataStage jobs should be...