page202
288
Figure 8-14.
Parallel processing high-level design
Adopting this design pattern for an existing application allows the selective
replacement of a poorly performing ingestion pipeline with highly performant
components and minimal system impact.
Setting Up Application Tables
In this section I will simulate an existing application raw or staging table along with a
target core table both populated with sample data. Figure 8-15 illustrates the immediate
objective.
Figure 8-15.
Setup objective
Begin by declaring a single-core table clustered in a geographic region and use an
X-Large warehouse due to high data volumes.
USE WAREHOUSE IDENTIFIER ( $tpc_warehouse_xl );
Chapter 8
parallelization