page193
279
Figure 8-8.
Sample data feed
Warehouse Factors
The investigation starts by identifying factors external to the feed process that may affect
data ingestion, starting with the warehouse. In this example and typical for most data
ingestion patterns, you will use an X-Small warehouse.
Answer these questions:
•
Are there any warehouse queueing, spills to disk, or OOMs evident?
•
Is the warehouse overloaded, queueing, or blocking?
•
Is the data feed overrunning its schedule leading to feeds backing up?
•
Are costs increasing over time?
Figure 8-9 illustrates the warehouse scaling options.
Chapter 8
parallelization