SSIS 2008 Performance and Scalability

Sunday, May 30, 2010

This is continued live blogging from the Donald Farmer seminar from the SQL & BI convention in Tel Aviv of Data Integration in Large Organizations.   SSIS 2008 Performance and Scalability   The importance of measuring to improve performance Understand and measure hardware:How many CPU cores?How much memory?How fast is the I\O subsystem? Understand the potential bottlenecks:Understand the limits of the Source System (usually a bottleneck as it's usually slower than the new system) Gains from the source system:Find better driversConfigure the driverOptimize I\O and network configuration Measure Speed per Connection: Row / sec = Row Count / Time of the data flow   Improving the speed of...

SSIS 2008 improvements over SSIS 2005

This is continued live blogging from the Donald Farmer seminar from the SQL & BI convention in Tel Aviv of Data Integration in Large Organizations. SSIS 2008 improvements over SSIS 2005 C# scripting can reference all .net assembliesVSA replaced by VSTA Pipeline Scale Up Tuning SSIS through looking at the buffers on the Data Flow.In SSIS 2005 you would add buffers and break up flows SSIS Tip: Tools > Options > BI Designers > IS Designers:Control Flow Data ConnectData Flow Data ConnectCheck them both to connect the components automatically Use Row Sampling component to do performance testing. One buffer structure goes all through the process.We...
5 comments