Monday, March 3, 2014
A colleague of mine was working on a cube. The cube had a fact table that was also a dimension. It had 18 million rows of data. When my colleague tried to process the cube with that fact and dimension, he couldn’t. Both the full and the incremental process didn’t work. He got an error on processing the large dimension with a message of:
Exception calling "Process" with "1" argument(s): "File system error: A FileStore error from WriteFile occurred. Physical file: . Logical file: . .
Errors in the OLAP storage engine: An error occurred while the 'RN' attribute of the 'YYYYY'...
Sunday, May 30, 2010
This is continued live blogging from the Donald Farmer seminar from the SQL & BI convention in Tel Aviv of Data Integration in Large Organizations.
SSIS 2008 Performance and Scalability
The importance of measuring to improve performance
Understand and measure hardware:How many CPU cores?How much memory?How fast is the I\O subsystem?
Understand the potential bottlenecks:Understand the limits of the Source System (usually a bottleneck as it's usually slower than the new system)
Gains from the source system:Find better driversConfigure the driverOptimize I\O and network configuration
Measure Speed per Connection: Row / sec = Row Count / Time of the data flow
Improving the speed of...